-- Logs begin at Sun 2022-10-30 00:05:05 UTC, end at Sun 2022-10-30 01:07:57 UTC. -- Oct 30 00:34:25.289976 dv-cinder-861491-6-smb systemd[1]: Starting Devstack devstack@keystone.service... Oct 30 00:34:25.298794 dv-cinder-861491-6-smb devstack@keystone.service[87945]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Oct 30 00:34:25.300818 dv-cinder-861491-6-smb devstack@keystone.service[87945]: *** Starting uWSGI 2.0.18-debian (64bit) on [Sun Oct 30 00:34:25 2022] *** Oct 30 00:34:25.300818 dv-cinder-861491-6-smb devstack@keystone.service[87945]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 30 00:34:25.300818 dv-cinder-861491-6-smb devstack@keystone.service[87945]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 30 00:34:25.300818 dv-cinder-861491-6-smb devstack@keystone.service[87945]: nodename: dv-cinder-861491-6-smb Oct 30 00:34:25.300818 dv-cinder-861491-6-smb devstack@keystone.service[87945]: machine: x86_64 Oct 30 00:34:25.300818 dv-cinder-861491-6-smb devstack@keystone.service[87945]: clock source: unix Oct 30 00:34:25.300818 dv-cinder-861491-6-smb devstack@keystone.service[87945]: pcre jit disabled Oct 30 00:34:25.300818 dv-cinder-861491-6-smb devstack@keystone.service[87945]: detected number of CPU cores: 4 Oct 30 00:34:25.300818 dv-cinder-861491-6-smb devstack@keystone.service[87945]: current working directory: / Oct 30 00:34:25.300818 dv-cinder-861491-6-smb devstack@keystone.service[87945]: detected binary path: /usr/bin/uwsgi-core Oct 30 00:34:25.300818 dv-cinder-861491-6-smb devstack@keystone.service[87945]: your processes number limit is 47680 Oct 30 00:34:25.301446 dv-cinder-861491-6-smb devstack@keystone.service[87945]: your memory page size is 4096 bytes Oct 30 00:34:25.301446 dv-cinder-861491-6-smb devstack@keystone.service[87945]: detected max file descriptor number: 2048 Oct 30 00:34:25.301446 dv-cinder-861491-6-smb devstack@keystone.service[87945]: lock engine: pthread robust mutexes Oct 30 00:34:25.301446 dv-cinder-861491-6-smb devstack@keystone.service[87945]: thunder lock: enabled Oct 30 00:34:25.301446 dv-cinder-861491-6-smb devstack@keystone.service[87945]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Oct 30 00:34:25.301446 dv-cinder-861491-6-smb devstack@keystone.service[87945]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Oct 30 00:34:25.339306 dv-cinder-861491-6-smb devstack@keystone.service[87945]: Python main interpreter initialized at 0x564aca4e19c0 Oct 30 00:34:25.339306 dv-cinder-861491-6-smb devstack@keystone.service[87945]: python threads support enabled Oct 30 00:34:25.339306 dv-cinder-861491-6-smb devstack@keystone.service[87945]: your server socket listen backlog is limited to 100 connections Oct 30 00:34:25.339306 dv-cinder-861491-6-smb devstack@keystone.service[87945]: your mercy for graceful operations on workers is 90 seconds Oct 30 00:34:25.339626 dv-cinder-861491-6-smb devstack@keystone.service[87945]: mapped 403077 bytes (393 KB) for 2 cores Oct 30 00:34:25.339626 dv-cinder-861491-6-smb devstack@keystone.service[87945]: *** Operational MODE: preforking *** Oct 30 00:34:25.339931 dv-cinder-861491-6-smb devstack@keystone.service[87945]: *** uWSGI is running in multiple interpreter mode *** Oct 30 00:34:25.339931 dv-cinder-861491-6-smb devstack@keystone.service[87945]: spawned uWSGI master process (pid: 87945) Oct 30 00:34:25.340136 dv-cinder-861491-6-smb systemd[1]: Started Devstack devstack@keystone.service. Oct 30 00:34:25.342414 dv-cinder-861491-6-smb devstack@keystone.service[87945]: spawned uWSGI worker 1 (pid: 87955, cores: 1) Oct 30 00:34:25.342414 dv-cinder-861491-6-smb devstack@keystone.service[87945]: spawned uWSGI worker 2 (pid: 87956, cores: 1) Oct 30 00:34:25.342414 dv-cinder-861491-6-smb devstack@keystone.service[87945]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 30 00:34:29.520017 dv-cinder-861491-6-smb devstack@keystone.service[87956]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 30 00:34:29.520017 dv-cinder-861491-6-smb devstack@keystone.service[87956]: from cryptography.utils import int_from_bytes Oct 30 00:34:29.520802 dv-cinder-861491-6-smb devstack@keystone.service[87955]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 30 00:34:29.520802 dv-cinder-861491-6-smb devstack@keystone.service[87955]: from cryptography.utils import int_from_bytes Oct 30 00:34:29.521218 dv-cinder-861491-6-smb devstack@keystone.service[87956]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 30 00:34:29.521218 dv-cinder-861491-6-smb devstack@keystone.service[87956]: from cryptography.utils import int_from_bytes Oct 30 00:34:29.521328 dv-cinder-861491-6-smb devstack@keystone.service[87955]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 30 00:34:29.521328 dv-cinder-861491-6-smb devstack@keystone.service[87955]: from cryptography.utils import int_from_bytes Oct 30 00:34:29.569188 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=87956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 30 00:34:29.569399 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=87956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 30 00:34:29.569486 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=87955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 30 00:34:29.569577 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG uwsgi [-] command line args: [] {{(pid=87956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 30 00:34:29.569654 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=87955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 30 00:34:29.569784 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=87956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 30 00:34:29.569879 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG uwsgi [-] command line args: [] {{(pid=87955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 30 00:34:29.569950 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG uwsgi [-] ================================================================================ {{(pid=87956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 30 00:34:29.570111 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=87955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 30 00:34:29.570243 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG uwsgi [-] admin_token = **** {{(pid=87956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:34:29.570321 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG uwsgi [-] ================================================================================ {{(pid=87955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 30 00:34:29.570451 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG uwsgi [-] config_dir = [] {{(pid=87956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:34:29.570596 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG uwsgi [-] admin_token = **** {{(pid=87955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:34:29.570682 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=87956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:34:29.570757 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG uwsgi [-] config_dir = [] {{(pid=87955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:34:29.570834 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG uwsgi [-] config_source = [] {{(pid=87956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:34:29.570906 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=87955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:34:29.570974 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG uwsgi [-] debug = True {{(pid=87956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:34:29.571042 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG uwsgi [-] config_source = [] {{(pid=87955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:34:29.571112 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=87956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:34:29.571398 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG uwsgi [-] debug = True {{(pid=87955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:34:29.571467 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=87955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:34:29.571558 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=87956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:34:29.571706 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG uwsgi [-] insecure_debug = False {{(pid=87956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:34:29.571784 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=87955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:34:29.571843 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG uwsgi [-] insecure_debug = False {{(pid=87955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:34:29.571898 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=87956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:34:29.572094 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=87955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:34:29.572213 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=87956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:34:29.572317 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=87955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:34:29.572393 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG uwsgi [-] list_limit = None {{(pid=87956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:34:29.572536 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG uwsgi [-] log_config_append = None {{(pid=87956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:34:29.572640 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG uwsgi [-] list_limit = None {{(pid=87955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:34:29.572714 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=87956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:34:29.572787 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG uwsgi [-] log_config_append = None {{(pid=87955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:34:29.572852 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG uwsgi [-] log_dir = None {{(pid=87956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:34:29.572909 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=87955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:34:29.573009 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG uwsgi [-] log_file = None {{(pid=87956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:34:29.573090 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG uwsgi [-] log_dir = None {{(pid=87955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:34:29.573226 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG uwsgi [-] log_file = None {{(pid=87955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:34:29.573345 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=87956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:34:29.573417 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=87955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:34:29.573481 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=87956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:34:29.573704 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=87955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:34:29.573785 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=87956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:34:29.573904 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=87955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:34:29.573990 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=87956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:34:29.574184 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=87956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:34:29.574331 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=87955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:34:29.574409 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=87956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:34:29.574484 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=87955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:34:29.574484 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=87955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:34:29.574622 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=87956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:34:29.574699 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=87955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:34:29.574772 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=87956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:34:29.574973 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=87956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:34:29.575121 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=87955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:34:29.575254 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=87956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:34:29.575452 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=87955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:34:29.575562 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=87956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:34:29.575798 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=87955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:34:29.575971 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=87956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:34:29.576138 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=87955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:34:29.576138 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=87955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:34:29.576435 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=87956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:34:29.576435 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG uwsgi [-] notification_format = cadf {{(pid=87956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:34:29.576761 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=87955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:34:29.576761 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG uwsgi [-] notification_format = cadf {{(pid=87955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:34:29.577022 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=87956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:34:29.577204 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=87955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:34:29.577372 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.42/identity {{(pid=87956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:34:29.577372 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG uwsgi [-] publish_errors = False {{(pid=87956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:34:29.577668 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.42/identity {{(pid=87955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:34:29.577843 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=87956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:34:29.578010 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG uwsgi [-] publish_errors = False {{(pid=87955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:34:29.578181 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=87956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:34:29.578346 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=87955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:34:29.578521 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=87956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:34:29.578660 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=87955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:34:29.578826 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=87956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:34:29.578960 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=87955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:34:29.579150 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=87956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:34:29.579299 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=87955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:34:29.579439 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG uwsgi [-] standard_threads = False {{(pid=87956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:34:29.579554 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=87955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:34:29.579665 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG uwsgi [-] strict_password_check = False {{(pid=87956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:34:29.579811 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG uwsgi [-] standard_threads = False {{(pid=87955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:34:29.579934 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=87956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:34:29.580047 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG uwsgi [-] strict_password_check = False {{(pid=87955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:34:29.580168 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG uwsgi [-] use_eventlog = False {{(pid=87956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:34:29.580168 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG uwsgi [-] use_journal = False {{(pid=87956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:34:29.580392 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=87955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:34:29.580536 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG uwsgi [-] use_json = False {{(pid=87956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:34:29.580702 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG uwsgi [-] use_eventlog = False {{(pid=87955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:34:29.580823 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG uwsgi [-] use_stderr = False {{(pid=87956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:34:29.580935 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG uwsgi [-] use_journal = False {{(pid=87955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:34:29.581046 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG uwsgi [-] use_syslog = False {{(pid=87956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:34:29.581158 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG uwsgi [-] use_json = False {{(pid=87955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:34:29.581268 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG uwsgi [-] watch_log_file = False {{(pid=87956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:34:29.581395 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG uwsgi [-] use_stderr = False {{(pid=87955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:34:29.581395 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG uwsgi [-] use_syslog = False {{(pid=87955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:34:29.581626 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=87956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.581745 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG uwsgi [-] watch_log_file = False {{(pid=87955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:34:29.581885 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=87956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.582004 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=87955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.582124 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=87956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.582238 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=87955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.582349 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=87956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.582465 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=87955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.582579 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=87956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.582689 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=87955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.582806 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=87956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.582925 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=87955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.583036 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=87956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.583146 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=87955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.583272 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=87956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.583384 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=87955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.583507 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=87956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.583621 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=87955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.583731 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=87956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.583875 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=87955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.583988 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=87956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.584104 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=87955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.584228 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=87956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.584340 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=87955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.584484 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=87956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.584628 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=87955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.584779 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=87956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.584899 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=87955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.585020 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=87956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.585139 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=87955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.585250 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=87956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.585387 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=87955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.585500 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=87956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.585618 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=87955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.585739 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=87956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.585851 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=87955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.585967 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=87956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.586078 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=87955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.586188 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=87956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.586297 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=87955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.586485 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=87956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.586601 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=87955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.586712 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=87956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.586830 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=87955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.586942 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=87956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.587060 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=87955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.587173 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=87956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.587298 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=87955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.587408 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=87956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.587408 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=87956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.587616 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=87955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.587739 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=87956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.587859 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=87955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.587970 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=87956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.588086 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=87955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.588197 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=87956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.588310 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=87955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.588428 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=87956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.588539 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=87955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.588655 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=87956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.588773 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=87955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.588884 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=87956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.588993 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=87955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.589114 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=87956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.589237 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=87955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.589354 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=87956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.589465 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=87955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.589575 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=87956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.589685 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=87955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.589803 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=87956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.589915 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=87955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.590030 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=87956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.590145 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=87955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.590256 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=87956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.590371 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=87955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.590491 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=87956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.590603 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=87955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.590720 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=87956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.590831 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=87955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.590941 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=87956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.591051 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=87955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.591169 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=87956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.591329 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=87955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.591440 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=87956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.591550 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=87955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.591661 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=87956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.591781 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=87955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.591975 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=87956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.592099 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=87955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.592210 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=87956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.592321 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=87955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.592430 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=87956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.592540 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=87955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.592663 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=87956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.592776 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=87955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.592894 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=87956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.593004 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=87955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.593114 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=87956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.593223 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=87955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.593341 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=87956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.593452 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=87955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.593562 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=87956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.593672 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=87955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.593789 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=87956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.593906 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=87955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.594030 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=87956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.594143 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=87955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.594259 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=87956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.594370 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=87955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.594465 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=87956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.594557 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=87955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.594658 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=87956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.594753 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=87955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.594846 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=87956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.594974 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=87955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.595079 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=87956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.595183 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=87955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.595302 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=87956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.595396 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=87955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.595490 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=87956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.595583 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=87955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.595675 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=87956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.595781 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=87955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.596045 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=87956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.596166 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=87955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.596286 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=87956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.596401 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=87955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.596512 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=87956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.596634 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=87955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.596759 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=87956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.596759 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=87956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.596985 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=87955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.597098 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=87956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.597208 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=87955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.597321 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=87956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.597437 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=87955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.597557 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=87956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.597675 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=87955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.597788 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=87956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.597890 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=87955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.598000 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=87956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.598111 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=87955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.598230 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=87956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.598350 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=87955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.598468 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=87956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.598589 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=87955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.598700 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=87956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.598820 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=87955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.598944 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG uwsgi [-] cache.enabled = True {{(pid=87956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.599068 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=87955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.599180 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=87956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.599329 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=87955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.599439 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=87956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.599549 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=87955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.599672 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=87956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.599786 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG uwsgi [-] cache.enabled = True {{(pid=87955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.599897 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=87956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.600006 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=87955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.600116 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=87956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.600238 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=87955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.600363 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=87956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.600476 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=87955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.600588 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=87956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.600588 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=87956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.600786 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=87955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.600896 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=87956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.601014 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=87955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.601127 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=87956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.601237 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=87955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.601237 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=87955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.601452 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=87956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.601562 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=87955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.601684 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=87956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.601797 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=87955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.601908 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=87956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.602024 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=87955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.602136 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=87956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.602136 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=87956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.602351 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=87955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.602463 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=87956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.602573 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=87955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.602683 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=87956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.602793 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=87955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.602902 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=87956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.603087 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=87955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.603217 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=87956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.603334 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=87955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.603446 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=87956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.603557 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=87955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.603681 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=87956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.603804 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=87955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.603924 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=87956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.604037 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=87955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.604148 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=87956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.604258 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=87955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.604369 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=87956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.604483 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=87955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.604602 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=87956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.604716 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=87955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.604826 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=87956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.604937 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=87955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.605048 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=87956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.605158 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=87955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.605277 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=87956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.605391 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=87955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.605502 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=87956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.605612 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=87955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.605723 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=87956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.605834 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=87955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.605952 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=87956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.606065 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=87955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.606177 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG uwsgi [-] auth.external = None {{(pid=87956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.606287 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=87955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.606398 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG uwsgi [-] auth.mapped = None {{(pid=87956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.606547 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=87955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.606669 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=87956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.606785 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=87955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.606905 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=87956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.607019 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=87955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.607131 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG uwsgi [-] auth.password = None {{(pid=87956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.607280 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG uwsgi [-] auth.external = None {{(pid=87955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.607394 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG uwsgi [-] auth.token = None {{(pid=87956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.607516 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG uwsgi [-] auth.mapped = None {{(pid=87955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.607644 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=87956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.607758 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=87955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.607871 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG uwsgi [-] catalog.caching = True {{(pid=87956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.607982 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=87955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.608100 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=87956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.608213 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG uwsgi [-] auth.password = None {{(pid=87955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.608332 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=87956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.608446 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG uwsgi [-] auth.token = None {{(pid=87955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.608557 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=87956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.608670 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=87955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.608780 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=87956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.608897 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG uwsgi [-] catalog.caching = True {{(pid=87955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.609022 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=87956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.609136 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=87955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.609248 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG uwsgi [-] credential.caching = True {{(pid=87956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.609359 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=87955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.609476 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG uwsgi [-] credential.driver = sql {{(pid=87956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.609589 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=87955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.609710 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=87956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.609825 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=87955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.609936 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=87956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.610047 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=87955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.610158 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=87956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.610272 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG uwsgi [-] credential.caching = True {{(pid=87955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.610392 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=87956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.610506 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG uwsgi [-] credential.driver = sql {{(pid=87955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.610617 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=87956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.610728 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=87955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.610840 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=87956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.610951 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=87955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.611073 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=87956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.611187 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=87955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.611315 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=87956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.611427 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=87955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.611539 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=87956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.611651 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=87955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.611775 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=87956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.611898 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=87955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.612011 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=87956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.612122 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=87955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.612232 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=87956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.612344 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=87955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.612463 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=87956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.612577 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=87955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.612687 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=87956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.612800 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=87955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.612912 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG uwsgi [-] federation.caching = True {{(pid=87956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.613023 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=87955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.613143 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=87956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.613256 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=87955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.613368 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG uwsgi [-] federation.driver = sql {{(pid=87956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.613490 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=87955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.613604 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=87956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.613716 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=87955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.613837 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=87956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.613951 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG uwsgi [-] federation.caching = True {{(pid=87955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.614062 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=87956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.614173 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=87955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.614291 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=87956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.614403 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG uwsgi [-] federation.driver = sql {{(pid=87955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.614523 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=87956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.614648 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=87955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.614761 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=87956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.614873 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=87955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.614985 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=87956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.615105 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=87955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.615232 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=87956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.615345 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=87955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.615457 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=87956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.615569 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=87955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.615691 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG uwsgi [-] identity.caching = True {{(pid=87956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.615815 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=87955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.615930 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=87956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.616042 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=87955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.616154 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=87956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.616265 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=87955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.616376 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=87956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.616872 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=87955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.616992 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=87956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.617105 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG uwsgi [-] identity.caching = True {{(pid=87955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.617216 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG uwsgi [-] identity.driver = sql {{(pid=87956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.617327 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=87955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.617439 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=87956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.617559 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=87955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.617679 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=87956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.617792 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=87955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.617904 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=87956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.618016 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=87955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.618128 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=87956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.618255 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG uwsgi [-] identity.driver = sql {{(pid=87955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.618375 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=87956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.618489 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=87955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.618601 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=87956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.618715 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=87955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.618826 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=87956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.618946 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=87955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.619066 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=87956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.619180 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=87955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.619336 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=87956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.619448 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=87955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.619560 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=87956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.619684 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=87955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.619798 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=87956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.619911 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=87955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.620024 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=87956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.620138 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=87955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.620254 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=87956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.620375 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=87955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.620488 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=87956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.620599 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=87955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.620719 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=87956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.620833 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=87955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.621024 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=87956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.621151 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=87955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.621267 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=87956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.621267 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=87956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.621477 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=87955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.621588 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=87956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.621700 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=87955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.621819 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=87956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.621933 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=87955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.622051 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=87956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.622165 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=87955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.622278 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=87956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.622389 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=87955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.622509 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=87956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.622622 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=87955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.622733 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=87956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.622844 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=87955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.622955 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=87956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.623066 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=87955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.623186 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=87956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.623318 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=87955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.623430 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=87956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.623542 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=87955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.623654 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=87956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.623765 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=87955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.623890 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=87956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.624005 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=87955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.624117 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=87956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.624228 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=87955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.624340 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG uwsgi [-] ldap.password = **** {{(pid=87956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.624451 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=87955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.624571 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=87956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.624685 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=87955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.624796 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=87956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.624907 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=87955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.624907 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=87955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.625124 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=87956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.625237 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=87955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.625349 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=87956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.625461 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG uwsgi [-] ldap.password = **** {{(pid=87955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.625573 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=87956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.625683 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=87955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.625803 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=87956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.625922 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=87955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.626036 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=87956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.626148 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=87955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.626259 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=87956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.626371 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=87955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.626492 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=87956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.626492 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=87956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.626703 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=87955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.626821 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=87956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.626936 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=87955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.627048 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=87956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.627869 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=87955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.627989 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=87956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.628103 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=87955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.628215 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=87956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.628328 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=87955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.628709 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG uwsgi [-] ldap.user = None {{(pid=87956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.629157 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=87955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.629274 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=87956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.629388 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=87955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.629500 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=87956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.629613 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=87955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.629733 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=87956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.629860 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=87955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.629975 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=87956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.630087 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=87955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.630199 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=87956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.630311 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG uwsgi [-] ldap.user = None {{(pid=87955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.630422 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=87956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.630543 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=87955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.630659 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=87956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.630659 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=87956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.630869 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=87955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.630981 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=87956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.631093 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=87955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.631093 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=87955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.631344 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=87956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.631456 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=87955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.631568 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=87956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.631568 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=87956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.631781 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=87955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.631781 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=87955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.632001 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=87956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.632113 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=87955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.632225 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=87956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.632337 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=87955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.632448 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=87956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.632568 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=87955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.632682 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=87956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.632795 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=87955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.632907 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=87956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.633018 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=87955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.633129 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=87956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.633250 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=87955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.633370 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=87956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.633483 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=87955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.633594 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=87956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.633706 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=87955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.633818 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=87956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.633938 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=87955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.634051 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=87956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.634163 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=87955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.634275 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=87956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.634386 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=87955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.634497 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=87956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.634620 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=87955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.634734 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=87956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.634847 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=87955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.634958 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=87956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.635069 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=87955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.635180 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG uwsgi [-] policy.driver = sql {{(pid=87956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.635365 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=87955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.635480 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=87956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.635606 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=87955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.635779 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=87956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.635888 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=87955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.636000 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=87956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.636121 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=87955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.636235 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG uwsgi [-] receipt.caching = True {{(pid=87956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.636347 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=87955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.636465 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=87956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.636465 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=87956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.636676 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG uwsgi [-] policy.driver = sql {{(pid=87955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.636676 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=87955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.636895 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=87956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.636895 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=87956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.637106 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=87955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.637217 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=87956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.637328 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=87955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.637448 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG uwsgi [-] resource.caching = True {{(pid=87956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.637562 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG uwsgi [-] receipt.caching = True {{(pid=87955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.637673 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=87956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.637785 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=87955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.637896 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG uwsgi [-] resource.driver = sql {{(pid=87956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.638009 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=87955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.638128 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=87956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.638242 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=87955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.638242 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=87955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.638451 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=87956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.638562 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=87955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.638673 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=87956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.638793 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG uwsgi [-] resource.caching = True {{(pid=87955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.638906 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG uwsgi [-] revoke.caching = True {{(pid=87956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.638906 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=87956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.639115 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=87955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.639245 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=87956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.639357 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG uwsgi [-] resource.driver = sql {{(pid=87955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.639481 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG uwsgi [-] role.cache_time = None {{(pid=87956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.639596 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=87955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.639708 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG uwsgi [-] role.caching = True {{(pid=87956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.639819 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=87955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.639931 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG uwsgi [-] role.driver = sql {{(pid=87956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.640043 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=87955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.640231 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG uwsgi [-] role.list_limit = None {{(pid=87956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.640347 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG uwsgi [-] revoke.caching = True {{(pid=87955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.640460 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=87956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.640614 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=87955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.640732 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=87956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.640855 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=87955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.640970 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=87956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.641081 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG uwsgi [-] role.cache_time = None {{(pid=87955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.641195 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=87956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.641307 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG uwsgi [-] role.caching = True {{(pid=87955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.641418 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=87956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.641538 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG uwsgi [-] role.driver = sql {{(pid=87955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.641651 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=87956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.641762 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG uwsgi [-] role.list_limit = None {{(pid=87955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.641873 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=87956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.641984 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=87955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.642095 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=87956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.642216 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=87955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.642337 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=87956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.642451 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=87955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.642569 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=87956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.642705 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=87955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.642803 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=87956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.642922 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=87955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.643036 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=87956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.643149 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=87955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.643285 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=87956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.643398 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=87955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.643398 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=87955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.643621 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=87956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.643736 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=87955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.643848 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=87956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.643960 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=87955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.644073 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=87956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.644185 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=87955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.644307 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=87956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.644422 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=87955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.644534 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=87956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.644647 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=87955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.644758 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=87956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.644758 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=87956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.644976 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=87955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.645089 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=87956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.645201 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=87955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.645315 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=87956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.645426 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=87955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.645546 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=87956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.645660 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=87955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.645771 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=87956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.645882 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=87955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.645993 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=87956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.646104 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=87955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.646223 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=87956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.646336 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=87955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.646448 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=87956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.646560 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=87955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.646671 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=87956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.646782 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=87955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.646901 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=87956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.647014 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=87955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.647126 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=87956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.647314 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=87955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.647430 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=87956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.647542 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=87955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.647667 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG uwsgi [-] token.cache_time = None {{(pid=87956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.647782 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=87955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.647893 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG uwsgi [-] token.caching = True {{(pid=87956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.648004 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=87955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.648116 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=87956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.648227 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=87955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.648347 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG uwsgi [-] token.provider = fernet {{(pid=87956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.648462 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=87955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.648574 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=87956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.648686 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=87955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.648797 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=87956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.648909 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=87955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.649028 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=87956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.649143 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG uwsgi [-] token.cache_time = None {{(pid=87955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.649255 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=87956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.649369 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG uwsgi [-] token.caching = True {{(pid=87955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.649482 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=87956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.649593 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=87955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.649713 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=87956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.649827 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG uwsgi [-] token.provider = fernet {{(pid=87955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.649938 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG uwsgi [-] trust.driver = sql {{(pid=87956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.650049 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=87955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.650160 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=87956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.650271 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=87955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.650396 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=87956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.650509 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=87955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.650622 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=87956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.650733 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=87955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.650844 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=87956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.650954 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=87955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.651074 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=87956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.651205 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=87955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.651320 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=87956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.651446 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG uwsgi [-] trust.driver = sql {{(pid=87955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.651568 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=87956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.651684 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=87955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.651795 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=87956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.651914 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=87955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.652028 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG uwsgi [-] database.connection = **** {{(pid=87956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.652139 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=87955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.652250 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=87956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.652361 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=87955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.652478 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=87956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.652599 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=87955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.652713 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=87956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.652825 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=87955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.652944 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=87956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.653066 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=87955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.653180 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=87956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.653292 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=87955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.653403 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=87956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.653523 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG uwsgi [-] database.connection = **** {{(pid=87955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.653637 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=87956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.653762 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=87955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.653883 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=87956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.653996 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=87955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.654108 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=87956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.654227 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=87955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.654340 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=87956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.654451 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=87955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.654562 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=87956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.654673 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=87955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.654785 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=87956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.654904 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=87955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.655018 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=87956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.655129 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=87955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.655253 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=87956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.655367 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=87955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.655478 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=87956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.655602 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=87955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.655717 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=87956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.655830 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=87955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.655941 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=87956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.656052 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=87955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.656163 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=87956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.656282 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=87955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.656397 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=87956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 30 00:34:29.656509 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=87955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.656509 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=87955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.656509 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=87955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.656509 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=87955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.656509 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=87955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.656509 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=87955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:34:29.656509 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=87955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 30 00:34:29.681092 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=87956) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 30 00:34:29.681317 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=87956) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 30 00:34:29.681538 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=87956) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 30 00:34:29.682012 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=87955) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 30 00:34:29.682245 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=87955) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 30 00:34:29.682470 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=87955) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 30 00:34:29.689825 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=87956) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 30 00:34:29.690877 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=87955) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 30 00:34:29.718550 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=87955) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 30 00:34:29.718699 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=87956) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 30 00:34:29.718778 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=87955) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 30 00:34:29.718855 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=87956) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 30 00:34:29.769978 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=87956) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 30 00:34:29.770770 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=87955) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 30 00:34:29.817258 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=87956) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 30 00:34:29.817489 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=87956) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 30 00:34:29.818476 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=87955) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 30 00:34:29.818712 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=87955) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 30 00:34:29.970202 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=87956) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 30 00:34:29.970408 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=87956) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 30 00:34:29.970667 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=87956) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 30 00:34:29.970885 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=87956) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 30 00:34:29.971098 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=87956) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 30 00:34:29.971313 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=87956) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 30 00:34:29.971413 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=87955) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 30 00:34:29.971573 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=87955) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 30 00:34:29.971782 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=87955) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 30 00:34:29.971989 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=87955) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 30 00:34:29.972214 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=87955) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 30 00:34:29.972434 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=87955) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 30 00:34:29.994338 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=87956) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 30 00:34:29.994468 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=87955) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 30 00:34:29.994545 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=87956) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 30 00:34:29.994645 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=87955) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 30 00:34:29.994754 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=87956) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 30 00:34:29.994906 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=87955) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 30 00:34:29.995033 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=87956) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 30 00:34:29.995111 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=87955) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 30 00:34:29.995187 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=87956) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 30 00:34:29.995347 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=87955) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 30 00:34:29.995439 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=87956) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 30 00:34:29.995597 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=87955) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 30 00:34:29.995690 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=87956) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 30 00:34:29.995764 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=87955) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 30 00:34:30.006481 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=87956) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 30 00:34:30.007054 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=87955) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 30 00:34:30.019182 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=87956) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 30 00:34:30.019441 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=87956) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 30 00:34:30.019639 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=87955) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 30 00:34:30.019786 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=87956) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 30 00:34:30.019871 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=87956) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 30 00:34:30.019944 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=87955) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 30 00:34:30.020014 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=87956) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 30 00:34:30.020086 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=87955) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 30 00:34:30.020254 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=87956) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 30 00:34:30.020395 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=87955) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 30 00:34:30.020474 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=87956) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 30 00:34:30.020551 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=87955) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 30 00:34:30.020708 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=87955) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 30 00:34:30.020978 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=87955) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 30 00:34:30.037051 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=87956) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:34:30.037253 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=87956) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 30 00:34:30.037554 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=87955) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:34:30.037679 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=87956) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:34:30.037756 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=87955) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 30 00:34:30.037832 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=87956) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 30 00:34:30.038035 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=87956) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:34:30.038159 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=87955) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:34:30.038237 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=87955) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 30 00:34:30.038311 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=87956) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:34:30.038534 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=87955) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:34:30.038789 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=87956) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:34:30.038917 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=87955) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:34:30.039026 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=87955) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:34:30.039114 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=87956) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:34:30.039345 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=87955) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:34:30.048457 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=87956) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:34:30.048761 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=87956) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:34:30.049064 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=87956) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:34:30.049179 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=87955) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:34:30.049316 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=87956) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:34:30.049462 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=87955) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:34:30.049745 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=87955) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:34:30.050042 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=87955) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:34:30.056382 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=87956) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 30 00:34:30.057125 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=87955) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 30 00:34:30.059274 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=87956) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 30 00:34:30.059582 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=87956) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:34:30.059866 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=87956) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:34:30.060077 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=87955) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 30 00:34:30.060198 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=87956) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:34:30.060358 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=87955) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:34:30.060480 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=87956) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:34:30.060653 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=87955) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:34:30.060775 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=87956) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:34:30.060926 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=87956) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:34:30.061047 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=87955) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:34:30.061197 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=87956) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:34:30.061333 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=87955) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:34:30.061411 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=87955) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:34:30.061544 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=87956) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:34:30.061664 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=87955) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:34:30.061850 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=87956) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:34:30.061987 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=87955) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:34:30.062070 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=87956) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:34:30.062221 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=87955) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:34:30.062484 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=87955) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:34:30.062848 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=87955) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:34:30.084815 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=87956) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:34:30.085939 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=87955) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:34:30.086276 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=87956) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 30 00:34:30.086560 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=87956) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:34:30.087437 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=87955) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 30 00:34:30.087720 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=87955) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:34:30.092398 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=87955) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 30 00:34:30.092685 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=87955) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:34:30.092961 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=87955) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:34:30.093082 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=87956) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 30 00:34:30.093309 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=87956) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:34:30.093589 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=87956) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:34:30.099383 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=87955) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 30 00:34:30.099670 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=87955) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:34:30.100262 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=87956) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 30 00:34:30.100551 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=87956) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:34:30.104722 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=87956) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 30 00:34:30.105012 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=87956) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:34:30.105293 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=87956) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:34:30.105414 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=87955) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 30 00:34:30.105576 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=87956) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:34:30.105718 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=87955) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:34:30.105825 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=87956) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:34:30.105986 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=87955) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:34:30.106111 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=87956) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:34:30.106240 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=87955) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:34:30.106381 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=87956) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:34:30.106549 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=87955) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:34:30.106672 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=87956) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:34:30.106786 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=87955) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:34:30.107078 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=87955) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:34:30.107376 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=87955) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:34:30.122690 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=87956) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:34:30.122969 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=87956) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:34:30.123438 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=87955) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:34:30.123716 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=87955) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:34:30.126887 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=87956) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 30 00:34:30.127572 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=87955) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 30 00:34:30.130106 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=87956) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:34:30.130409 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=87956) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:34:30.130752 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=87955) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:34:30.131052 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=87955) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:34:30.134642 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=87956) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 30 00:34:30.135226 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=87955) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 30 00:34:30.137817 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=87956) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 30 00:34:30.138378 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=87955) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 30 00:34:30.141080 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=87956) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:34:30.141340 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=87956) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:34:30.141644 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=87956) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:34:30.141765 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=87955) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:34:30.141940 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=87956) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:34:30.142063 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=87955) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:34:30.142256 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=87956) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:34:30.142352 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=87955) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:34:30.142561 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=87956) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:34:30.142684 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=87955) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:34:30.142912 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=87955) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:34:30.143228 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=87955) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:34:30.158475 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=87956) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 30 00:34:30.158764 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=87956) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:34:30.159034 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=87956) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:34:30.159155 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=87955) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 30 00:34:30.159295 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=87956) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:34:30.159503 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=87955) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:34:30.159772 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=87955) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:34:30.160035 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=87955) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:34:30.166192 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=87956) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:34:30.166882 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=87955) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:34:30.167762 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=87956) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:34:30.168462 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=87955) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:34:30.169326 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=87956) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:34:30.169604 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=87956) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:34:30.170017 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=87955) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:34:30.170300 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=87955) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:34:30.172252 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=87956) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 30 00:34:30.172539 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=87956) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:34:30.172924 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=87956) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:34:30.173195 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=87955) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 30 00:34:30.173317 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=87956) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:34:30.173511 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=87955) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:34:30.173633 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=87956) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:34:30.173796 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=87955) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:34:30.174075 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=87955) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:34:30.174452 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=87955) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:34:30.184632 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=87956) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 30 00:34:30.184924 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=87956) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:34:30.185311 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=87956) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:34:30.185593 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=87956) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:34:30.185714 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=87955) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 30 00:34:30.185884 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=87956) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:34:30.186007 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=87955) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:34:30.186171 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=87956) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:34:30.186294 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=87955) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:34:30.186446 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=87956) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:34:30.186582 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=87955) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:34:30.186858 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=87955) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:34:30.187143 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=87955) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:34:30.187454 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=87955) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:34:30.201865 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=87956) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 30 00:34:30.203088 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=87955) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 30 00:34:30.204816 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=87956) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 30 00:34:30.206043 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=87955) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 30 00:34:30.207740 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=87956) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:34:30.208953 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=87955) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:34:30.209135 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=87956) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:34:30.210453 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=87955) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:34:30.210778 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=87956) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 30 00:34:30.211062 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=87956) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:34:30.211365 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=87956) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:34:30.211975 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=87955) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 30 00:34:30.212259 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=87955) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:34:30.212658 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=87955) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:34:30.217708 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=87956) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:34:30.219112 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=87955) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:34:30.219256 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=87956) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 30 00:34:30.220647 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=87955) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 30 00:34:30.222278 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=87956) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:34:30.222564 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=87956) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:34:30.222844 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=87956) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:34:30.223121 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=87956) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:34:30.223536 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=87955) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:34:30.223933 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=87955) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:34:30.224217 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=87955) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:34:30.224495 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=87955) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:34:30.230946 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=87956) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 30 00:34:30.231222 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=87956) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:34:30.231539 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=87956) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:34:30.232323 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=87955) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 30 00:34:30.232616 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=87955) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:34:30.232900 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=87955) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:34:30.239305 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=87956) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 30 00:34:30.239589 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=87956) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:34:30.239872 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=87956) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:34:30.240006 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=87955) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 30 00:34:30.240123 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=87956) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:34:30.240212 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=87955) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:34:30.240429 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=87956) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:34:30.240565 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=87955) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:34:30.240655 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=87956) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:34:30.240733 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=87955) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:34:30.241254 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=87956) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:34:30.241376 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=87955) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:34:30.241551 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=87956) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:34:30.241652 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=87955) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:34:30.241873 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=87955) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:34:30.241995 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=87956) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:34:30.242125 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=87956) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:34:30.242216 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=87955) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:34:30.242411 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=87956) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:34:30.242534 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=87955) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:34:30.242652 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=87955) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:34:30.242751 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=87956) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:34:30.242932 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=87956) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:34:30.243055 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=87955) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:34:30.243162 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=87956) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:34:30.243272 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=87955) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:34:30.243536 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=87955) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:34:30.243827 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=87955) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:34:30.276166 dv-cinder-861491-6-smb devstack@keystone.service[87956]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x564aca4e19c0 pid: 87956 (default app) Oct 30 00:34:30.278020 dv-cinder-861491-6-smb devstack@keystone.service[87955]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x564aca4e19c0 pid: 87955 (default app) Oct 30 00:34:30.279534 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a4f630-790e-41e0-8492-4a0f6b941b8c None None] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:34:30.279817 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a4f630-790e-41e0-8492-4a0f6b941b8c None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:34:30.280089 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a4f630-790e-41e0-8492-4a0f6b941b8c None None] PATH_INFO: `/v3` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:34:30.284383 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 1/1] 10.222.0.42 () {50 vars in 791 bytes} [Sun Oct 30 00:34:30 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:34:37.018244 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6305cd-c4a6-4ee4-bb80-dc88f1e28ea7 None None] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:34:37.019123 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6305cd-c4a6-4ee4-bb80-dc88f1e28ea7 None None] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:34:37.019123 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6305cd-c4a6-4ee4-bb80-dc88f1e28ea7 None None] PATH_INFO: `/` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:34:37.026236 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 1/2] 10.222.0.42 () {54 vars in 927 bytes} [Sun Oct 30 00:34:37 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:34:37.032153 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db6f9db-19b1-417a-95d1-c4ee87e051ab None None] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:34:37.032597 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db6f9db-19b1-417a-95d1-c4ee87e051ab None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:34:37.032738 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db6f9db-19b1-417a-95d1-c4ee87e051ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:34:37.104209 dv-cinder-861491-6-smb devstack@keystone.service[87956]: INFO dbcounter [None req-2db6f9db-19b1-417a-95d1-c4ee87e051ab None None] Registered counter for database keystone Oct 30 00:34:37.126047 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG oslo_db.sqlalchemy.engines [None req-2db6f9db-19b1-417a-95d1-c4ee87e051ab None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87956) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 30 00:34:37.137668 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writer thread running {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 30 00:34:37.321679 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG passlib.handlers.bcrypt [None req-2db6f9db-19b1-417a-95d1-c4ee87e051ab None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=87956) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Oct 30 00:34:37.322020 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG passlib.handlers.bcrypt [None req-2db6f9db-19b1-417a-95d1-c4ee87e051ab None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=87956) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Oct 30 00:34:37.381637 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.auth.core [None req-2db6f9db-19b1-417a-95d1-c4ee87e051ab None None] MFA Rules not processed for user `eb55b6cbca4945abb21b0e49eb745e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=87956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:34:37.383327 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-2db6f9db-19b1-417a-95d1-c4ee87e051ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:34:37.523931 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 2/3] 10.222.0.42 () {58 vars in 1024 bytes} [Sun Oct 30 00:34:37 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 493 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Oct 30 00:34:37.985423 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6305cd-c4a6-4ee4-bb80-dc88f1e28ea7 None None] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:34:38.058407 dv-cinder-861491-6-smb devstack@keystone.service[87955]: INFO dbcounter [None req-7d6305cd-c4a6-4ee4-bb80-dc88f1e28ea7 None None] Registered counter for database keystone Oct 30 00:34:38.083529 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG oslo_db.sqlalchemy.engines [None req-7d6305cd-c4a6-4ee4-bb80-dc88f1e28ea7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87955) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 30 00:34:38.090655 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writer thread running {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 30 00:34:38.212488 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6305cd-c4a6-4ee4-bb80-dc88f1e28ea7 None None] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:34:38.217906 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8626b4ab-e478-4298-8b2e-c6daaa682fef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:34:38.218535 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8626b4ab-e478-4298-8b2e-c6daaa682fef admin admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:34:38.218814 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8626b4ab-e478-4298-8b2e-c6daaa682fef admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:34:38.219085 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8626b4ab-e478-4298-8b2e-c6daaa682fef admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:34:38.228412 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8626b4ab-e478-4298-8b2e-c6daaa682fef admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:34:38.279340 dv-cinder-861491-6-smb devstack@keystone.service[87955]: WARNING keystone.common.rbac_enforcer.enforcer [None req-8626b4ab-e478-4298-8b2e-c6daaa682fef admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Oct 30 00:34:38.279736 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8626b4ab-e478-4298-8b2e-c6daaa682fef admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:34:38.289929 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 2/4] 10.222.0.42 () {58 vars in 1324 bytes} [Sun Oct 30 00:34:37 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 30 00:34:38.297232 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db6f9db-19b1-417a-95d1-c4ee87e051ab None None] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:34:38.325022 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db6f9db-19b1-417a-95d1-c4ee87e051ab None None] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:34:38.331062 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c826fd66-af04-4794-8823-ddf675c7f83b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:34:38.332220 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c826fd66-af04-4794-8823-ddf675c7f83b admin admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:34:38.332498 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c826fd66-af04-4794-8823-ddf675c7f83b admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:34:38.332763 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c826fd66-af04-4794-8823-ddf675c7f83b admin admin] PATH_INFO: `/v3/projects/a39b871ca4334427a0ee2ffbee79352f` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:34:38.336683 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c826fd66-af04-4794-8823-ddf675c7f83b admin admin] RBAC: Authorizing `identity:get_project(project_id=a39b871ca4334427a0ee2ffbee79352f)` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:34:38.386688 dv-cinder-861491-6-smb devstack@keystone.service[87956]: WARNING keystone.common.rbac_enforcer.enforcer [None req-c826fd66-af04-4794-8823-ddf675c7f83b admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Oct 30 00:34:38.387030 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c826fd66-af04-4794-8823-ddf675c7f83b admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:34:38.391607 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 3/5] 10.222.0.42 () {56 vars in 1207 bytes} [Sun Oct 30 00:34:38 2022] GET /identity/v3/projects/a39b871ca4334427a0ee2ffbee79352f => generated 344 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:34:40.503068 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f8fda6-d35e-4173-a9a9-9cb2ff197eeb None None] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:34:40.503676 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f8fda6-d35e-4173-a9a9-9cb2ff197eeb None None] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:34:40.503676 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f8fda6-d35e-4173-a9a9-9cb2ff197eeb None None] PATH_INFO: `/` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:34:40.507712 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 3/6] 10.222.0.42 () {54 vars in 927 bytes} [Sun Oct 30 00:34:40 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:34:40.513941 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1429d2-d45b-48ee-a7a8-5bc50447d527 None None] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:34:40.514482 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1429d2-d45b-48ee-a7a8-5bc50447d527 None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:34:40.514573 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1429d2-d45b-48ee-a7a8-5bc50447d527 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:34:40.539415 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.auth.core [None req-4e1429d2-d45b-48ee-a7a8-5bc50447d527 None None] MFA Rules not processed for user `eb55b6cbca4945abb21b0e49eb745e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=87956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:34:40.541135 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-4e1429d2-d45b-48ee-a7a8-5bc50447d527 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:34:40.550748 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 4/7] 10.222.0.42 () {58 vars in 1024 bytes} [Sun Oct 30 00:34:40 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Oct 30 00:34:40.821807 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f8fda6-d35e-4173-a9a9-9cb2ff197eeb None None] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:34:40.842886 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f8fda6-d35e-4173-a9a9-9cb2ff197eeb None None] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:34:40.850384 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbd575d-b843-4325-b539-d198aa0c2880 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:34:40.851275 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbd575d-b843-4325-b539-d198aa0c2880 admin admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:34:40.851625 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbd575d-b843-4325-b539-d198aa0c2880 admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:34:40.852000 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbd575d-b843-4325-b539-d198aa0c2880 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:34:40.865264 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbd575d-b843-4325-b539-d198aa0c2880 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:34:40.868041 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbd575d-b843-4325-b539-d198aa0c2880 admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:34:40.877192 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 4/8] 10.222.0.42 () {58 vars in 1324 bytes} [Sun Oct 30 00:34:40 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 30 00:34:40.886061 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1429d2-d45b-48ee-a7a8-5bc50447d527 None None] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:34:40.900141 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1429d2-d45b-48ee-a7a8-5bc50447d527 None None] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:34:40.905106 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301bfe63-10ca-4434-a242-a588926f9bda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:34:40.905735 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301bfe63-10ca-4434-a242-a588926f9bda admin admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:34:40.906009 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301bfe63-10ca-4434-a242-a588926f9bda admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:34:40.906280 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301bfe63-10ca-4434-a242-a588926f9bda admin admin] PATH_INFO: `/v3/users/eb55b6cbca4945abb21b0e49eb745e1c` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:34:40.907714 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301bfe63-10ca-4434-a242-a588926f9bda admin admin] RBAC: Authorizing `identity:get_user(user_id=eb55b6cbca4945abb21b0e49eb745e1c)` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:34:40.909557 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301bfe63-10ca-4434-a242-a588926f9bda admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:34:40.911048 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 5/9] 10.222.0.42 () {56 vars in 1198 bytes} [Sun Oct 30 00:34:40 2022] GET /identity/v3/users/eb55b6cbca4945abb21b0e49eb745e1c => generated 247 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:34:43.076415 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2812b0-803f-445c-a078-4a1ac9cca2b8 None None] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:34:43.076845 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2812b0-803f-445c-a078-4a1ac9cca2b8 None None] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:34:43.076946 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2812b0-803f-445c-a078-4a1ac9cca2b8 None None] PATH_INFO: `/` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:34:43.078304 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 5/10] 10.222.0.42 () {54 vars in 927 bytes} [Sun Oct 30 00:34:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:34:43.083575 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b479e9-94ab-462b-8d93-02f6af81b82b None None] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:34:43.084030 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b479e9-94ab-462b-8d93-02f6af81b82b None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:34:43.084115 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b479e9-94ab-462b-8d93-02f6af81b82b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:34:43.103048 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.auth.core [None req-67b479e9-94ab-462b-8d93-02f6af81b82b None None] MFA Rules not processed for user `eb55b6cbca4945abb21b0e49eb745e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=87956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:34:43.104254 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-67b479e9-94ab-462b-8d93-02f6af81b82b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:34:43.156548 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270bff2f-1977-424a-b606-17329943c337 None None] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:34:43.156821 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270bff2f-1977-424a-b606-17329943c337 None None] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:34:43.157095 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270bff2f-1977-424a-b606-17329943c337 None None] PATH_INFO: `/` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:34:43.158431 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 6/11] 10.222.0.42 () {54 vars in 927 bytes} [Sun Oct 30 00:34:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:34:43.163453 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93394fea-37a6-4432-b20a-18992be5d941 None None] REQUEST_METHOD: `POST` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:34:43.163744 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93394fea-37a6-4432-b20a-18992be5d941 None None] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:34:43.164019 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93394fea-37a6-4432-b20a-18992be5d941 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:34:43.189251 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 6/12] 10.222.0.42 () {58 vars in 1024 bytes} [Sun Oct 30 00:34:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 30 00:34:43.206928 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG passlib.handlers.bcrypt [None req-93394fea-37a6-4432-b20a-18992be5d941 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=87955) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Oct 30 00:34:43.207376 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG passlib.handlers.bcrypt [None req-93394fea-37a6-4432-b20a-18992be5d941 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=87955) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Oct 30 00:34:43.255896 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.auth.core [None req-93394fea-37a6-4432-b20a-18992be5d941 None None] MFA Rules not processed for user `eb55b6cbca4945abb21b0e49eb745e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=87955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:34:43.257624 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-93394fea-37a6-4432-b20a-18992be5d941 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:34:43.357323 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 7/13] 10.222.0.42 () {58 vars in 1024 bytes} [Sun Oct 30 00:34:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 30 00:34:43.448607 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b479e9-94ab-462b-8d93-02f6af81b82b None None] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:34:43.472938 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=100 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:34:43.553060 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b479e9-94ab-462b-8d93-02f6af81b82b None None] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:34:43.586946 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d1cfc6-cc28-43f4-8bb4-9e9557f00388 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:34:43.587605 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d1cfc6-cc28-43f4-8bb4-9e9557f00388 None admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:34:43.587883 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d1cfc6-cc28-43f4-8bb4-9e9557f00388 None admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:34:43.588152 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d1cfc6-cc28-43f4-8bb4-9e9557f00388 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:34:43.599358 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d1cfc6-cc28-43f4-8bb4-9e9557f00388 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 30 00:34:43.608550 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application [None req-96d1cfc6-cc28-43f4-8bb4-9e9557f00388 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 30 00:34:43.608550 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:34:43.608550 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:34:43.608550 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:34:43.608550 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:34:43.608550 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:34:43.608550 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:34:43.608550 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:34:43.608550 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:34:43.608550 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:34:43.608550 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:34:43.608550 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:34:43.608550 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 30 00:34:43.608550 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 30 00:34:43.608550 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 30 00:34:43.608550 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 30 00:34:43.609444 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 30 00:34:43.609444 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 30 00:34:43.609444 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 30 00:34:43.609444 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 30 00:34:43.609444 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:34:43.609444 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:34:43.609444 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:34:43.609444 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:34:43.609444 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:34:43.609444 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:34:43.609444 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:34:43.609444 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application with Lock( Oct 30 00:34:43.609444 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:34:43.609444 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:34:43.609444 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:34:43.609444 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:34:43.610448 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:34:43.610448 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:34:43.610448 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:34:43.610448 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:34:43.610448 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 30 00:34:43.610448 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 30 00:34:43.610448 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 30 00:34:43.610448 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 30 00:34:43.610448 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 30 00:34:43.610448 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 30 00:34:43.610448 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 30 00:34:43.610448 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application Oct 30 00:34:43.610448 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 7/14] 10.222.0.42 () {56 vars in 1096 bytes} [Sun Oct 30 00:34:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:34:43.615544 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93394fea-37a6-4432-b20a-18992be5d941 None None] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:34:43.619778 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d1cfc6-cc28-43f4-8bb4-9e9557f00388 None admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:34:43.699704 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=100 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:34:43.716943 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93394fea-37a6-4432-b20a-18992be5d941 None None] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:34:43.718492 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d1cfc6-cc28-43f4-8bb4-9e9557f00388 None admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:34:43.719248 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=100 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:34:43.752866 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eab8e73-fb2b-4de1-8616-c00cf8a91b16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:34:43.753482 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eab8e73-fb2b-4de1-8616-c00cf8a91b16 None admin] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:34:43.753754 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eab8e73-fb2b-4de1-8616-c00cf8a91b16 None admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:34:43.754019 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eab8e73-fb2b-4de1-8616-c00cf8a91b16 None admin] PATH_INFO: `/v3/domains` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:34:43.754311 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6a7f64-19fe-4e7e-8310-02d499323095 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:34:43.754693 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eab8e73-fb2b-4de1-8616-c00cf8a91b16 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:34:43.755222 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6a7f64-19fe-4e7e-8310-02d499323095 None admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:34:43.755510 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6a7f64-19fe-4e7e-8310-02d499323095 None admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:34:43.755779 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6a7f64-19fe-4e7e-8310-02d499323095 None admin] PATH_INFO: `/v3/roles` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:34:43.756153 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eab8e73-fb2b-4de1-8616-c00cf8a91b16 None admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:34:43.756617 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6a7f64-19fe-4e7e-8310-02d499323095 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:34:43.756920 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6a7f64-19fe-4e7e-8310-02d499323095 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:34:43.758412 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6a7f64-19fe-4e7e-8310-02d499323095 None admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:34:43.766680 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.sql.core [None req-0eab8e73-fb2b-4de1-8616-c00cf8a91b16 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Oct 30 00:34:43.766680 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 30 00:34:43.766680 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [parameters: {'id': 'f6be90a7013c49f98106722ba3a0d4b9', 'name': 'Default', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] Oct 30 00:34:43.766680 dv-cinder-861491-6-smb devstack@keystone.service[87956]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=87956) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 30 00:34:43.770577 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 8/15] 10.222.0.42 () {56 vars in 1099 bytes} [Sun Oct 30 00:34:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:34:43.776209 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6a7f64-19fe-4e7e-8310-02d499323095 None admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:34:43.783583 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application [None req-0eab8e73-fb2b-4de1-8616-c00cf8a91b16 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default. Oct 30 00:34:43.783583 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:34:43.783583 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 30 00:34:43.783583 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 30 00:34:43.783583 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 30 00:34:43.783583 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 30 00:34:43.783583 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 30 00:34:43.783583 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application result = self._query(query) Oct 30 00:34:43.783583 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 30 00:34:43.783583 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application conn.query(q) Oct 30 00:34:43.783583 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 30 00:34:43.783583 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 30 00:34:43.783583 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 30 00:34:43.783583 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application result.read() Oct 30 00:34:43.784514 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 30 00:34:43.784514 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 30 00:34:43.784514 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 30 00:34:43.784514 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 30 00:34:43.784514 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 30 00:34:43.784514 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 30 00:34:43.784514 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 30 00:34:43.784514 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 30 00:34:43.784514 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Oct 30 00:34:43.784514 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application Oct 30 00:34:43.784514 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 30 00:34:43.784514 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application Oct 30 00:34:43.784514 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:34:43.784514 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 30 00:34:43.784514 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 30 00:34:43.784514 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Oct 30 00:34:43.784514 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return project_ref.to_dict() Oct 30 00:34:43.784514 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 30 00:34:43.785621 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application next(self.gen) Oct 30 00:34:43.785621 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1068, in _transaction_scope Oct 30 00:34:43.785621 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application yield resource Oct 30 00:34:43.785621 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 30 00:34:43.785621 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application next(self.gen) Oct 30 00:34:43.785621 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 670, in _session Oct 30 00:34:43.785621 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application self.session.rollback() Oct 30 00:34:43.785621 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 30 00:34:43.785621 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application self.force_reraise() Oct 30 00:34:43.785621 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 30 00:34:43.785621 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application raise self.value Oct 30 00:34:43.785621 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 667, in _session Oct 30 00:34:43.785621 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 30 00:34:43.785621 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 695, in _end_session_transaction Oct 30 00:34:43.785621 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application session.commit() Oct 30 00:34:43.785621 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 30 00:34:43.785621 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 30 00:34:43.786828 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 30 00:34:43.786828 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application self._prepare_impl() Oct 30 00:34:43.786828 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 30 00:34:43.786828 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application self.session.flush() Oct 30 00:34:43.786828 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 30 00:34:43.786828 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application self._flush(objects) Oct 30 00:34:43.786828 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 30 00:34:43.786828 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 30 00:34:43.786828 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 30 00:34:43.786828 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application compat.raise_( Oct 30 00:34:43.786828 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 30 00:34:43.786828 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application raise exception Oct 30 00:34:43.786828 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 30 00:34:43.786828 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application flush_context.execute() Oct 30 00:34:43.786828 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 30 00:34:43.786828 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application rec.execute(self) Oct 30 00:34:43.786828 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 30 00:34:43.788066 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 30 00:34:43.788066 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 30 00:34:43.788066 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 30 00:34:43.788066 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Oct 30 00:34:43.788066 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application c = connection._execute_20( Oct 30 00:34:43.788066 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 30 00:34:43.788066 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 30 00:34:43.788066 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 30 00:34:43.788066 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 30 00:34:43.788066 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 30 00:34:43.788066 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 30 00:34:43.788066 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 30 00:34:43.788066 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 30 00:34:43.788066 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 30 00:34:43.788066 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 30 00:34:43.788918 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 30 00:34:43.788918 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application raise exception Oct 30 00:34:43.788918 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 30 00:34:43.788918 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 30 00:34:43.788918 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 30 00:34:43.788918 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 30 00:34:43.788918 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 30 00:34:43.788918 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application result = self._query(query) Oct 30 00:34:43.788918 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 30 00:34:43.788918 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application conn.query(q) Oct 30 00:34:43.788918 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 30 00:34:43.788918 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 30 00:34:43.788918 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 30 00:34:43.788918 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application result.read() Oct 30 00:34:43.788918 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 30 00:34:43.788918 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 30 00:34:43.788918 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 30 00:34:43.789772 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 30 00:34:43.789772 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 30 00:34:43.789772 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 30 00:34:43.789772 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 30 00:34:43.789772 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 30 00:34:43.789772 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Oct 30 00:34:43.789772 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 30 00:34:43.789772 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application [parameters: {'id': 'f6be90a7013c49f98106722ba3a0d4b9', 'name': 'Default', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] Oct 30 00:34:43.789772 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 30 00:34:43.789772 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application Oct 30 00:34:43.789772 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 30 00:34:43.789772 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application Oct 30 00:34:43.789772 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:34:43.789772 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Oct 30 00:34:43.789772 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Oct 30 00:34:43.790592 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 30 00:34:43.790592 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 30 00:34:43.790592 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name Default. Oct 30 00:34:43.790592 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application Oct 30 00:34:43.790592 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 30 00:34:43.790592 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application Oct 30 00:34:43.790592 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:34:43.790592 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:34:43.790592 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:34:43.790592 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:34:43.790592 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:34:43.790592 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:34:43.790592 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:34:43.790592 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:34:43.790592 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:34:43.790592 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:34:43.790592 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:34:43.791786 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 128, in post Oct 30 00:34:43.791786 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_domain( Oct 30 00:34:43.791786 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:34:43.791786 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:34:43.791786 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 765, in create_domain Oct 30 00:34:43.791786 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application is_domain_project = self.create_project( Oct 30 00:34:43.791786 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:34:43.791786 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:34:43.791786 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Oct 30 00:34:43.791786 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application raise exception.Conflict( Oct 30 00:34:43.791786 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default. Oct 30 00:34:43.791786 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application Oct 30 00:34:43.791786 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 8/16] 10.222.0.42 () {60 vars in 1137 bytes} [Sun Oct 30 00:34:43 2022] POST /identity/v3/domains => generated 190 bytes in 165 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:34:43.791786 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eab8e73-fb2b-4de1-8616-c00cf8a91b16 None admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:34:43.877086 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6a7f64-19fe-4e7e-8310-02d499323095 None admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:34:43.887509 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eab8e73-fb2b-4de1-8616-c00cf8a91b16 None admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:34:43.910550 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49d903e-676e-434e-a9de-7e1085b4b0d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:34:43.911518 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49d903e-676e-434e-a9de-7e1085b4b0d3 None admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:34:43.911801 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49d903e-676e-434e-a9de-7e1085b4b0d3 None admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:34:43.912070 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49d903e-676e-434e-a9de-7e1085b4b0d3 None admin] PATH_INFO: `/v3/users/eb55b6cbca4945abb21b0e49eb745e1c` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:34:43.913577 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49d903e-676e-434e-a9de-7e1085b4b0d3 None admin] RBAC: Authorizing `identity:get_user(user_id=eb55b6cbca4945abb21b0e49eb745e1c)` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:34:43.915033 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49d903e-676e-434e-a9de-7e1085b4b0d3 None admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:34:43.916662 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 9/17] 10.222.0.42 () {56 vars in 1177 bytes} [Sun Oct 30 00:34:43 2022] GET /identity/v3/users/eb55b6cbca4945abb21b0e49eb745e1c => generated 247 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 30 00:34:43.921085 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f76a21-9e7f-46b4-ae71-4074c26434ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:34:43.921739 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f76a21-9e7f-46b4-ae71-4074c26434ec None admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:34:43.922015 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f76a21-9e7f-46b4-ae71-4074c26434ec None admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:34:43.922287 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f76a21-9e7f-46b4-ae71-4074c26434ec None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:34:43.922384 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49d903e-676e-434e-a9de-7e1085b4b0d3 None admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:34:43.932321 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f76a21-9e7f-46b4-ae71-4074c26434ec None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:34:43.933785 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f76a21-9e7f-46b4-ae71-4074c26434ec None admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:34:43.942687 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:34:43.951995 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application [None req-f8f76a21-9e7f-46b4-ae71-4074c26434ec None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 30 00:34:43.951995 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:34:43.951995 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:34:43.951995 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:34:43.951995 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:34:43.951995 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:34:43.951995 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:34:43.951995 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:34:43.951995 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:34:43.951995 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:34:43.951995 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:34:43.951995 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:34:43.951995 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 30 00:34:43.951995 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 30 00:34:43.951995 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 30 00:34:43.951995 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 30 00:34:43.952857 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:34:43.952857 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:34:43.952857 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:34:43.952857 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:34:43.952857 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:34:43.952857 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:34:43.952857 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:34:43.952857 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application with Lock( Oct 30 00:34:43.952857 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:34:43.952857 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:34:43.952857 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:34:43.952857 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:34:43.952857 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:34:43.952857 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:34:43.952857 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:34:43.952857 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:34:43.952857 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 30 00:34:43.953682 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 30 00:34:43.953682 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 30 00:34:43.953682 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application Oct 30 00:34:43.955351 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 9/18] 10.222.0.42 () {56 vars in 1108 bytes} [Sun Oct 30 00:34:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 30 00:34:43.958082 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=100 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:34:43.959000 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f76a21-9e7f-46b4-ae71-4074c26434ec None admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:34:44.022681 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49d903e-676e-434e-a9de-7e1085b4b0d3 None admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:34:44.056065 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f76a21-9e7f-46b4-ae71-4074c26434ec None admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:34:44.057958 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012e785d-4995-4122-9620-b6e634362ad7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:34:44.058599 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012e785d-4995-4122-9620-b6e634362ad7 None admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:34:44.058875 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012e785d-4995-4122-9620-b6e634362ad7 None admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:34:44.059163 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012e785d-4995-4122-9620-b6e634362ad7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:34:44.060322 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012e785d-4995-4122-9620-b6e634362ad7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:34:44.061765 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012e785d-4995-4122-9620-b6e634362ad7 None admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:34:44.063336 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 10/19] 10.222.0.42 () {56 vars in 1108 bytes} [Sun Oct 30 00:34:43 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:34:44.069182 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012e785d-4995-4122-9620-b6e634362ad7 None admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:34:44.092105 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c06d1d-38da-4c7f-9811-5d5a660373c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:34:44.092719 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c06d1d-38da-4c7f-9811-5d5a660373c4 None admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:34:44.092999 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c06d1d-38da-4c7f-9811-5d5a660373c4 None admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:34:44.093273 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c06d1d-38da-4c7f-9811-5d5a660373c4 None admin] PATH_INFO: `/v3/domains` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:34:44.093921 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c06d1d-38da-4c7f-9811-5d5a660373c4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87956) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:34:44.094224 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c06d1d-38da-4c7f-9811-5d5a660373c4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:34:44.095650 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c06d1d-38da-4c7f-9811-5d5a660373c4 None admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:34:44.112931 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 10/20] 10.222.0.42 () {56 vars in 1109 bytes} [Sun Oct 30 00:34:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 30 00:34:44.174775 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012e785d-4995-4122-9620-b6e634362ad7 None admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:34:44.176528 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=100 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:34:44.213938 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e57938-c4e5-4e8d-917a-9fc6e33c0679 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:34:44.214618 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e57938-c4e5-4e8d-917a-9fc6e33c0679 None admin] REQUEST_METHOD: `PUT` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:34:44.214902 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e57938-c4e5-4e8d-917a-9fc6e33c0679 None admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:34:44.215178 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e57938-c4e5-4e8d-917a-9fc6e33c0679 None admin] PATH_INFO: `/v3/domains/default/users/eb55b6cbca4945abb21b0e49eb745e1c/roles/6ccaa8c11f29456fb4e4eeccb21616c7` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:34:44.217226 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e57938-c4e5-4e8d-917a-9fc6e33c0679 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=eb55b6cbca4945abb21b0e49eb745e1c, role_id=6ccaa8c11f29456fb4e4eeccb21616c7)` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:34:44.218717 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e57938-c4e5-4e8d-917a-9fc6e33c0679 None admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:34:44.338347 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 11/21] 10.222.0.42 () {58 vars in 1361 bytes} [Sun Oct 30 00:34:44 2022] PUT /identity/v3/domains/default/users/eb55b6cbca4945abb21b0e49eb745e1c/roles/6ccaa8c11f29456fb4e4eeccb21616c7 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 00:34:46.782032 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33a4c31-44fd-455f-ab2c-ece8e6eaba51 None None] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:34:46.782546 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33a4c31-44fd-455f-ab2c-ece8e6eaba51 None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:34:46.782546 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33a4c31-44fd-455f-ab2c-ece8e6eaba51 None None] PATH_INFO: `/` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:34:46.783939 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 11/22] 10.222.0.42 () {54 vars in 927 bytes} [Sun Oct 30 00:34:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:34:46.792279 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2faee9a-0b92-49a2-a885-d2044e475580 None None] REQUEST_METHOD: `POST` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:34:46.792724 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2faee9a-0b92-49a2-a885-d2044e475580 None None] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:34:46.792911 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2faee9a-0b92-49a2-a885-d2044e475580 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:34:46.820348 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.auth.core [None req-e2faee9a-0b92-49a2-a885-d2044e475580 None None] MFA Rules not processed for user `eb55b6cbca4945abb21b0e49eb745e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=87955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:34:46.821900 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-e2faee9a-0b92-49a2-a885-d2044e475580 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:34:46.848663 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4dc756-04ba-4181-b7a2-efb5f33787da None None] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:34:46.848978 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4dc756-04ba-4181-b7a2-efb5f33787da None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:34:46.849206 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4dc756-04ba-4181-b7a2-efb5f33787da None None] PATH_INFO: `/` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:34:46.850768 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 12/23] 10.222.0.42 () {54 vars in 927 bytes} [Sun Oct 30 00:34:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:34:46.856196 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b26282-874f-4657-a722-f2c889e4ddf6 None None] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:34:46.856476 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b26282-874f-4657-a722-f2c889e4ddf6 None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:34:46.856747 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b26282-874f-4657-a722-f2c889e4ddf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:34:46.882575 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.auth.core [None req-88b26282-874f-4657-a722-f2c889e4ddf6 None None] MFA Rules not processed for user `eb55b6cbca4945abb21b0e49eb745e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=87956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:34:46.883798 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-88b26282-874f-4657-a722-f2c889e4ddf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:34:46.924147 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 12/24] 10.222.0.42 () {58 vars in 1024 bytes} [Sun Oct 30 00:34:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 30 00:34:46.966133 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baecc0b4-4989-4de7-9a7d-3c7adaf7d0f4 None None] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:34:46.966429 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baecc0b4-4989-4de7-9a7d-3c7adaf7d0f4 None None] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:34:46.966682 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baecc0b4-4989-4de7-9a7d-3c7adaf7d0f4 None None] PATH_INFO: `/` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:34:46.970853 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 13/25] 10.222.0.42 () {54 vars in 927 bytes} [Sun Oct 30 00:34:46 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 30 00:34:46.976143 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19d4c6d-d7d9-4c37-86fe-37dba2a6709c None None] REQUEST_METHOD: `POST` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:34:46.976422 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19d4c6d-d7d9-4c37-86fe-37dba2a6709c None None] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:34:46.976695 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19d4c6d-d7d9-4c37-86fe-37dba2a6709c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:34:46.991532 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=100 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:34:47.017686 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 13/26] 10.222.0.42 () {58 vars in 1024 bytes} [Sun Oct 30 00:34:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 30 00:34:47.018849 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.auth.core [None req-e19d4c6d-d7d9-4c37-86fe-37dba2a6709c None None] MFA Rules not processed for user `eb55b6cbca4945abb21b0e49eb745e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=87955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:34:47.020118 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-e19d4c6d-d7d9-4c37-86fe-37dba2a6709c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:34:47.080090 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f88872e-e036-48d4-896c-962743c86924 None None] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:34:47.080824 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f88872e-e036-48d4-896c-962743c86924 None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:34:47.081666 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f88872e-e036-48d4-896c-962743c86924 None None] PATH_INFO: `/` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:34:47.083728 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 14/27] 10.222.0.42 () {54 vars in 927 bytes} [Sun Oct 30 00:34:47 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 30 00:34:47.090910 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160ec82f-99b1-4d7b-853f-e38bbacda8f5 None None] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:34:47.091441 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160ec82f-99b1-4d7b-853f-e38bbacda8f5 None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:34:47.091902 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160ec82f-99b1-4d7b-853f-e38bbacda8f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:34:47.116264 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.auth.core [None req-160ec82f-99b1-4d7b-853f-e38bbacda8f5 None None] MFA Rules not processed for user `eb55b6cbca4945abb21b0e49eb745e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=87956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:34:47.118397 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-160ec82f-99b1-4d7b-853f-e38bbacda8f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:34:47.171223 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 14/28] 10.222.0.42 () {58 vars in 1024 bytes} [Sun Oct 30 00:34:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 30 00:34:47.240508 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 15/29] 10.222.0.42 () {58 vars in 1024 bytes} [Sun Oct 30 00:34:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 30 00:34:47.324722 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19d4c6d-d7d9-4c37-86fe-37dba2a6709c None None] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:34:47.353620 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:34:47.428787 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19d4c6d-d7d9-4c37-86fe-37dba2a6709c None None] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:34:47.462220 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9250c784-36d5-4005-bbd0-bf8dd2009f87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:34:47.462835 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9250c784-36d5-4005-bbd0-bf8dd2009f87 None admin] REQUEST_METHOD: `POST` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:34:47.463113 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9250c784-36d5-4005-bbd0-bf8dd2009f87 None admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:34:47.463416 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9250c784-36d5-4005-bbd0-bf8dd2009f87 None admin] PATH_INFO: `/v3/roles` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:34:47.464100 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9250c784-36d5-4005-bbd0-bf8dd2009f87 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:34:47.465598 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9250c784-36d5-4005-bbd0-bf8dd2009f87 None admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:34:47.466045 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160ec82f-99b1-4d7b-853f-e38bbacda8f5 None None] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:34:47.510572 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 15/30] 10.222.0.42 () {60 vars in 1131 bytes} [Sun Oct 30 00:34:47 2022] POST /identity/v3/roles => generated 225 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 00:34:47.609415 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9250c784-36d5-4005-bbd0-bf8dd2009f87 None admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:34:47.636275 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160ec82f-99b1-4d7b-853f-e38bbacda8f5 None None] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:34:47.671236 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=100 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:34:47.718087 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83aafee-f76b-4f11-9827-f6e70aef8caa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:34:47.718749 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83aafee-f76b-4f11-9827-f6e70aef8caa None admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:34:47.719026 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83aafee-f76b-4f11-9827-f6e70aef8caa None admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:34:47.719324 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83aafee-f76b-4f11-9827-f6e70aef8caa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:34:47.737895 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83aafee-f76b-4f11-9827-f6e70aef8caa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:34:47.739899 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:34:47.740518 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83aafee-f76b-4f11-9827-f6e70aef8caa None admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:34:47.759387 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9250c784-36d5-4005-bbd0-bf8dd2009f87 None admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:34:47.762266 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application [None req-f83aafee-f76b-4f11-9827-f6e70aef8caa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 30 00:34:47.762266 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:34:47.762266 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:34:47.762266 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:34:47.762266 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:34:47.762266 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:34:47.762266 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:34:47.762266 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:34:47.762266 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:34:47.762266 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:34:47.762266 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:34:47.762266 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:34:47.762266 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 30 00:34:47.762266 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 30 00:34:47.762266 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 30 00:34:47.762266 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 30 00:34:47.763092 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:34:47.763092 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:34:47.763092 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:34:47.763092 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:34:47.763092 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:34:47.763092 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:34:47.763092 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:34:47.763092 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application with Lock( Oct 30 00:34:47.763092 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:34:47.763092 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:34:47.763092 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:34:47.763092 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:34:47.763092 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:34:47.763092 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:34:47.763092 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:34:47.763092 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:34:47.763092 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 30 00:34:47.763989 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 30 00:34:47.763989 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 30 00:34:47.763989 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application Oct 30 00:34:47.765772 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 16/31] 10.222.0.42 () {56 vars in 1108 bytes} [Sun Oct 30 00:34:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 300 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:34:47.766693 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83aafee-f76b-4f11-9827-f6e70aef8caa None admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:34:47.795817 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476d3c50-fa64-464d-ba4c-c25098a6d4f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:34:47.796602 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476d3c50-fa64-464d-ba4c-c25098a6d4f3 None admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:34:47.796940 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476d3c50-fa64-464d-ba4c-c25098a6d4f3 None admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:34:47.797277 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476d3c50-fa64-464d-ba4c-c25098a6d4f3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:34:47.810643 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476d3c50-fa64-464d-ba4c-c25098a6d4f3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 30 00:34:47.820272 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application [None req-476d3c50-fa64-464d-ba4c-c25098a6d4f3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 30 00:34:47.820272 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:34:47.820272 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:34:47.820272 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:34:47.820272 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:34:47.820272 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:34:47.820272 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:34:47.820272 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:34:47.820272 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:34:47.820272 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:34:47.820272 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:34:47.820272 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:34:47.820272 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 30 00:34:47.820272 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 30 00:34:47.820272 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 30 00:34:47.820272 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 30 00:34:47.821143 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 30 00:34:47.821143 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 30 00:34:47.821143 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 30 00:34:47.821143 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 30 00:34:47.821143 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:34:47.821143 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:34:47.821143 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:34:47.821143 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:34:47.821143 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:34:47.821143 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:34:47.821143 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:34:47.821143 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application with Lock( Oct 30 00:34:47.821143 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:34:47.821143 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:34:47.821143 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:34:47.821143 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:34:47.821889 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:34:47.821889 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:34:47.821889 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:34:47.821889 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:34:47.821889 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 30 00:34:47.821889 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 30 00:34:47.821889 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 30 00:34:47.821889 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 30 00:34:47.821889 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 30 00:34:47.821889 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 30 00:34:47.821889 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 30 00:34:47.821889 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application Oct 30 00:34:47.821889 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 16/32] 10.222.0.42 () {56 vars in 1096 bytes} [Sun Oct 30 00:34:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 30 00:34:47.822493 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476d3c50-fa64-464d-ba4c-c25098a6d4f3 None admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:34:47.884213 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83aafee-f76b-4f11-9827-f6e70aef8caa None admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:34:47.938393 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476d3c50-fa64-464d-ba4c-c25098a6d4f3 None admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:34:47.952294 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d4436b-45b5-4fb9-af2e-3671e03f6cfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:34:47.953795 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d4436b-45b5-4fb9-af2e-3671e03f6cfd None admin] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:34:47.954341 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d4436b-45b5-4fb9-af2e-3671e03f6cfd None admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:34:47.954780 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d4436b-45b5-4fb9-af2e-3671e03f6cfd None admin] PATH_INFO: `/v3/roles` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:34:47.955884 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d4436b-45b5-4fb9-af2e-3671e03f6cfd None admin] RBAC: Authorizing `identity:create_role()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:34:47.957860 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d4436b-45b5-4fb9-af2e-3671e03f6cfd None admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:34:47.973561 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3c2f72-3c3d-4f56-b131-abd3966bb10c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:34:47.974255 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3c2f72-3c3d-4f56-b131-abd3966bb10c None admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:34:47.974598 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3c2f72-3c3d-4f56-b131-abd3966bb10c None admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:34:47.974935 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3c2f72-3c3d-4f56-b131-abd3966bb10c None admin] PATH_INFO: `/v3/domains` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:34:47.975682 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3c2f72-3c3d-4f56-b131-abd3966bb10c None admin] RBAC: Adding query filter params (name=Default) {{(pid=87955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:34:47.976044 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3c2f72-3c3d-4f56-b131-abd3966bb10c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:34:47.977854 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3c2f72-3c3d-4f56-b131-abd3966bb10c None admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:34:47.999161 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 17/33] 10.222.0.42 () {56 vars in 1109 bytes} [Sun Oct 30 00:34:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:34:48.000168 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3c2f72-3c3d-4f56-b131-abd3966bb10c None admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:34:48.003188 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=100 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:34:48.108012 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 17/34] 10.222.0.42 () {60 vars in 1131 bytes} [Sun Oct 30 00:34:47 2022] POST /identity/v3/roles => generated 219 bytes in 341 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 00:34:48.114252 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d4436b-45b5-4fb9-af2e-3671e03f6cfd None admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:34:48.120460 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3c2f72-3c3d-4f56-b131-abd3966bb10c None admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:34:48.162042 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea06af3e-ea94-47be-a259-bb9fce2b4ec9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:34:48.163301 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea06af3e-ea94-47be-a259-bb9fce2b4ec9 None admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:34:48.163748 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea06af3e-ea94-47be-a259-bb9fce2b4ec9 None admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:34:48.164202 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea06af3e-ea94-47be-a259-bb9fce2b4ec9 None admin] PATH_INFO: `/v3/roles` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:34:48.165155 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea06af3e-ea94-47be-a259-bb9fce2b4ec9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:34:48.165641 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea06af3e-ea94-47be-a259-bb9fce2b4ec9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:34:48.167346 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea06af3e-ea94-47be-a259-bb9fce2b4ec9 None admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:34:48.175631 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:34:48.179673 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 18/35] 10.222.0.42 () {56 vars in 1099 bytes} [Sun Oct 30 00:34:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:34:48.189665 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea06af3e-ea94-47be-a259-bb9fce2b4ec9 None admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:34:48.299494 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=100 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:34:48.317069 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d4436b-45b5-4fb9-af2e-3671e03f6cfd None admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:34:48.370038 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea06af3e-ea94-47be-a259-bb9fce2b4ec9 None admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:34:48.381928 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583b9457-d79e-496b-9b25-d7dcf9662aaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:34:48.382109 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583b9457-d79e-496b-9b25-d7dcf9662aaf None admin] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:34:48.382639 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583b9457-d79e-496b-9b25-d7dcf9662aaf None admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:34:48.382639 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583b9457-d79e-496b-9b25-d7dcf9662aaf None admin] PATH_INFO: `/v3/projects` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:34:48.383763 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583b9457-d79e-496b-9b25-d7dcf9662aaf None admin] RBAC: Authorizing `identity:create_project()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:34:48.384773 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583b9457-d79e-496b-9b25-d7dcf9662aaf None admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:34:48.416974 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 18/36] 10.222.0.42 () {60 vars in 1141 bytes} [Sun Oct 30 00:34:48 2022] POST /identity/v3/projects => generated 301 bytes in 308 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 00:34:48.418267 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e18943c-4483-4102-81d2-430db1bc128c None None] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:34:48.418553 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e18943c-4483-4102-81d2-430db1bc128c None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:34:48.418826 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e18943c-4483-4102-81d2-430db1bc128c None None] PATH_INFO: `/` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:34:48.419750 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea41fdd5-6b13-4e89-b9c0-d7d54e679350 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:34:48.420253 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 19/37] 10.222.0.42 () {54 vars in 927 bytes} [Sun Oct 30 00:34:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:34:48.420454 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea41fdd5-6b13-4e89-b9c0-d7d54e679350 None admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:34:48.420742 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea41fdd5-6b13-4e89-b9c0-d7d54e679350 None admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:34:48.421020 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea41fdd5-6b13-4e89-b9c0-d7d54e679350 None admin] PATH_INFO: `/v3/users/eb55b6cbca4945abb21b0e49eb745e1c` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:34:48.426484 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea41fdd5-6b13-4e89-b9c0-d7d54e679350 None admin] RBAC: Authorizing `identity:get_user(user_id=eb55b6cbca4945abb21b0e49eb745e1c)` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:34:48.426988 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45f233f-2ce7-4b0c-885a-cf46d940342e None None] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:34:48.427311 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45f233f-2ce7-4b0c-885a-cf46d940342e None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:34:48.427631 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45f233f-2ce7-4b0c-885a-cf46d940342e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:34:48.428042 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea41fdd5-6b13-4e89-b9c0-d7d54e679350 None admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:34:48.429731 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 19/38] 10.222.0.42 () {56 vars in 1177 bytes} [Sun Oct 30 00:34:48 2022] GET /identity/v3/users/eb55b6cbca4945abb21b0e49eb745e1c => generated 247 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:34:48.435832 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea41fdd5-6b13-4e89-b9c0-d7d54e679350 None admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:34:48.455693 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.auth.core [None req-e45f233f-2ce7-4b0c-885a-cf46d940342e None None] MFA Rules not processed for user `eb55b6cbca4945abb21b0e49eb745e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=87956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:34:48.457439 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-e45f233f-2ce7-4b0c-885a-cf46d940342e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:34:48.558973 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 20/39] 10.222.0.42 () {58 vars in 1024 bytes} [Sun Oct 30 00:34:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 30 00:34:48.576809 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea41fdd5-6b13-4e89-b9c0-d7d54e679350 None admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:34:48.610329 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=100 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:34:48.619342 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c5646a-fb31-41ba-9a12-c0044306d531 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:34:48.620003 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c5646a-fb31-41ba-9a12-c0044306d531 None admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:34:48.620285 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c5646a-fb31-41ba-9a12-c0044306d531 None admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:34:48.620557 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c5646a-fb31-41ba-9a12-c0044306d531 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:34:48.622774 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c5646a-fb31-41ba-9a12-c0044306d531 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:34:48.624283 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c5646a-fb31-41ba-9a12-c0044306d531 None admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:34:48.626281 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 20/40] 10.222.0.42 () {56 vars in 1108 bytes} [Sun Oct 30 00:34:48 2022] GET /identity/v3/domains/default => generated 199 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:34:48.632509 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45f233f-2ce7-4b0c-885a-cf46d940342e None None] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:34:48.638760 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9eb03e-fdef-437e-91b4-b2331e767dcd None None] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:34:48.639054 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9eb03e-fdef-437e-91b4-b2331e767dcd None None] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:34:48.639338 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9eb03e-fdef-437e-91b4-b2331e767dcd None None] PATH_INFO: `/` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:34:48.640816 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 21/41] 10.222.0.42 () {54 vars in 927 bytes} [Sun Oct 30 00:34:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 30 00:34:48.647579 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0892e5c-1b06-41e3-9eb8-28bd638bab1d None None] REQUEST_METHOD: `POST` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:34:48.647872 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0892e5c-1b06-41e3-9eb8-28bd638bab1d None None] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:34:48.648174 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0892e5c-1b06-41e3-9eb8-28bd638bab1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:34:48.655847 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:34:48.667137 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.auth.core [None req-e0892e5c-1b06-41e3-9eb8-28bd638bab1d None None] MFA Rules not processed for user `eb55b6cbca4945abb21b0e49eb745e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=87955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:34:48.668331 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-e0892e5c-1b06-41e3-9eb8-28bd638bab1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:34:48.752234 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 22/42] 10.222.0.42 () {58 vars in 1024 bytes} [Sun Oct 30 00:34:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 30 00:34:48.761905 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45f233f-2ce7-4b0c-885a-cf46d940342e None None] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:34:48.797454 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a64a3d6-5c74-48e4-be20-25182621fa43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:34:48.798183 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a64a3d6-5c74-48e4-be20-25182621fa43 None admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:34:48.798540 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a64a3d6-5c74-48e4-be20-25182621fa43 None admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:34:48.798672 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a64a3d6-5c74-48e4-be20-25182621fa43 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:34:48.799478 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a64a3d6-5c74-48e4-be20-25182621fa43 None admin] RBAC: Adding query filter params (role.id=6ccaa8c11f29456fb4e4eeccb21616c7, scope.domain.id=default, user.id=eb55b6cbca4945abb21b0e49eb745e1c) {{(pid=87956) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:34:48.799812 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a64a3d6-5c74-48e4-be20-25182621fa43 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:34:48.801259 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a64a3d6-5c74-48e4-be20-25182621fa43 None admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:34:48.809211 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 21/43] 10.222.0.42 () {56 vars in 1322 bytes} [Sun Oct 30 00:34:48 2022] GET /identity/v3/role_assignments?user.id=eb55b6cbca4945abb21b0e49eb745e1c&scope.domain.id=default&role.id=6ccaa8c11f29456fb4e4eeccb21616c7 => generated 530 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:34:48.847644 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0892e5c-1b06-41e3-9eb8-28bd638bab1d None None] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:34:48.960091 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0892e5c-1b06-41e3-9eb8-28bd638bab1d None None] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:34:48.992714 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=100 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:34:49.000293 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f2156d-9ccd-4d86-99a3-8c8bc41581d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:34:49.000920 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f2156d-9ccd-4d86-99a3-8c8bc41581d2 None admin] REQUEST_METHOD: `POST` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:34:49.001198 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f2156d-9ccd-4d86-99a3-8c8bc41581d2 None admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:34:49.001472 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f2156d-9ccd-4d86-99a3-8c8bc41581d2 None admin] PATH_INFO: `/v3/roles` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:34:49.002170 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f2156d-9ccd-4d86-99a3-8c8bc41581d2 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:34:49.005503 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f2156d-9ccd-4d86-99a3-8c8bc41581d2 None admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:34:49.021615 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a64a3d6-5c74-48e4-be20-25182621fa43 None admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:34:49.025306 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 23/44] 10.222.0.42 () {60 vars in 1131 bytes} [Sun Oct 30 00:34:48 2022] POST /identity/v3/roles => generated 223 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 00:34:49.219984 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=100 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:34:49.244444 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a64a3d6-5c74-48e4-be20-25182621fa43 None admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:34:49.278738 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c835bfb-4e38-43c0-aa7d-82e8b6a588a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:34:49.279403 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c835bfb-4e38-43c0-aa7d-82e8b6a588a3 None admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:34:49.279684 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c835bfb-4e38-43c0-aa7d-82e8b6a588a3 None admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:34:49.279955 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c835bfb-4e38-43c0-aa7d-82e8b6a588a3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:34:49.281078 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c835bfb-4e38-43c0-aa7d-82e8b6a588a3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:34:49.282519 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c835bfb-4e38-43c0-aa7d-82e8b6a588a3 None admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:34:49.284194 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 22/45] 10.222.0.42 () {56 vars in 1108 bytes} [Sun Oct 30 00:34:49 2022] GET /identity/v3/domains/default => generated 199 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 30 00:34:49.289849 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f2156d-9ccd-4d86-99a3-8c8bc41581d2 None admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:34:49.406855 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f2156d-9ccd-4d86-99a3-8c8bc41581d2 None admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:34:49.441610 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459733d5-6a73-4edc-95ab-558980930e5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:34:49.442206 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459733d5-6a73-4edc-95ab-558980930e5b None admin] REQUEST_METHOD: `POST` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:34:49.442485 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459733d5-6a73-4edc-95ab-558980930e5b None admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:34:49.442756 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459733d5-6a73-4edc-95ab-558980930e5b None admin] PATH_INFO: `/v3/projects` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:34:49.443453 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459733d5-6a73-4edc-95ab-558980930e5b None admin] RBAC: Authorizing `identity:create_project()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:34:49.444888 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459733d5-6a73-4edc-95ab-558980930e5b None admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:34:49.485362 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 24/46] 10.222.0.42 () {60 vars in 1141 bytes} [Sun Oct 30 00:34:49 2022] POST /identity/v3/projects => generated 312 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 00:34:51.606616 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d268ad-2a63-4599-955d-74109119f767 None None] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:34:51.607168 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d268ad-2a63-4599-955d-74109119f767 None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:34:51.607168 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d268ad-2a63-4599-955d-74109119f767 None None] PATH_INFO: `/` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:34:51.608537 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 23/47] 10.222.0.42 () {54 vars in 927 bytes} [Sun Oct 30 00:34:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:34:51.614903 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dd8853-ed1f-43b2-9d46-462591abbc49 None None] REQUEST_METHOD: `POST` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:34:51.615645 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dd8853-ed1f-43b2-9d46-462591abbc49 None None] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:34:51.615785 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dd8853-ed1f-43b2-9d46-462591abbc49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:34:51.642709 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.auth.core [None req-b3dd8853-ed1f-43b2-9d46-462591abbc49 None None] MFA Rules not processed for user `eb55b6cbca4945abb21b0e49eb745e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=87955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:34:51.644627 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-b3dd8853-ed1f-43b2-9d46-462591abbc49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:34:51.687684 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:34:51.721261 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 25/48] 10.222.0.42 () {58 vars in 1024 bytes} [Sun Oct 30 00:34:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 30 00:34:51.999050 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d268ad-2a63-4599-955d-74109119f767 None None] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:34:52.112287 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d268ad-2a63-4599-955d-74109119f767 None None] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:34:52.148048 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7af7696-fd9b-4e0d-9d6b-6d8f76078f4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:34:52.148668 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7af7696-fd9b-4e0d-9d6b-6d8f76078f4e None admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:34:52.148946 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7af7696-fd9b-4e0d-9d6b-6d8f76078f4e None admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:34:52.149213 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7af7696-fd9b-4e0d-9d6b-6d8f76078f4e None admin] PATH_INFO: `/v3/domains/default` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:34:52.150445 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7af7696-fd9b-4e0d-9d6b-6d8f76078f4e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:34:52.151903 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7af7696-fd9b-4e0d-9d6b-6d8f76078f4e None admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:34:52.153476 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 24/49] 10.222.0.42 () {56 vars in 1108 bytes} [Sun Oct 30 00:34:51 2022] GET /identity/v3/domains/default => generated 199 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:34:52.160068 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3dd8853-ed1f-43b2-9d46-462591abbc49 None None] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:34:52.272031 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3dd8853-ed1f-43b2-9d46-462591abbc49 None None] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:34:52.307577 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8953996-9fd5-40cd-9afb-58a25a2f6730 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:34:52.308178 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8953996-9fd5-40cd-9afb-58a25a2f6730 None admin] REQUEST_METHOD: `POST` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:34:52.308458 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8953996-9fd5-40cd-9afb-58a25a2f6730 None admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:34:52.308731 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8953996-9fd5-40cd-9afb-58a25a2f6730 None admin] PATH_INFO: `/v3/projects` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:34:52.309378 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8953996-9fd5-40cd-9afb-58a25a2f6730 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:34:52.310829 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8953996-9fd5-40cd-9afb-58a25a2f6730 None admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:34:52.340753 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 26/50] 10.222.0.42 () {60 vars in 1140 bytes} [Sun Oct 30 00:34:52 2022] POST /identity/v3/projects => generated 298 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 00:34:54.452153 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09650a23-bf75-4b8c-9652-4556dcfa20a4 None None] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:34:54.452673 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09650a23-bf75-4b8c-9652-4556dcfa20a4 None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:34:54.452673 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09650a23-bf75-4b8c-9652-4556dcfa20a4 None None] PATH_INFO: `/` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:34:54.454295 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 25/51] 10.222.0.42 () {54 vars in 927 bytes} [Sun Oct 30 00:34:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:34:54.460680 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c184a3-351e-44a7-9243-fd6af4c41760 None None] REQUEST_METHOD: `POST` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:34:54.461354 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c184a3-351e-44a7-9243-fd6af4c41760 None None] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:34:54.461573 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c184a3-351e-44a7-9243-fd6af4c41760 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:34:54.488984 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.auth.core [None req-a9c184a3-351e-44a7-9243-fd6af4c41760 None None] MFA Rules not processed for user `eb55b6cbca4945abb21b0e49eb745e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=87955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:34:54.490192 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-a9c184a3-351e-44a7-9243-fd6af4c41760 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:34:54.508574 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:34:54.562760 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 27/52] 10.222.0.42 () {58 vars in 1024 bytes} [Sun Oct 30 00:34:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 30 00:34:54.837619 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09650a23-bf75-4b8c-9652-4556dcfa20a4 None None] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:34:54.857632 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=100 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:34:54.966642 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09650a23-bf75-4b8c-9652-4556dcfa20a4 None None] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:34:55.002035 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b319057-b78f-4662-ac06-89dba7637b94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:34:55.002691 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b319057-b78f-4662-ac06-89dba7637b94 None admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:34:55.002965 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b319057-b78f-4662-ac06-89dba7637b94 None admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:34:55.003244 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b319057-b78f-4662-ac06-89dba7637b94 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:34:55.004406 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b319057-b78f-4662-ac06-89dba7637b94 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:34:55.005856 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b319057-b78f-4662-ac06-89dba7637b94 None admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:34:55.007440 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 26/53] 10.222.0.42 () {56 vars in 1108 bytes} [Sun Oct 30 00:34:54 2022] GET /identity/v3/domains/default => generated 199 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:34:55.013336 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c184a3-351e-44a7-9243-fd6af4c41760 None None] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:34:55.128110 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c184a3-351e-44a7-9243-fd6af4c41760 None None] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:34:55.270056 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39df4b24-454b-4bbe-90b0-76d9afc78334 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:34:55.270647 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39df4b24-454b-4bbe-90b0-76d9afc78334 None admin] REQUEST_METHOD: `POST` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:34:55.270938 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39df4b24-454b-4bbe-90b0-76d9afc78334 None admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:34:55.271234 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39df4b24-454b-4bbe-90b0-76d9afc78334 None admin] PATH_INFO: `/v3/users` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:34:55.271893 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39df4b24-454b-4bbe-90b0-76d9afc78334 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:34:55.273314 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39df4b24-454b-4bbe-90b0-76d9afc78334 None admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:34:55.302772 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 28/54] 10.222.0.42 () {60 vars in 1132 bytes} [Sun Oct 30 00:34:55 2022] POST /identity/v3/users => generated 275 bytes in 290 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 00:34:58.601522 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407bef5f-d101-420a-a14c-28db74858daa None None] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:34:58.601522 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407bef5f-d101-420a-a14c-28db74858daa None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:34:58.601522 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407bef5f-d101-420a-a14c-28db74858daa None None] PATH_INFO: `/` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:34:58.602526 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 27/55] 10.222.0.42 () {54 vars in 927 bytes} [Sun Oct 30 00:34:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:34:58.608312 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88a7f1c-3ce9-4de9-8f4b-83608f2a6c53 None None] REQUEST_METHOD: `POST` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:34:58.609048 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88a7f1c-3ce9-4de9-8f4b-83608f2a6c53 None None] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:34:58.609484 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88a7f1c-3ce9-4de9-8f4b-83608f2a6c53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:34:58.628357 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.auth.core [None req-f88a7f1c-3ce9-4de9-8f4b-83608f2a6c53 None None] MFA Rules not processed for user `eb55b6cbca4945abb21b0e49eb745e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=87955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:34:58.629782 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-f88a7f1c-3ce9-4de9-8f4b-83608f2a6c53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:34:58.633636 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:34:58.686232 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f07b059-ca5c-42f7-9b82-49c2d78d2738 None None] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:34:58.686770 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f07b059-ca5c-42f7-9b82-49c2d78d2738 None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:34:58.687186 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f07b059-ca5c-42f7-9b82-49c2d78d2738 None None] PATH_INFO: `/` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:34:58.688707 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 28/56] 10.222.0.42 () {54 vars in 927 bytes} [Sun Oct 30 00:34:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:34:58.693822 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a5023e-5ab6-45d1-856d-286e46f09b30 None None] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:34:58.694336 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a5023e-5ab6-45d1-856d-286e46f09b30 None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:34:58.694772 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a5023e-5ab6-45d1-856d-286e46f09b30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:34:58.719224 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 29/57] 10.222.0.42 () {58 vars in 1024 bytes} [Sun Oct 30 00:34:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 30 00:34:58.720440 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.auth.core [None req-52a5023e-5ab6-45d1-856d-286e46f09b30 None None] MFA Rules not processed for user `eb55b6cbca4945abb21b0e49eb745e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=87956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:34:58.722126 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-52a5023e-5ab6-45d1-856d-286e46f09b30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:34:58.811421 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 29/58] 10.222.0.42 () {58 vars in 1024 bytes} [Sun Oct 30 00:34:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 30 00:34:58.910679 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763137da-894c-42a0-8686-e48e8e366a72 None None] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:34:58.911323 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763137da-894c-42a0-8686-e48e8e366a72 None None] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:34:58.911791 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763137da-894c-42a0-8686-e48e8e366a72 None None] PATH_INFO: `/` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:34:58.913346 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 30/59] 10.222.0.42 () {54 vars in 927 bytes} [Sun Oct 30 00:34:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:34:58.918998 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04efe684-e6ed-4049-9e74-2b3fcd08f4d4 None None] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:34:58.919330 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04efe684-e6ed-4049-9e74-2b3fcd08f4d4 None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:34:58.919618 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04efe684-e6ed-4049-9e74-2b3fcd08f4d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:34:58.944296 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.auth.core [None req-04efe684-e6ed-4049-9e74-2b3fcd08f4d4 None None] MFA Rules not processed for user `eb55b6cbca4945abb21b0e49eb745e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=87956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:34:58.945518 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-04efe684-e6ed-4049-9e74-2b3fcd08f4d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:34:58.948828 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=100 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:34:59.034673 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 30/60] 10.222.0.42 () {58 vars in 1024 bytes} [Sun Oct 30 00:34:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 30 00:34:59.085385 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763137da-894c-42a0-8686-e48e8e366a72 None None] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:34:59.183030 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04efe684-e6ed-4049-9e74-2b3fcd08f4d4 None None] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:34:59.219605 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763137da-894c-42a0-8686-e48e8e366a72 None None] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:34:59.295055 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81ba78a-41b0-4d26-a609-5387fda9b3b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:34:59.295727 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81ba78a-41b0-4d26-a609-5387fda9b3b7 None admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:34:59.296062 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81ba78a-41b0-4d26-a609-5387fda9b3b7 None admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:34:59.296342 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81ba78a-41b0-4d26-a609-5387fda9b3b7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:34:59.315519 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=100 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:34:59.317195 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81ba78a-41b0-4d26-a609-5387fda9b3b7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 30 00:34:59.322565 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application [None req-b81ba78a-41b0-4d26-a609-5387fda9b3b7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 30 00:34:59.322565 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:34:59.322565 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:34:59.322565 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:34:59.322565 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:34:59.322565 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:34:59.322565 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:34:59.322565 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:34:59.322565 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:34:59.322565 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:34:59.322565 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:34:59.322565 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:34:59.322565 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 30 00:34:59.322565 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 30 00:34:59.322565 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 30 00:34:59.322565 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 30 00:34:59.323746 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 30 00:34:59.323746 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 30 00:34:59.323746 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 30 00:34:59.323746 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 30 00:34:59.323746 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:34:59.323746 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:34:59.323746 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:34:59.323746 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:34:59.323746 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:34:59.323746 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:34:59.323746 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:34:59.323746 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application with Lock( Oct 30 00:34:59.323746 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:34:59.323746 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:34:59.323746 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:34:59.323746 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:34:59.324713 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:34:59.324713 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:34:59.324713 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:34:59.324713 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:34:59.324713 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 30 00:34:59.324713 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 30 00:34:59.324713 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 30 00:34:59.324713 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 30 00:34:59.324713 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 30 00:34:59.324713 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 30 00:34:59.324713 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 30 00:34:59.324713 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application Oct 30 00:34:59.324713 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 31/61] 10.222.0.42 () {56 vars in 1096 bytes} [Sun Oct 30 00:34:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:34:59.329726 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81ba78a-41b0-4d26-a609-5387fda9b3b7 None admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:34:59.367846 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04efe684-e6ed-4049-9e74-2b3fcd08f4d4 None None] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:34:59.414827 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbf648a-95e1-479f-ad6e-9ac8546a22a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:34:59.416397 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbf648a-95e1-479f-ad6e-9ac8546a22a8 None admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:34:59.416826 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbf648a-95e1-479f-ad6e-9ac8546a22a8 None admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:34:59.417490 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbf648a-95e1-479f-ad6e-9ac8546a22a8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:34:59.428222 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=100 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:34:59.431488 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbf648a-95e1-479f-ad6e-9ac8546a22a8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 30 00:34:59.438586 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application [None req-6dbf648a-95e1-479f-ad6e-9ac8546a22a8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 30 00:34:59.438586 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:34:59.438586 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:34:59.438586 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:34:59.438586 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:34:59.438586 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:34:59.438586 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:34:59.438586 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:34:59.438586 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:34:59.438586 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:34:59.438586 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:34:59.438586 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:34:59.438586 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 30 00:34:59.438586 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 30 00:34:59.438586 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 30 00:34:59.438586 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 30 00:34:59.439490 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 30 00:34:59.439490 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 30 00:34:59.439490 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 30 00:34:59.439490 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 30 00:34:59.439490 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:34:59.439490 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:34:59.439490 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:34:59.439490 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:34:59.439490 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:34:59.439490 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:34:59.439490 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:34:59.439490 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application with Lock( Oct 30 00:34:59.439490 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:34:59.439490 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:34:59.439490 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:34:59.439490 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:34:59.440237 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:34:59.440237 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:34:59.440237 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:34:59.440237 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:34:59.440237 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 30 00:34:59.440237 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 30 00:34:59.440237 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 30 00:34:59.440237 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 30 00:34:59.440237 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 30 00:34:59.440237 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 30 00:34:59.440237 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 30 00:34:59.440237 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application Oct 30 00:34:59.444525 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 31/62] 10.222.0.42 () {56 vars in 1099 bytes} [Sun Oct 30 00:34:59 2022] GET /identity/v3/roles/member => generated 84 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:34:59.446041 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334beec8-5646-482b-a771-0b7aacee769a None None] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:34:59.446328 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334beec8-5646-482b-a771-0b7aacee769a None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:34:59.446610 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334beec8-5646-482b-a771-0b7aacee769a None None] PATH_INFO: `/` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:34:59.448802 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 32/63] 10.222.0.42 () {54 vars in 927 bytes} [Sun Oct 30 00:34:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:34:59.450991 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334beec8-5646-482b-a771-0b7aacee769a None None] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:34:59.461853 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81ba78a-41b0-4d26-a609-5387fda9b3b7 None admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:34:59.501462 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f135d920-1549-4c57-bdcd-96b008096a75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:34:59.502073 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f135d920-1549-4c57-bdcd-96b008096a75 None admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:34:59.502354 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f135d920-1549-4c57-bdcd-96b008096a75 None admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:34:59.502652 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f135d920-1549-4c57-bdcd-96b008096a75 None admin] PATH_INFO: `/v3/roles` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:34:59.503424 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f135d920-1549-4c57-bdcd-96b008096a75 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:34:59.504060 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f135d920-1549-4c57-bdcd-96b008096a75 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:34:59.505208 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f135d920-1549-4c57-bdcd-96b008096a75 None admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:34:59.514574 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 32/64] 10.222.0.42 () {56 vars in 1099 bytes} [Sun Oct 30 00:34:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:34:59.515469 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f135d920-1549-4c57-bdcd-96b008096a75 None admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:34:59.556060 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334beec8-5646-482b-a771-0b7aacee769a None None] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:34:59.573562 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=100 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:34:59.589088 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f5cd97-1afb-48c4-b8d1-d2e7fbcef9a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:34:59.589768 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f5cd97-1afb-48c4-b8d1-d2e7fbcef9a2 None admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:34:59.590053 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f5cd97-1afb-48c4-b8d1-d2e7fbcef9a2 None admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:34:59.590335 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f5cd97-1afb-48c4-b8d1-d2e7fbcef9a2 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:34:59.601102 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f5cd97-1afb-48c4-b8d1-d2e7fbcef9a2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 30 00:34:59.606054 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application [None req-b1f5cd97-1afb-48c4-b8d1-d2e7fbcef9a2 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 30 00:34:59.606054 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:34:59.606054 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:34:59.606054 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:34:59.606054 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:34:59.606054 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:34:59.606054 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:34:59.606054 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:34:59.606054 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:34:59.606054 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:34:59.606054 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:34:59.606054 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:34:59.606054 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 30 00:34:59.606054 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 30 00:34:59.606054 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 30 00:34:59.606054 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 30 00:34:59.607673 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 30 00:34:59.607673 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 30 00:34:59.607673 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 30 00:34:59.607673 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 30 00:34:59.607673 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:34:59.607673 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:34:59.607673 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:34:59.607673 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:34:59.607673 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:34:59.607673 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:34:59.607673 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:34:59.607673 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application with Lock( Oct 30 00:34:59.607673 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:34:59.607673 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:34:59.607673 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:34:59.607673 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:34:59.608632 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:34:59.608632 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:34:59.608632 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:34:59.608632 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:34:59.608632 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 30 00:34:59.608632 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 30 00:34:59.608632 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 30 00:34:59.608632 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 30 00:34:59.608632 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 30 00:34:59.608632 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 30 00:34:59.608632 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 30 00:34:59.608632 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application Oct 30 00:34:59.608632 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 33/65] 10.222.0.42 () {56 vars in 1114 bytes} [Sun Oct 30 00:34:59 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:34:59.608632 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8205e5eb-c119-4258-9da7-e9b210883fc2 None None] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:34:59.609305 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8205e5eb-c119-4258-9da7-e9b210883fc2 None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:34:59.609305 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8205e5eb-c119-4258-9da7-e9b210883fc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:34:59.615343 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f135d920-1549-4c57-bdcd-96b008096a75 None admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:34:59.628689 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.auth.core [None req-8205e5eb-c119-4258-9da7-e9b210883fc2 None None] MFA Rules not processed for user `eb55b6cbca4945abb21b0e49eb745e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=87956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:34:59.629906 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-8205e5eb-c119-4258-9da7-e9b210883fc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:34:59.652510 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0115d871-e1d4-4e26-ad75-ba41d35fc05f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:34:59.653127 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0115d871-e1d4-4e26-ad75-ba41d35fc05f None admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:34:59.653410 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0115d871-e1d4-4e26-ad75-ba41d35fc05f None admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:34:59.653676 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0115d871-e1d4-4e26-ad75-ba41d35fc05f None admin] PATH_INFO: `/v3/roles` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:34:59.654356 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0115d871-e1d4-4e26-ad75-ba41d35fc05f None admin] RBAC: Adding query filter params (name=member) {{(pid=87955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:34:59.654658 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0115d871-e1d4-4e26-ad75-ba41d35fc05f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:34:59.656083 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0115d871-e1d4-4e26-ad75-ba41d35fc05f None admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:34:59.663830 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 33/66] 10.222.0.42 () {56 vars in 1101 bytes} [Sun Oct 30 00:34:59 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:34:59.665569 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90bdd52-737c-4f55-8832-45547e88f2d3 None None] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:34:59.665569 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90bdd52-737c-4f55-8832-45547e88f2d3 None None] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:34:59.665569 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90bdd52-737c-4f55-8832-45547e88f2d3 None None] PATH_INFO: `/` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:34:59.666892 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 34/67] 10.222.0.42 () {54 vars in 927 bytes} [Sun Oct 30 00:34:59 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:34:59.671555 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90bdd52-737c-4f55-8832-45547e88f2d3 None None] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:34:59.686300 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=100 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:34:59.701787 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 34/68] 10.222.0.42 () {58 vars in 1024 bytes} [Sun Oct 30 00:34:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 30 00:34:59.701787 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8205e5eb-c119-4258-9da7-e9b210883fc2 None None] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:34:59.788522 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90bdd52-737c-4f55-8832-45547e88f2d3 None None] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:34:59.812655 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8205e5eb-c119-4258-9da7-e9b210883fc2 None None] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:34:59.814647 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=100 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:34:59.827013 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235d3b8f-bc28-49d7-b2df-3cf12684025f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:34:59.827875 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235d3b8f-bc28-49d7-b2df-3cf12684025f None admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:34:59.828112 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235d3b8f-bc28-49d7-b2df-3cf12684025f None admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:34:59.828397 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235d3b8f-bc28-49d7-b2df-3cf12684025f None admin] PATH_INFO: `/v3/users/eb55b6cbca4945abb21b0e49eb745e1c` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:34:59.829559 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235d3b8f-bc28-49d7-b2df-3cf12684025f None admin] RBAC: Authorizing `identity:get_user(user_id=eb55b6cbca4945abb21b0e49eb745e1c)` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:34:59.831078 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235d3b8f-bc28-49d7-b2df-3cf12684025f None admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:34:59.832968 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 35/69] 10.222.0.42 () {56 vars in 1177 bytes} [Sun Oct 30 00:34:59 2022] GET /identity/v3/users/eb55b6cbca4945abb21b0e49eb745e1c => generated 247 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:34:59.833739 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235d3b8f-bc28-49d7-b2df-3cf12684025f None admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:34:59.851969 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2713cf-3f37-4035-b043-ebef2929f0bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:34:59.852662 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2713cf-3f37-4035-b043-ebef2929f0bf None admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:34:59.852873 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2713cf-3f37-4035-b043-ebef2929f0bf None admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:34:59.853144 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2713cf-3f37-4035-b043-ebef2929f0bf None admin] PATH_INFO: `/v3/roles` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:34:59.853815 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2713cf-3f37-4035-b043-ebef2929f0bf None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87956) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:34:59.854135 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2713cf-3f37-4035-b043-ebef2929f0bf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:34:59.855572 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2713cf-3f37-4035-b043-ebef2929f0bf None admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:34:59.867831 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 35/70] 10.222.0.42 () {56 vars in 1111 bytes} [Sun Oct 30 00:34:59 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:34:59.868989 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b29c7f7-7320-42db-a4cd-ae8f0c1ff126 None None] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:34:59.869337 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b29c7f7-7320-42db-a4cd-ae8f0c1ff126 None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:34:59.869737 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b29c7f7-7320-42db-a4cd-ae8f0c1ff126 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:34:59.887451 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.auth.core [None req-9b29c7f7-7320-42db-a4cd-ae8f0c1ff126 None None] MFA Rules not processed for user `eb55b6cbca4945abb21b0e49eb745e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=87956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:34:59.888655 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-9b29c7f7-7320-42db-a4cd-ae8f0c1ff126 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:34:59.936767 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=100 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:34:59.946544 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235d3b8f-bc28-49d7-b2df-3cf12684025f None admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:34:59.959625 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 36/71] 10.222.0.42 () {58 vars in 1024 bytes} [Sun Oct 30 00:34:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 30 00:34:59.960698 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b29c7f7-7320-42db-a4cd-ae8f0c1ff126 None None] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:34:59.982864 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6654a6b1-9152-47e7-8ed4-0655b49d1d9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:34:59.983555 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6654a6b1-9152-47e7-8ed4-0655b49d1d9d None admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:34:59.983851 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6654a6b1-9152-47e7-8ed4-0655b49d1d9d None admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:34:59.984111 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6654a6b1-9152-47e7-8ed4-0655b49d1d9d None admin] PATH_INFO: `/v3/users/da70f1c161a64061818e8e4c38b75efc` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:00.000320 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6654a6b1-9152-47e7-8ed4-0655b49d1d9d None admin] RBAC: Authorizing `identity:get_user(user_id=da70f1c161a64061818e8e4c38b75efc)` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:35:00.001781 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6654a6b1-9152-47e7-8ed4-0655b49d1d9d None admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:35:00.004588 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 36/72] 10.222.0.42 () {56 vars in 1177 bytes} [Sun Oct 30 00:34:59 2022] GET /identity/v3/users/da70f1c161a64061818e8e4c38b75efc => generated 275 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:35:00.004588 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6654a6b1-9152-47e7-8ed4-0655b49d1d9d None admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:35:00.057286 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=100 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:35:00.076863 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b29c7f7-7320-42db-a4cd-ae8f0c1ff126 None None] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:35:00.112936 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963a113b-437e-4ea8-b1c0-a92dd553074a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:35:00.113883 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963a113b-437e-4ea8-b1c0-a92dd553074a None admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:00.114166 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963a113b-437e-4ea8-b1c0-a92dd553074a None admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:00.114440 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963a113b-437e-4ea8-b1c0-a92dd553074a None admin] PATH_INFO: `/v3/projects/cbc9734c46db44918000791ce8bbb4e8` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:00.115659 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963a113b-437e-4ea8-b1c0-a92dd553074a None admin] RBAC: Authorizing `identity:get_project(project_id=cbc9734c46db44918000791ce8bbb4e8)` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:35:00.116665 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6654a6b1-9152-47e7-8ed4-0655b49d1d9d None admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:35:00.117111 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963a113b-437e-4ea8-b1c0-a92dd553074a None admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:35:00.118938 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 37/73] 10.222.0.42 () {56 vars in 1186 bytes} [Sun Oct 30 00:34:59 2022] GET /identity/v3/projects/cbc9734c46db44918000791ce8bbb4e8 => generated 298 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:35:00.119540 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963a113b-437e-4ea8-b1c0-a92dd553074a None admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:35:00.158224 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e131fbb2-373e-4ac6-9072-d5c0d002fa70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:35:00.158950 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e131fbb2-373e-4ac6-9072-d5c0d002fa70 None admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:00.159259 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e131fbb2-373e-4ac6-9072-d5c0d002fa70 None admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:00.159540 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e131fbb2-373e-4ac6-9072-d5c0d002fa70 None admin] PATH_INFO: `/v3/users/da70f1c161a64061818e8e4c38b75efc` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:00.160677 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e131fbb2-373e-4ac6-9072-d5c0d002fa70 None admin] RBAC: Authorizing `identity:get_user(user_id=da70f1c161a64061818e8e4c38b75efc)` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:35:00.162135 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e131fbb2-373e-4ac6-9072-d5c0d002fa70 None admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:35:00.163953 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 37/74] 10.222.0.42 () {56 vars in 1177 bytes} [Sun Oct 30 00:35:00 2022] GET /identity/v3/users/da70f1c161a64061818e8e4c38b75efc => generated 275 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:35:00.164594 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e131fbb2-373e-4ac6-9072-d5c0d002fa70 None admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:35:00.185314 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=100 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:35:00.232376 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963a113b-437e-4ea8-b1c0-a92dd553074a None admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:35:00.266072 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf97eec-40b5-4d2e-8375-cd1a4db26657 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:35:00.266709 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf97eec-40b5-4d2e-8375-cd1a4db26657 None admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:00.267011 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf97eec-40b5-4d2e-8375-cd1a4db26657 None admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:00.267311 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf97eec-40b5-4d2e-8375-cd1a4db26657 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:00.267524 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e131fbb2-373e-4ac6-9072-d5c0d002fa70 None admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:35:00.277658 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf97eec-40b5-4d2e-8375-cd1a4db26657 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 30 00:35:00.282485 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application [None req-0bf97eec-40b5-4d2e-8375-cd1a4db26657 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 30 00:35:00.282485 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:35:00.282485 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:35:00.282485 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:35:00.282485 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:35:00.282485 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:35:00.282485 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:35:00.282485 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:35:00.282485 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:35:00.282485 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:35:00.282485 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:35:00.282485 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:35:00.282485 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 30 00:35:00.282485 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 30 00:35:00.282485 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 30 00:35:00.282485 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 30 00:35:00.283460 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 30 00:35:00.283460 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 30 00:35:00.283460 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 30 00:35:00.283460 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 30 00:35:00.283460 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:35:00.283460 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:35:00.283460 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:35:00.283460 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:35:00.283460 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:35:00.283460 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:35:00.283460 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:35:00.283460 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application with Lock( Oct 30 00:35:00.283460 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:35:00.283460 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:35:00.283460 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:35:00.283460 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:35:00.284232 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:35:00.284232 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:35:00.284232 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:35:00.284232 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:35:00.284232 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 30 00:35:00.284232 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 30 00:35:00.284232 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 30 00:35:00.284232 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 30 00:35:00.284232 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 30 00:35:00.284232 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 30 00:35:00.284232 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 30 00:35:00.284232 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application Oct 30 00:35:00.284232 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 38/75] 10.222.0.42 () {56 vars in 1099 bytes} [Sun Oct 30 00:35:00 2022] GET /identity/v3/roles/member => generated 84 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:35:00.284853 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf97eec-40b5-4d2e-8375-cd1a4db26657 None admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:35:00.285609 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=100 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:35:00.307631 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2e81a5-7d97-4bcb-8f92-f5e2b133e7a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:35:00.308310 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2e81a5-7d97-4bcb-8f92-f5e2b133e7a2 None admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:00.308589 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2e81a5-7d97-4bcb-8f92-f5e2b133e7a2 None admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:00.308862 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2e81a5-7d97-4bcb-8f92-f5e2b133e7a2 None admin] PATH_INFO: `/v3/projects/cbc9734c46db44918000791ce8bbb4e8` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:00.310014 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2e81a5-7d97-4bcb-8f92-f5e2b133e7a2 None admin] RBAC: Authorizing `identity:get_project(project_id=cbc9734c46db44918000791ce8bbb4e8)` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:35:00.311513 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2e81a5-7d97-4bcb-8f92-f5e2b133e7a2 None admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:35:00.313148 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 38/76] 10.222.0.42 () {56 vars in 1186 bytes} [Sun Oct 30 00:35:00 2022] GET /identity/v3/projects/cbc9734c46db44918000791ce8bbb4e8 => generated 298 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:35:00.313899 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2e81a5-7d97-4bcb-8f92-f5e2b133e7a2 None admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:35:00.389064 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf97eec-40b5-4d2e-8375-cd1a4db26657 None admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:35:00.399292 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=100 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:35:00.411149 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2e81a5-7d97-4bcb-8f92-f5e2b133e7a2 None admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:35:00.422042 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de51b7df-3476-4dc2-8e5f-74cb8b72aefc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:35:00.422705 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de51b7df-3476-4dc2-8e5f-74cb8b72aefc None admin] REQUEST_METHOD: `PUT` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:00.422985 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de51b7df-3476-4dc2-8e5f-74cb8b72aefc None admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:00.423284 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de51b7df-3476-4dc2-8e5f-74cb8b72aefc None admin] PATH_INFO: `/v3/projects/cbc9734c46db44918000791ce8bbb4e8/users/eb55b6cbca4945abb21b0e49eb745e1c/roles/6ccaa8c11f29456fb4e4eeccb21616c7` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:00.425199 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de51b7df-3476-4dc2-8e5f-74cb8b72aefc None admin] RBAC: Authorizing `identity:create_grant(project_id=cbc9734c46db44918000791ce8bbb4e8, user_id=eb55b6cbca4945abb21b0e49eb745e1c, role_id=6ccaa8c11f29456fb4e4eeccb21616c7)` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:35:00.426652 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de51b7df-3476-4dc2-8e5f-74cb8b72aefc None admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:35:00.440304 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 39/77] 10.222.0.42 () {58 vars in 1439 bytes} [Sun Oct 30 00:35:00 2022] PUT /identity/v3/projects/cbc9734c46db44918000791ce8bbb4e8/users/eb55b6cbca4945abb21b0e49eb745e1c/roles/6ccaa8c11f29456fb4e4eeccb21616c7 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 00:35:00.441093 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de51b7df-3476-4dc2-8e5f-74cb8b72aefc None admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:35:00.444538 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c222b1-9490-4d4d-9476-427b249b9a4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:35:00.445364 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c222b1-9490-4d4d-9476-427b249b9a4d None admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:00.445769 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c222b1-9490-4d4d-9476-427b249b9a4d None admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:00.446166 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c222b1-9490-4d4d-9476-427b249b9a4d None admin] PATH_INFO: `/v3/projects/cbc9734c46db44918000791ce8bbb4e8` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:00.447575 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c222b1-9490-4d4d-9476-427b249b9a4d None admin] RBAC: Authorizing `identity:get_project(project_id=cbc9734c46db44918000791ce8bbb4e8)` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:35:00.449309 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c222b1-9490-4d4d-9476-427b249b9a4d None admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:35:00.451588 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 39/78] 10.222.0.42 () {56 vars in 1186 bytes} [Sun Oct 30 00:35:00 2022] GET /identity/v3/projects/cbc9734c46db44918000791ce8bbb4e8 => generated 298 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:35:00.452574 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c222b1-9490-4d4d-9476-427b249b9a4d None admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:35:00.519263 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=100 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:35:00.562513 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de51b7df-3476-4dc2-8e5f-74cb8b72aefc None admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:35:00.567184 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c222b1-9490-4d4d-9476-427b249b9a4d None admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:35:00.598639 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb01145-61b0-44d2-b07b-18075bb71342 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:35:00.599415 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb01145-61b0-44d2-b07b-18075bb71342 None admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:00.599699 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb01145-61b0-44d2-b07b-18075bb71342 None admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:00.599978 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb01145-61b0-44d2-b07b-18075bb71342 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:00.601162 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb01145-61b0-44d2-b07b-18075bb71342 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:35:00.602654 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb01145-61b0-44d2-b07b-18075bb71342 None admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:35:00.607330 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 40/79] 10.222.0.42 () {56 vars in 1108 bytes} [Sun Oct 30 00:35:00 2022] GET /identity/v3/domains/default => generated 199 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:35:00.607330 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb01145-61b0-44d2-b07b-18075bb71342 None admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:35:00.610592 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb034df-ff9b-41bd-8091-f6c6cfc40f2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:35:00.611243 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb034df-ff9b-41bd-8091-f6c6cfc40f2d None admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:00.611527 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb034df-ff9b-41bd-8091-f6c6cfc40f2d None admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:00.611801 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb034df-ff9b-41bd-8091-f6c6cfc40f2d None admin] PATH_INFO: `/v3/roles` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:00.612476 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb034df-ff9b-41bd-8091-f6c6cfc40f2d None admin] RBAC: Adding query filter params (name=member) {{(pid=87955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:35:00.612778 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb034df-ff9b-41bd-8091-f6c6cfc40f2d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:35:00.614224 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb034df-ff9b-41bd-8091-f6c6cfc40f2d None admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:35:00.624915 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 40/80] 10.222.0.42 () {56 vars in 1101 bytes} [Sun Oct 30 00:35:00 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:35:00.625736 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb034df-ff9b-41bd-8091-f6c6cfc40f2d None admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:35:00.653143 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:35:00.717568 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb01145-61b0-44d2-b07b-18075bb71342 None admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:35:00.725667 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb034df-ff9b-41bd-8091-f6c6cfc40f2d None admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:35:00.742355 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=100 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:35:00.754000 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194d6dc3-dd46-4fa0-a5c9-febe59e1b44b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:35:00.754915 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194d6dc3-dd46-4fa0-a5c9-febe59e1b44b None admin] REQUEST_METHOD: `PUT` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:00.755399 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194d6dc3-dd46-4fa0-a5c9-febe59e1b44b None admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:00.755745 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194d6dc3-dd46-4fa0-a5c9-febe59e1b44b None admin] PATH_INFO: `/v3/projects/cbc9734c46db44918000791ce8bbb4e8/users/da70f1c161a64061818e8e4c38b75efc/roles/1c93019874174c4b91118d9ce2347e47` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:00.757676 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194d6dc3-dd46-4fa0-a5c9-febe59e1b44b None admin] RBAC: Authorizing `identity:create_grant(project_id=cbc9734c46db44918000791ce8bbb4e8, user_id=da70f1c161a64061818e8e4c38b75efc, role_id=1c93019874174c4b91118d9ce2347e47)` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:35:00.759127 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194d6dc3-dd46-4fa0-a5c9-febe59e1b44b None admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:35:00.760074 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9b4aaf-759b-4932-a13f-4d827549bccf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:35:00.760735 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9b4aaf-759b-4932-a13f-4d827549bccf None admin] REQUEST_METHOD: `PUT` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:00.761045 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9b4aaf-759b-4932-a13f-4d827549bccf None admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:00.761323 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9b4aaf-759b-4932-a13f-4d827549bccf None admin] PATH_INFO: `/v3/projects/cbc9734c46db44918000791ce8bbb4e8/users/da70f1c161a64061818e8e4c38b75efc/roles/7f42beaeb9e84fd8961e2fa0ae82d034` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:00.763550 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9b4aaf-759b-4932-a13f-4d827549bccf None admin] RBAC: Authorizing `identity:create_grant(project_id=cbc9734c46db44918000791ce8bbb4e8, user_id=da70f1c161a64061818e8e4c38b75efc, role_id=7f42beaeb9e84fd8961e2fa0ae82d034)` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:35:00.765294 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9b4aaf-759b-4932-a13f-4d827549bccf None admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:35:00.773443 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 41/81] 10.222.0.42 () {58 vars in 1439 bytes} [Sun Oct 30 00:35:00 2022] PUT /identity/v3/projects/cbc9734c46db44918000791ce8bbb4e8/users/da70f1c161a64061818e8e4c38b75efc/roles/1c93019874174c4b91118d9ce2347e47 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 00:35:00.774190 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194d6dc3-dd46-4fa0-a5c9-febe59e1b44b None admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:35:00.788807 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 41/82] 10.222.0.42 () {58 vars in 1439 bytes} [Sun Oct 30 00:35:00 2022] PUT /identity/v3/projects/cbc9734c46db44918000791ce8bbb4e8/users/da70f1c161a64061818e8e4c38b75efc/roles/7f42beaeb9e84fd8961e2fa0ae82d034 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 00:35:00.789973 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9b4aaf-759b-4932-a13f-4d827549bccf None admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:35:01.007892 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9b4aaf-759b-4932-a13f-4d827549bccf None admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:35:01.020556 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:35:01.025404 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194d6dc3-dd46-4fa0-a5c9-febe59e1b44b None admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:35:01.057773 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902a2140-0009-432c-86aa-11fa122bae7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:35:01.058983 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902a2140-0009-432c-86aa-11fa122bae7c None admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:01.059483 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902a2140-0009-432c-86aa-11fa122bae7c None admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:01.060105 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902a2140-0009-432c-86aa-11fa122bae7c None admin] PATH_INFO: `/v3/users/da70f1c161a64061818e8e4c38b75efc` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:01.062144 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902a2140-0009-432c-86aa-11fa122bae7c None admin] RBAC: Authorizing `identity:get_user(user_id=da70f1c161a64061818e8e4c38b75efc)` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:35:01.063858 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902a2140-0009-432c-86aa-11fa122bae7c None admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:35:01.065586 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e002308-6011-47e4-a781-358c978878f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:35:01.068381 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e002308-6011-47e4-a781-358c978878f5 None admin] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:01.068381 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e002308-6011-47e4-a781-358c978878f5 None admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:01.068381 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e002308-6011-47e4-a781-358c978878f5 None admin] PATH_INFO: `/v3/users` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:01.068381 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e002308-6011-47e4-a781-358c978878f5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:35:01.069228 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 42/83] 10.222.0.42 () {56 vars in 1177 bytes} [Sun Oct 30 00:35:00 2022] GET /identity/v3/users/da70f1c161a64061818e8e4c38b75efc => generated 275 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:35:01.070107 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e002308-6011-47e4-a781-358c978878f5 None admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:35:01.075895 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902a2140-0009-432c-86aa-11fa122bae7c None admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:35:01.108226 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 42/84] 10.222.0.42 () {60 vars in 1132 bytes} [Sun Oct 30 00:35:00 2022] POST /identity/v3/users => generated 289 bytes in 334 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 00:35:01.155534 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:35:01.236840 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902a2140-0009-432c-86aa-11fa122bae7c None admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:35:01.281964 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1f38ab-6563-470f-a030-f13429e24851 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:35:01.282582 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1f38ab-6563-470f-a030-f13429e24851 None admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:01.282923 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1f38ab-6563-470f-a030-f13429e24851 None admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:01.283256 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1f38ab-6563-470f-a030-f13429e24851 None admin] PATH_INFO: `/v3/projects/83cdf66c40584b3fbfa7a4ce60b58017` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:01.287987 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1f38ab-6563-470f-a030-f13429e24851 None admin] RBAC: Authorizing `identity:get_project(project_id=83cdf66c40584b3fbfa7a4ce60b58017)` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:35:01.289605 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1f38ab-6563-470f-a030-f13429e24851 None admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:35:01.291531 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 43/85] 10.222.0.42 () {56 vars in 1186 bytes} [Sun Oct 30 00:35:01 2022] GET /identity/v3/projects/83cdf66c40584b3fbfa7a4ce60b58017 => generated 312 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 30 00:35:01.297776 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e002308-6011-47e4-a781-358c978878f5 None admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:35:01.418931 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e002308-6011-47e4-a781-358c978878f5 None admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:35:01.457562 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc55784-f3a9-4672-84ac-83986b5a9fa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:35:01.458244 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc55784-f3a9-4672-84ac-83986b5a9fa2 None admin] REQUEST_METHOD: `PUT` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:01.458529 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc55784-f3a9-4672-84ac-83986b5a9fa2 None admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:01.458809 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc55784-f3a9-4672-84ac-83986b5a9fa2 None admin] PATH_INFO: `/v3/projects/83cdf66c40584b3fbfa7a4ce60b58017/users/da70f1c161a64061818e8e4c38b75efc/roles/1c93019874174c4b91118d9ce2347e47` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:01.460771 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc55784-f3a9-4672-84ac-83986b5a9fa2 None admin] RBAC: Authorizing `identity:create_grant(project_id=83cdf66c40584b3fbfa7a4ce60b58017, user_id=da70f1c161a64061818e8e4c38b75efc, role_id=1c93019874174c4b91118d9ce2347e47)` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:35:01.462367 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc55784-f3a9-4672-84ac-83986b5a9fa2 None admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:35:01.482747 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 43/86] 10.222.0.42 () {58 vars in 1439 bytes} [Sun Oct 30 00:35:01 2022] PUT /identity/v3/projects/83cdf66c40584b3fbfa7a4ce60b58017/users/da70f1c161a64061818e8e4c38b75efc/roles/1c93019874174c4b91118d9ce2347e47 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 00:35:02.780671 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f528ca4-e6af-47c8-b534-f3ab24314400 None None] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:02.781207 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f528ca4-e6af-47c8-b534-f3ab24314400 None None] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:02.781207 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f528ca4-e6af-47c8-b534-f3ab24314400 None None] PATH_INFO: `/` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:02.782662 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 44/87] 10.222.0.42 () {54 vars in 927 bytes} [Sun Oct 30 00:35:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:35:02.788404 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3284f4e-6abf-4300-9f55-031c13fb56fa None None] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:02.788827 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3284f4e-6abf-4300-9f55-031c13fb56fa None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:02.788997 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3284f4e-6abf-4300-9f55-031c13fb56fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:02.813871 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.auth.core [None req-b3284f4e-6abf-4300-9f55-031c13fb56fa None None] MFA Rules not processed for user `eb55b6cbca4945abb21b0e49eb745e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=87956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:35:02.815095 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-b3284f4e-6abf-4300-9f55-031c13fb56fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:35:02.831660 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:35:02.916389 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 44/88] 10.222.0.42 () {58 vars in 1024 bytes} [Sun Oct 30 00:35:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 30 00:35:03.453335 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f528ca4-e6af-47c8-b534-f3ab24314400 None None] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:35:03.580509 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f528ca4-e6af-47c8-b534-f3ab24314400 None None] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:35:03.591023 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f94edf2-b431-4b1e-9cf5-632b2b303157 None None] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:03.591481 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f94edf2-b431-4b1e-9cf5-632b2b303157 None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:03.591879 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f94edf2-b431-4b1e-9cf5-632b2b303157 None None] PATH_INFO: `/` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:03.593815 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 45/89] 10.222.0.42 () {54 vars in 927 bytes} [Sun Oct 30 00:35:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:35:03.599743 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d1d2f1-f6db-4b96-b06b-61a99e2ca9fd None None] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:03.600169 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d1d2f1-f6db-4b96-b06b-61a99e2ca9fd None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:03.600454 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d1d2f1-f6db-4b96-b06b-61a99e2ca9fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:03.612551 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=100 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:35:03.632162 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.auth.core [None req-62d1d2f1-f6db-4b96-b06b-61a99e2ca9fd None None] MFA Rules not processed for user `eb55b6cbca4945abb21b0e49eb745e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=87956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:35:03.633365 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-62d1d2f1-f6db-4b96-b06b-61a99e2ca9fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:35:03.666732 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3da8cb-5e05-477b-8c86-ce1751f754b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:35:03.667405 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3da8cb-5e05-477b-8c86-ce1751f754b4 None admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:03.667688 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3da8cb-5e05-477b-8c86-ce1751f754b4 None admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:03.667966 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3da8cb-5e05-477b-8c86-ce1751f754b4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:03.689848 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3da8cb-5e05-477b-8c86-ce1751f754b4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 30 00:35:03.696501 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application [None req-3a3da8cb-5e05-477b-8c86-ce1751f754b4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 30 00:35:03.696501 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:35:03.696501 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:35:03.696501 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:35:03.696501 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:35:03.696501 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:35:03.696501 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:35:03.696501 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:35:03.696501 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:35:03.696501 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:35:03.696501 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:35:03.696501 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:35:03.696501 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 30 00:35:03.696501 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 30 00:35:03.696501 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 30 00:35:03.696501 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 30 00:35:03.697372 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 30 00:35:03.697372 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 30 00:35:03.697372 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 30 00:35:03.697372 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 30 00:35:03.697372 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:35:03.697372 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:35:03.697372 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:35:03.697372 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:35:03.697372 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:35:03.697372 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:35:03.697372 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:35:03.697372 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application with Lock( Oct 30 00:35:03.697372 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:35:03.697372 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:35:03.697372 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:35:03.697372 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:35:03.698125 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:35:03.698125 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:35:03.698125 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:35:03.698125 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:35:03.698125 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 30 00:35:03.698125 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 30 00:35:03.698125 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 30 00:35:03.698125 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 30 00:35:03.698125 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 30 00:35:03.698125 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 30 00:35:03.698125 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 30 00:35:03.698125 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application Oct 30 00:35:03.698125 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 45/90] 10.222.0.42 () {56 vars in 1096 bytes} [Sun Oct 30 00:35:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:35:03.699260 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4294b1de-ed31-4988-9d97-def2bc1a9f21 None None] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:03.699260 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4294b1de-ed31-4988-9d97-def2bc1a9f21 None None] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:03.699546 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4294b1de-ed31-4988-9d97-def2bc1a9f21 None None] PATH_INFO: `/` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:03.700601 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 46/91] 10.222.0.42 () {54 vars in 927 bytes} [Sun Oct 30 00:35:03 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:35:03.710127 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4294b1de-ed31-4988-9d97-def2bc1a9f21 None None] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:35:03.788525 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 46/92] 10.222.0.42 () {58 vars in 1024 bytes} [Sun Oct 30 00:35:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 30 00:35:03.790444 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2738e90d-13df-4cc9-8a48-ec0e28d431d3 None None] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:03.790979 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2738e90d-13df-4cc9-8a48-ec0e28d431d3 None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:03.791477 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2738e90d-13df-4cc9-8a48-ec0e28d431d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:03.836264 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.auth.core [None req-2738e90d-13df-4cc9-8a48-ec0e28d431d3 None None] MFA Rules not processed for user `eb55b6cbca4945abb21b0e49eb745e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=87956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:35:03.837584 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-2738e90d-13df-4cc9-8a48-ec0e28d431d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:35:03.849631 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4294b1de-ed31-4988-9d97-def2bc1a9f21 None None] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:35:03.897367 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11e709a-1712-41c7-a3ae-24e67084685b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:35:03.897991 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11e709a-1712-41c7-a3ae-24e67084685b None admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:03.898274 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11e709a-1712-41c7-a3ae-24e67084685b None admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:03.898668 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11e709a-1712-41c7-a3ae-24e67084685b None admin] PATH_INFO: `/v3/roles` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:03.899373 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11e709a-1712-41c7-a3ae-24e67084685b None admin] RBAC: Adding query filter params (name=admin) {{(pid=87955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:35:03.899683 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11e709a-1712-41c7-a3ae-24e67084685b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:35:03.901517 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11e709a-1712-41c7-a3ae-24e67084685b None admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:35:03.925328 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 47/93] 10.222.0.42 () {56 vars in 1099 bytes} [Sun Oct 30 00:35:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:35:03.935765 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11e709a-1712-41c7-a3ae-24e67084685b None admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:35:03.983794 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 47/94] 10.222.0.42 () {58 vars in 1024 bytes} [Sun Oct 30 00:35:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 30 00:35:04.008577 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=100 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:35:04.128736 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11e709a-1712-41c7-a3ae-24e67084685b None admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:35:04.156917 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2738e90d-13df-4cc9-8a48-ec0e28d431d3 None None] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:35:04.168283 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=100 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:35:04.180791 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21661f0a-bb5d-45c2-968b-b8c178f27654 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:35:04.180791 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21661f0a-bb5d-45c2-968b-b8c178f27654 None admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:04.180791 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21661f0a-bb5d-45c2-968b-b8c178f27654 None admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:04.180791 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21661f0a-bb5d-45c2-968b-b8c178f27654 None admin] PATH_INFO: `/v3/users/eb55b6cbca4945abb21b0e49eb745e1c` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:04.181193 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21661f0a-bb5d-45c2-968b-b8c178f27654 None admin] RBAC: Authorizing `identity:get_user(user_id=eb55b6cbca4945abb21b0e49eb745e1c)` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:35:04.182658 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21661f0a-bb5d-45c2-968b-b8c178f27654 None admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:35:04.187488 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 48/95] 10.222.0.42 () {56 vars in 1177 bytes} [Sun Oct 30 00:35:03 2022] GET /identity/v3/users/eb55b6cbca4945abb21b0e49eb745e1c => generated 247 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 30 00:35:04.197344 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21661f0a-bb5d-45c2-968b-b8c178f27654 None admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:35:04.328235 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21661f0a-bb5d-45c2-968b-b8c178f27654 None admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:35:04.330005 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=100 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:35:04.371665 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1617cde3-0ce7-4ce8-90de-67edb779362d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:35:04.372686 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1617cde3-0ce7-4ce8-90de-67edb779362d None admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:04.373113 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1617cde3-0ce7-4ce8-90de-67edb779362d None admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:04.373849 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1617cde3-0ce7-4ce8-90de-67edb779362d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:04.382357 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2738e90d-13df-4cc9-8a48-ec0e28d431d3 None None] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:35:04.418412 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77de473-dcbe-469b-8a27-fbfbc4e41ece None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:35:04.419355 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77de473-dcbe-469b-8a27-fbfbc4e41ece None admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:04.419816 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77de473-dcbe-469b-8a27-fbfbc4e41ece None admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:04.420257 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77de473-dcbe-469b-8a27-fbfbc4e41ece None admin] PATH_INFO: `/v3/roles/member` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:04.435762 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77de473-dcbe-469b-8a27-fbfbc4e41ece None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 30 00:35:04.442264 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application [None req-d77de473-dcbe-469b-8a27-fbfbc4e41ece None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 30 00:35:04.442264 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:35:04.442264 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:35:04.442264 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:35:04.442264 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:35:04.442264 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:35:04.442264 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:35:04.442264 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:35:04.442264 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:35:04.442264 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:35:04.442264 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:35:04.442264 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:35:04.442264 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 30 00:35:04.442264 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 30 00:35:04.442264 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 30 00:35:04.442264 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 30 00:35:04.443324 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 30 00:35:04.443324 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 30 00:35:04.443324 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 30 00:35:04.443324 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 30 00:35:04.443324 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:35:04.443324 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:35:04.443324 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:35:04.443324 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:35:04.443324 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:35:04.443324 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:35:04.443324 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:35:04.443324 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application with Lock( Oct 30 00:35:04.443324 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:35:04.443324 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:35:04.443324 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:35:04.443324 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:35:04.444091 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:35:04.444091 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:35:04.444091 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:35:04.444091 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:35:04.444091 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 30 00:35:04.444091 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 30 00:35:04.444091 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 30 00:35:04.444091 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 30 00:35:04.444091 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 30 00:35:04.444091 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 30 00:35:04.444091 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 30 00:35:04.444091 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application Oct 30 00:35:04.444665 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 48/96] 10.222.0.42 () {56 vars in 1099 bytes} [Sun Oct 30 00:35:04 2022] GET /identity/v3/roles/member => generated 84 bytes in 288 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 30 00:35:04.445564 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77de473-dcbe-469b-8a27-fbfbc4e41ece None admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:35:04.458503 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1617cde3-0ce7-4ce8-90de-67edb779362d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:35:04.460125 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1617cde3-0ce7-4ce8-90de-67edb779362d None admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:35:04.531872 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=100 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:35:04.578590 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 49/97] 10.222.0.42 () {58 vars in 1282 bytes} [Sun Oct 30 00:35:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Oct 30 00:35:04.579424 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1617cde3-0ce7-4ce8-90de-67edb779362d None admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:35:04.580366 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77de473-dcbe-469b-8a27-fbfbc4e41ece None admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:35:04.585481 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=100 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:35:04.629790 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b17c45c-6d49-41f8-be02-9e45daaf8c71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:35:04.631154 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b17c45c-6d49-41f8-be02-9e45daaf8c71 None admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:04.631684 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b17c45c-6d49-41f8-be02-9e45daaf8c71 None admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:04.632152 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b17c45c-6d49-41f8-be02-9e45daaf8c71 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:04.654910 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b17c45c-6d49-41f8-be02-9e45daaf8c71 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 30 00:35:04.667877 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application [None req-5b17c45c-6d49-41f8-be02-9e45daaf8c71 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 30 00:35:04.667877 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:35:04.667877 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:35:04.667877 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:35:04.667877 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:35:04.667877 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:35:04.667877 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:35:04.667877 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:35:04.667877 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:35:04.667877 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:35:04.667877 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:35:04.667877 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:35:04.667877 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 30 00:35:04.667877 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 30 00:35:04.667877 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 30 00:35:04.667877 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 30 00:35:04.668798 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 30 00:35:04.668798 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 30 00:35:04.668798 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 30 00:35:04.668798 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 30 00:35:04.668798 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:35:04.668798 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:35:04.668798 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:35:04.668798 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:35:04.668798 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:35:04.668798 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:35:04.668798 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:35:04.668798 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application with Lock( Oct 30 00:35:04.668798 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:35:04.668798 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:35:04.668798 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:35:04.668798 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:35:04.669559 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:35:04.669559 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:35:04.669559 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:35:04.669559 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:35:04.669559 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 30 00:35:04.669559 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 30 00:35:04.669559 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 30 00:35:04.669559 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 30 00:35:04.669559 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 30 00:35:04.669559 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 30 00:35:04.669559 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 30 00:35:04.669559 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application Oct 30 00:35:04.674313 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 49/98] 10.222.0.42 () {56 vars in 1114 bytes} [Sun Oct 30 00:35:04 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:35:04.675556 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b17c45c-6d49-41f8-be02-9e45daaf8c71 None admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:35:04.800662 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1617cde3-0ce7-4ce8-90de-67edb779362d None admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:35:04.810968 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b17c45c-6d49-41f8-be02-9e45daaf8c71 None admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:35:04.837307 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=100 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:35:04.840587 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3285df3-260d-42a5-a744-136eb01a829c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:35:04.841210 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3285df3-260d-42a5-a744-136eb01a829c None admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:04.841493 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3285df3-260d-42a5-a744-136eb01a829c None admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:04.841774 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3285df3-260d-42a5-a744-136eb01a829c None admin] PATH_INFO: `/v3/roles` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:04.842450 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3285df3-260d-42a5-a744-136eb01a829c None admin] RBAC: Adding query filter params (name=member) {{(pid=87955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:35:04.843056 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3285df3-260d-42a5-a744-136eb01a829c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:35:04.844483 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3285df3-260d-42a5-a744-136eb01a829c None admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:35:04.851246 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6ae6be-4caa-4023-8133-09e8cf1ea67d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:35:04.852063 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6ae6be-4caa-4023-8133-09e8cf1ea67d None admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:04.852485 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6ae6be-4caa-4023-8133-09e8cf1ea67d None admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:04.852980 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6ae6be-4caa-4023-8133-09e8cf1ea67d None admin] PATH_INFO: `/v3/projects/cbc9734c46db44918000791ce8bbb4e8` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:04.853100 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 50/99] 10.222.0.42 () {56 vars in 1101 bytes} [Sun Oct 30 00:35:04 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:35:04.853840 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3285df3-260d-42a5-a744-136eb01a829c None admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:35:04.855994 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6ae6be-4caa-4023-8133-09e8cf1ea67d None admin] RBAC: Authorizing `identity:get_project(project_id=cbc9734c46db44918000791ce8bbb4e8)` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:35:04.857463 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6ae6be-4caa-4023-8133-09e8cf1ea67d None admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:35:04.863786 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 50/100] 10.222.0.42 () {56 vars in 1186 bytes} [Sun Oct 30 00:35:04 2022] GET /identity/v3/projects/cbc9734c46db44918000791ce8bbb4e8 => generated 298 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:35:04.863786 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a536ee66-6a57-4bc3-a4ac-2a6877ae4b3a None None] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:04.863786 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a536ee66-6a57-4bc3-a4ac-2a6877ae4b3a None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:04.863786 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a536ee66-6a57-4bc3-a4ac-2a6877ae4b3a None None] PATH_INFO: `/` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:04.863786 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 51/101] 10.222.0.42 () {54 vars in 927 bytes} [Sun Oct 30 00:35:04 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:35:04.863786 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ec0da1-c4bc-47f5-8e8d-e7a8cec3f759 None None] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:04.864174 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ec0da1-c4bc-47f5-8e8d-e7a8cec3f759 None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:04.864174 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ec0da1-c4bc-47f5-8e8d-e7a8cec3f759 None None] PATH_INFO: `/` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:04.864918 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 52/102] 10.222.0.42 () {54 vars in 927 bytes} [Sun Oct 30 00:35:04 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:35:04.865494 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ec0da1-c4bc-47f5-8e8d-e7a8cec3f759 None None] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:35:04.945523 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=100 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:35:04.986716 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3285df3-260d-42a5-a744-136eb01a829c None admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:35:04.988454 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ec0da1-c4bc-47f5-8e8d-e7a8cec3f759 None None] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:35:05.021023 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2ed8b2-4a5a-4a37-a842-761d44649eca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:35:05.022142 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2ed8b2-4a5a-4a37-a842-761d44649eca None admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:05.022638 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2ed8b2-4a5a-4a37-a842-761d44649eca None admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:05.023097 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2ed8b2-4a5a-4a37-a842-761d44649eca None admin] PATH_INFO: `/v3/roles` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:05.023973 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2ed8b2-4a5a-4a37-a842-761d44649eca None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:35:05.024558 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2ed8b2-4a5a-4a37-a842-761d44649eca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:35:05.024655 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cd01c5-3ba8-4fa0-beaa-501bc79368f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:35:05.025279 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cd01c5-3ba8-4fa0-beaa-501bc79368f6 None admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:05.025563 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cd01c5-3ba8-4fa0-beaa-501bc79368f6 None admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:05.025840 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cd01c5-3ba8-4fa0-beaa-501bc79368f6 None admin] PATH_INFO: `/v3/users/da70f1c161a64061818e8e4c38b75efc` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:05.026862 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2ed8b2-4a5a-4a37-a842-761d44649eca None admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:35:05.027029 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49cd01c5-3ba8-4fa0-beaa-501bc79368f6 None admin] RBAC: Authorizing `identity:get_user(user_id=da70f1c161a64061818e8e4c38b75efc)` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:35:05.028443 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49cd01c5-3ba8-4fa0-beaa-501bc79368f6 None admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:35:05.030211 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 53/103] 10.222.0.42 () {56 vars in 1177 bytes} [Sun Oct 30 00:35:04 2022] GET /identity/v3/users/da70f1c161a64061818e8e4c38b75efc => generated 275 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:35:05.030808 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cd01c5-3ba8-4fa0-beaa-501bc79368f6 None admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:35:05.038204 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 51/104] 10.222.0.42 () {56 vars in 1111 bytes} [Sun Oct 30 00:35:04 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:35:05.039442 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41219d2e-9ebb-4222-9d09-ec91ea9fac0e None None] REQUEST_METHOD: `POST` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:05.039733 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41219d2e-9ebb-4222-9d09-ec91ea9fac0e None None] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:05.040005 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41219d2e-9ebb-4222-9d09-ec91ea9fac0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:05.058805 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.auth.core [None req-41219d2e-9ebb-4222-9d09-ec91ea9fac0e None None] MFA Rules not processed for user `eb55b6cbca4945abb21b0e49eb745e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=87955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:35:05.060052 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-41219d2e-9ebb-4222-9d09-ec91ea9fac0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:35:05.091640 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=100 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:35:05.126803 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 52/105] 10.222.0.42 () {58 vars in 1024 bytes} [Sun Oct 30 00:35:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 30 00:35:05.128361 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bb5ee5-bbba-41f9-9c0d-c2c22ce5e6e4 None None] REQUEST_METHOD: `POST` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:05.128642 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bb5ee5-bbba-41f9-9c0d-c2c22ce5e6e4 None None] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:05.128916 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bb5ee5-bbba-41f9-9c0d-c2c22ce5e6e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:05.142734 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cd01c5-3ba8-4fa0-beaa-501bc79368f6 None admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:35:05.146572 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.auth.core [None req-59bb5ee5-bbba-41f9-9c0d-c2c22ce5e6e4 None None] MFA Rules not processed for user `eb55b6cbca4945abb21b0e49eb745e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=87955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:35:05.147762 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-59bb5ee5-bbba-41f9-9c0d-c2c22ce5e6e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:35:05.178314 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290ad18d-f180-4e94-b206-7d400ebb8f27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:35:05.178951 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290ad18d-f180-4e94-b206-7d400ebb8f27 None admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:05.179252 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290ad18d-f180-4e94-b206-7d400ebb8f27 None admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:05.179524 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290ad18d-f180-4e94-b206-7d400ebb8f27 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:05.180240 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290ad18d-f180-4e94-b206-7d400ebb8f27 None admin] RBAC: Adding query filter params (role.id=6ccaa8c11f29456fb4e4eeccb21616c7, scope.project.id=cbc9734c46db44918000791ce8bbb4e8, user.id=eb55b6cbca4945abb21b0e49eb745e1c) {{(pid=87956) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:35:05.180624 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290ad18d-f180-4e94-b206-7d400ebb8f27 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:35:05.182066 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290ad18d-f180-4e94-b206-7d400ebb8f27 None admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:35:05.188729 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 54/106] 10.222.0.42 () {56 vars in 1374 bytes} [Sun Oct 30 00:35:05 2022] GET /identity/v3/role_assignments?user.id=eb55b6cbca4945abb21b0e49eb745e1c&scope.project.id=cbc9734c46db44918000791ce8bbb4e8&role.id=6ccaa8c11f29456fb4e4eeccb21616c7 => generated 608 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:35:05.190512 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6975c575-ce67-4325-8d40-157d87b54c74 None None] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:05.190998 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6975c575-ce67-4325-8d40-157d87b54c74 None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:05.191814 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6975c575-ce67-4325-8d40-157d87b54c74 None None] PATH_INFO: `/` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:05.198423 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 55/107] 10.222.0.42 () {54 vars in 927 bytes} [Sun Oct 30 00:35:05 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:35:05.198423 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6975c575-ce67-4325-8d40-157d87b54c74 None None] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:35:05.214976 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=100 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:35:05.223839 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 53/108] 10.222.0.42 () {58 vars in 1024 bytes} [Sun Oct 30 00:35:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 30 00:35:05.224568 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bb5ee5-bbba-41f9-9c0d-c2c22ce5e6e4 None None] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:35:05.345246 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6975c575-ce67-4325-8d40-157d87b54c74 None None] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:35:05.386138 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bb5ee5-bbba-41f9-9c0d-c2c22ce5e6e4 None None] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:35:05.407602 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=100 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:35:05.416935 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16539a52-3ccc-471b-8786-eb7820fd7baf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:35:05.417665 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16539a52-3ccc-471b-8786-eb7820fd7baf None admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:05.417945 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16539a52-3ccc-471b-8786-eb7820fd7baf None admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:05.418211 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16539a52-3ccc-471b-8786-eb7820fd7baf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:05.423377 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2e68dc-19c7-4538-889f-f49d17e56a2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:35:05.424256 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2e68dc-19c7-4538-889f-f49d17e56a2a None admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:05.424726 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2e68dc-19c7-4538-889f-f49d17e56a2a None admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:05.425001 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2e68dc-19c7-4538-889f-f49d17e56a2a None admin] PATH_INFO: `/v3/users/da70f1c161a64061818e8e4c38b75efc` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:05.426169 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2e68dc-19c7-4538-889f-f49d17e56a2a None admin] RBAC: Authorizing `identity:get_user(user_id=da70f1c161a64061818e8e4c38b75efc)` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:35:05.427987 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2e68dc-19c7-4538-889f-f49d17e56a2a None admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:35:05.429525 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 54/109] 10.222.0.42 () {56 vars in 1177 bytes} [Sun Oct 30 00:35:05 2022] GET /identity/v3/users/da70f1c161a64061818e8e4c38b75efc => generated 275 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:35:05.430509 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9d3101-2b2f-45d8-83de-bdbbbf8278de None None] REQUEST_METHOD: `POST` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:05.430788 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9d3101-2b2f-45d8-83de-bdbbbf8278de None None] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:05.431060 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9d3101-2b2f-45d8-83de-bdbbbf8278de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:05.453823 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.auth.core [None req-0e9d3101-2b2f-45d8-83de-bdbbbf8278de None None] MFA Rules not processed for user `eb55b6cbca4945abb21b0e49eb745e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=87955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:35:05.455325 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-0e9d3101-2b2f-45d8-83de-bdbbbf8278de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:35:05.495325 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16539a52-3ccc-471b-8786-eb7820fd7baf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:35:05.496789 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16539a52-3ccc-471b-8786-eb7820fd7baf None admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:35:05.508532 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=100 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:35:05.526051 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 55/110] 10.222.0.42 () {58 vars in 1024 bytes} [Sun Oct 30 00:35:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 30 00:35:05.527119 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9d3101-2b2f-45d8-83de-bdbbbf8278de None None] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:35:05.611506 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 56/111] 10.222.0.42 () {58 vars in 1282 bytes} [Sun Oct 30 00:35:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 30 00:35:05.612281 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16539a52-3ccc-471b-8786-eb7820fd7baf None admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:35:05.636266 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9d3101-2b2f-45d8-83de-bdbbbf8278de None None] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:35:05.637216 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=100 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:35:05.671468 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6025076-f069-4dda-a986-9379c6618ccc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:35:05.672561 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6025076-f069-4dda-a986-9379c6618ccc None admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:05.672986 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6025076-f069-4dda-a986-9379c6618ccc None admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:05.673257 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6025076-f069-4dda-a986-9379c6618ccc None admin] PATH_INFO: `/v3/roles/member` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:05.683417 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6025076-f069-4dda-a986-9379c6618ccc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 30 00:35:05.688212 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application [None req-a6025076-f069-4dda-a986-9379c6618ccc None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 30 00:35:05.688212 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:35:05.688212 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:35:05.688212 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:35:05.688212 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:35:05.688212 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:35:05.688212 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:35:05.688212 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:35:05.688212 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:35:05.688212 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:35:05.688212 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:35:05.688212 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:35:05.688212 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 30 00:35:05.688212 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 30 00:35:05.688212 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 30 00:35:05.688212 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 30 00:35:05.689229 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 30 00:35:05.689229 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 30 00:35:05.689229 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 30 00:35:05.689229 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 30 00:35:05.689229 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:35:05.689229 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:35:05.689229 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:35:05.689229 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:35:05.689229 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:35:05.689229 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:35:05.689229 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:35:05.689229 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application with Lock( Oct 30 00:35:05.689229 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:35:05.689229 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:35:05.689229 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:35:05.689229 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:35:05.690183 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:35:05.690183 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:35:05.690183 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:35:05.690183 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:35:05.690183 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 30 00:35:05.690183 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 30 00:35:05.690183 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 30 00:35:05.690183 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 30 00:35:05.690183 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 30 00:35:05.690183 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 30 00:35:05.690183 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 30 00:35:05.690183 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application Oct 30 00:35:05.690183 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 56/112] 10.222.0.42 () {56 vars in 1099 bytes} [Sun Oct 30 00:35:05 2022] GET /identity/v3/roles/member => generated 84 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:35:05.690183 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6025076-f069-4dda-a986-9379c6618ccc None admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:35:05.719522 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16539a52-3ccc-471b-8786-eb7820fd7baf None admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:35:05.740804 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=100 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:35:05.757911 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e325c1-2b61-4b9b-81ce-fb125e3878e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:35:05.758547 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e325c1-2b61-4b9b-81ce-fb125e3878e2 None admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:05.758861 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e325c1-2b61-4b9b-81ce-fb125e3878e2 None admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:05.759147 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e325c1-2b61-4b9b-81ce-fb125e3878e2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:05.800356 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6025076-f069-4dda-a986-9379c6618ccc None admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:35:05.826630 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e325c1-2b61-4b9b-81ce-fb125e3878e2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:35:05.828112 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e325c1-2b61-4b9b-81ce-fb125e3878e2 None admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:35:05.834275 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13bbb8c-695f-4be8-ae4d-28463b748bc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:35:05.834904 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13bbb8c-695f-4be8-ae4d-28463b748bc2 None admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:05.835180 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13bbb8c-695f-4be8-ae4d-28463b748bc2 None admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:05.835908 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13bbb8c-695f-4be8-ae4d-28463b748bc2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:05.837054 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13bbb8c-695f-4be8-ae4d-28463b748bc2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:35:05.838512 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13bbb8c-695f-4be8-ae4d-28463b748bc2 None admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:35:05.840123 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 57/113] 10.222.0.42 () {56 vars in 1108 bytes} [Sun Oct 30 00:35:05 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:35:05.840876 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13bbb8c-695f-4be8-ae4d-28463b748bc2 None admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:35:05.854893 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=100 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:35:05.928615 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 57/114] 10.222.0.42 () {58 vars in 1282 bytes} [Sun Oct 30 00:35:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 30 00:35:05.929420 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e325c1-2b61-4b9b-81ce-fb125e3878e2 None admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:35:05.940782 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13bbb8c-695f-4be8-ae4d-28463b748bc2 None admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:35:05.954156 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=100 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:35:05.975497 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aaf7ba1-e156-44e0-9e25-91b27504c9c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:35:05.976131 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aaf7ba1-e156-44e0-9e25-91b27504c9c6 None admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:05.976441 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aaf7ba1-e156-44e0-9e25-91b27504c9c6 None admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:05.976722 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aaf7ba1-e156-44e0-9e25-91b27504c9c6 None admin] PATH_INFO: `/v3/projects/cbc9734c46db44918000791ce8bbb4e8` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:05.977897 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aaf7ba1-e156-44e0-9e25-91b27504c9c6 None admin] RBAC: Authorizing `identity:get_project(project_id=cbc9734c46db44918000791ce8bbb4e8)` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:35:05.979361 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aaf7ba1-e156-44e0-9e25-91b27504c9c6 None admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:35:05.980999 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 58/115] 10.222.0.42 () {56 vars in 1186 bytes} [Sun Oct 30 00:35:05 2022] GET /identity/v3/projects/cbc9734c46db44918000791ce8bbb4e8 => generated 298 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:35:05.981760 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aaf7ba1-e156-44e0-9e25-91b27504c9c6 None admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:35:06.030450 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e325c1-2b61-4b9b-81ce-fb125e3878e2 None admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:35:06.053066 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=100 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:35:06.065235 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f26123-fcb5-416c-b44c-26ab614c30d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:35:06.065859 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f26123-fcb5-416c-b44c-26ab614c30d0 None admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:06.066144 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f26123-fcb5-416c-b44c-26ab614c30d0 None admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:06.066419 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f26123-fcb5-416c-b44c-26ab614c30d0 None admin] PATH_INFO: `/v3/roles` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:06.067093 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f26123-fcb5-416c-b44c-26ab614c30d0 None admin] RBAC: Adding query filter params (name=member) {{(pid=87956) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:35:06.067427 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f26123-fcb5-416c-b44c-26ab614c30d0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:35:06.068818 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f26123-fcb5-416c-b44c-26ab614c30d0 None admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:35:06.077041 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 58/116] 10.222.0.42 () {56 vars in 1101 bytes} [Sun Oct 30 00:35:05 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:35:06.078082 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aaf7ba1-e156-44e0-9e25-91b27504c9c6 None admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:35:06.081010 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f26123-fcb5-416c-b44c-26ab614c30d0 None admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:35:06.112613 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d7b0fa-7e34-4a4b-8b3c-e4ad26bfe9d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:35:06.113237 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d7b0fa-7e34-4a4b-8b3c-e4ad26bfe9d3 None admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:06.113514 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d7b0fa-7e34-4a4b-8b3c-e4ad26bfe9d3 None admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:06.113785 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d7b0fa-7e34-4a4b-8b3c-e4ad26bfe9d3 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:06.124134 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d7b0fa-7e34-4a4b-8b3c-e4ad26bfe9d3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 30 00:35:06.129000 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application [None req-51d7b0fa-7e34-4a4b-8b3c-e4ad26bfe9d3 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 30 00:35:06.129000 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:35:06.129000 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:35:06.129000 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:35:06.129000 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:35:06.129000 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:35:06.129000 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:35:06.129000 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:35:06.129000 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:35:06.129000 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:35:06.129000 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:35:06.129000 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:35:06.129000 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 30 00:35:06.129000 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 30 00:35:06.129000 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 30 00:35:06.129000 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 30 00:35:06.129934 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 30 00:35:06.129934 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 30 00:35:06.129934 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 30 00:35:06.129934 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 30 00:35:06.129934 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:35:06.129934 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:35:06.129934 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:35:06.129934 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:35:06.129934 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:35:06.129934 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:35:06.129934 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:35:06.129934 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application with Lock( Oct 30 00:35:06.129934 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:35:06.129934 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:35:06.129934 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:35:06.129934 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:35:06.130664 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:35:06.130664 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:35:06.130664 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:35:06.130664 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:35:06.130664 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 30 00:35:06.130664 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 30 00:35:06.130664 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 30 00:35:06.130664 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 30 00:35:06.130664 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 30 00:35:06.130664 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 30 00:35:06.130664 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 30 00:35:06.130664 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application Oct 30 00:35:06.130664 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 59/117] 10.222.0.42 () {56 vars in 1099 bytes} [Sun Oct 30 00:35:05 2022] GET /identity/v3/roles/reader => generated 84 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:35:06.131322 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d7b0fa-7e34-4a4b-8b3c-e4ad26bfe9d3 None admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:35:06.172685 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=100 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:35:06.181134 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f26123-fcb5-416c-b44c-26ab614c30d0 None admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:35:06.213071 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b108e7af-64f8-4bf3-9ea8-6f9a307d9fae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:35:06.213680 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b108e7af-64f8-4bf3-9ea8-6f9a307d9fae None admin] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:06.213955 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b108e7af-64f8-4bf3-9ea8-6f9a307d9fae None admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:06.214229 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b108e7af-64f8-4bf3-9ea8-6f9a307d9fae None admin] PATH_INFO: `/v3/projects` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:06.214879 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b108e7af-64f8-4bf3-9ea8-6f9a307d9fae None admin] RBAC: Authorizing `identity:create_project()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:35:06.216359 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b108e7af-64f8-4bf3-9ea8-6f9a307d9fae None admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:35:06.228533 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d7b0fa-7e34-4a4b-8b3c-e4ad26bfe9d3 None admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:35:06.244587 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 59/118] 10.222.0.42 () {60 vars in 1141 bytes} [Sun Oct 30 00:35:06 2022] POST /identity/v3/projects => generated 302 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 00:35:06.245415 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b108e7af-64f8-4bf3-9ea8-6f9a307d9fae None admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:35:06.270534 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62a6ee8-99bf-4123-8d8d-f763bf4ddc4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:35:06.271329 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62a6ee8-99bf-4123-8d8d-f763bf4ddc4e None admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:06.271613 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62a6ee8-99bf-4123-8d8d-f763bf4ddc4e None admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:06.271904 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62a6ee8-99bf-4123-8d8d-f763bf4ddc4e None admin] PATH_INFO: `/v3/projects/cbc9734c46db44918000791ce8bbb4e8` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:06.273117 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62a6ee8-99bf-4123-8d8d-f763bf4ddc4e None admin] RBAC: Authorizing `identity:get_project(project_id=cbc9734c46db44918000791ce8bbb4e8)` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:35:06.274714 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62a6ee8-99bf-4123-8d8d-f763bf4ddc4e None admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:35:06.276798 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 60/119] 10.222.0.42 () {56 vars in 1186 bytes} [Sun Oct 30 00:35:06 2022] GET /identity/v3/projects/cbc9734c46db44918000791ce8bbb4e8 => generated 298 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:35:06.277502 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62a6ee8-99bf-4123-8d8d-f763bf4ddc4e None admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:35:06.293917 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:35:06.358479 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b108e7af-64f8-4bf3-9ea8-6f9a307d9fae None admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:35:06.390263 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62a6ee8-99bf-4123-8d8d-f763bf4ddc4e None admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:35:06.393552 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151cb0b1-680c-4642-80b1-074f52d5d6d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:35:06.394185 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151cb0b1-680c-4642-80b1-074f52d5d6d7 None admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:06.394463 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151cb0b1-680c-4642-80b1-074f52d5d6d7 None admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:06.394736 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151cb0b1-680c-4642-80b1-074f52d5d6d7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:06.395519 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151cb0b1-680c-4642-80b1-074f52d5d6d7 None admin] RBAC: Adding query filter params (role.id=1c93019874174c4b91118d9ce2347e47, scope.project.id=cbc9734c46db44918000791ce8bbb4e8, user.id=da70f1c161a64061818e8e4c38b75efc) {{(pid=87956) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:35:06.395831 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151cb0b1-680c-4642-80b1-074f52d5d6d7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:35:06.397299 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151cb0b1-680c-4642-80b1-074f52d5d6d7 None admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:35:06.400836 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=100 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:35:06.404714 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 60/120] 10.222.0.42 () {56 vars in 1374 bytes} [Sun Oct 30 00:35:06 2022] GET /identity/v3/role_assignments?user.id=da70f1c161a64061818e8e4c38b75efc&scope.project.id=cbc9734c46db44918000791ce8bbb4e8&role.id=1c93019874174c4b91118d9ce2347e47 => generated 608 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:35:06.404714 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151cb0b1-680c-4642-80b1-074f52d5d6d7 None admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:35:06.445142 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc0ffa6-5ec0-4502-a4cf-194e13e9385c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:35:06.446313 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc0ffa6-5ec0-4502-a4cf-194e13e9385c None admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:06.446809 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc0ffa6-5ec0-4502-a4cf-194e13e9385c None admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:06.447694 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc0ffa6-5ec0-4502-a4cf-194e13e9385c None admin] PATH_INFO: `/v3/users/da70f1c161a64061818e8e4c38b75efc` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:06.449518 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc0ffa6-5ec0-4502-a4cf-194e13e9385c None admin] RBAC: Authorizing `identity:get_user(user_id=da70f1c161a64061818e8e4c38b75efc)` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:35:06.451168 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc0ffa6-5ec0-4502-a4cf-194e13e9385c None admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:35:06.453061 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 61/121] 10.222.0.42 () {56 vars in 1177 bytes} [Sun Oct 30 00:35:06 2022] GET /identity/v3/users/da70f1c161a64061818e8e4c38b75efc => generated 275 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:35:06.453991 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc0ffa6-5ec0-4502-a4cf-194e13e9385c None admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:35:06.539974 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151cb0b1-680c-4642-80b1-074f52d5d6d7 None admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:35:06.541725 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=100 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:35:06.578662 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78b5973-284f-4807-8703-6e0d0b489c3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:35:06.579332 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78b5973-284f-4807-8703-6e0d0b489c3d None admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:06.579774 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78b5973-284f-4807-8703-6e0d0b489c3d None admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:06.580065 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78b5973-284f-4807-8703-6e0d0b489c3d None admin] PATH_INFO: `/v3/roles` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:06.581201 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78b5973-284f-4807-8703-6e0d0b489c3d None admin] RBAC: Adding query filter params (name=reader) {{(pid=87956) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:35:06.581652 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78b5973-284f-4807-8703-6e0d0b489c3d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:35:06.583081 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78b5973-284f-4807-8703-6e0d0b489c3d None admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:35:06.583412 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc0ffa6-5ec0-4502-a4cf-194e13e9385c None admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:35:06.594568 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 61/122] 10.222.0.42 () {56 vars in 1101 bytes} [Sun Oct 30 00:35:06 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:35:06.595298 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78b5973-284f-4807-8703-6e0d0b489c3d None admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:35:06.623823 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b0afee-71bb-4340-823f-d38fb90b9a74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:35:06.624448 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b0afee-71bb-4340-823f-d38fb90b9a74 None admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:06.624729 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b0afee-71bb-4340-823f-d38fb90b9a74 None admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:06.625003 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b0afee-71bb-4340-823f-d38fb90b9a74 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:06.625735 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b0afee-71bb-4340-823f-d38fb90b9a74 None admin] RBAC: Adding query filter params (role.id=7f42beaeb9e84fd8961e2fa0ae82d034, scope.project.id=cbc9734c46db44918000791ce8bbb4e8, user.id=da70f1c161a64061818e8e4c38b75efc) {{(pid=87955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:35:06.626036 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b0afee-71bb-4340-823f-d38fb90b9a74 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:35:06.628598 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b0afee-71bb-4340-823f-d38fb90b9a74 None admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:35:06.638202 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 62/123] 10.222.0.42 () {56 vars in 1374 bytes} [Sun Oct 30 00:35:06 2022] GET /identity/v3/role_assignments?user.id=da70f1c161a64061818e8e4c38b75efc&scope.project.id=cbc9734c46db44918000791ce8bbb4e8&role.id=7f42beaeb9e84fd8961e2fa0ae82d034 => generated 608 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:35:06.644241 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b0afee-71bb-4340-823f-d38fb90b9a74 None admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:35:06.704282 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=100 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:35:06.709867 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78b5973-284f-4807-8703-6e0d0b489c3d None admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:35:06.749818 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003c1a2d-a281-4c33-90ff-35cdbdf42fb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:35:06.750790 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003c1a2d-a281-4c33-90ff-35cdbdf42fb7 None admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:06.751272 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003c1a2d-a281-4c33-90ff-35cdbdf42fb7 None admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:06.751713 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003c1a2d-a281-4c33-90ff-35cdbdf42fb7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:06.777486 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b0afee-71bb-4340-823f-d38fb90b9a74 None admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:35:06.786415 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=100 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:35:06.816554 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106d80ea-9b70-4def-8032-261ea192857c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:35:06.817340 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106d80ea-9b70-4def-8032-261ea192857c None admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:06.817931 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106d80ea-9b70-4def-8032-261ea192857c None admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:06.818285 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106d80ea-9b70-4def-8032-261ea192857c None admin] PATH_INFO: `/v3/users/fc82d28a26eb41a784999dacd8a2b33c` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:06.830813 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003c1a2d-a281-4c33-90ff-35cdbdf42fb7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:35:06.832995 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003c1a2d-a281-4c33-90ff-35cdbdf42fb7 None admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:35:06.834555 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106d80ea-9b70-4def-8032-261ea192857c None admin] RBAC: Authorizing `identity:get_user(user_id=fc82d28a26eb41a784999dacd8a2b33c)` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:35:06.837355 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106d80ea-9b70-4def-8032-261ea192857c None admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:35:06.839259 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 63/124] 10.222.0.42 () {56 vars in 1177 bytes} [Sun Oct 30 00:35:06 2022] GET /identity/v3/users/fc82d28a26eb41a784999dacd8a2b33c => generated 289 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:35:06.848229 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106d80ea-9b70-4def-8032-261ea192857c None admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:35:06.963740 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 62/125] 10.222.0.42 () {58 vars in 1282 bytes} [Sun Oct 30 00:35:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 30 00:35:06.969407 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003c1a2d-a281-4c33-90ff-35cdbdf42fb7 None admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:35:06.974002 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=100 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:35:06.978690 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106d80ea-9b70-4def-8032-261ea192857c None admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:35:07.017580 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25227cee-96df-4cbd-a93c-07730bc4fad0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:35:07.018338 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25227cee-96df-4cbd-a93c-07730bc4fad0 None admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:07.018618 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25227cee-96df-4cbd-a93c-07730bc4fad0 None admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:07.018890 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25227cee-96df-4cbd-a93c-07730bc4fad0 None admin] PATH_INFO: `/v3/projects/cbc9734c46db44918000791ce8bbb4e8` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:07.020097 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25227cee-96df-4cbd-a93c-07730bc4fad0 None admin] RBAC: Authorizing `identity:get_project(project_id=cbc9734c46db44918000791ce8bbb4e8)` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:35:07.021551 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25227cee-96df-4cbd-a93c-07730bc4fad0 None admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:35:07.023518 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 64/126] 10.222.0.42 () {56 vars in 1186 bytes} [Sun Oct 30 00:35:06 2022] GET /identity/v3/projects/cbc9734c46db44918000791ce8bbb4e8 => generated 298 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:35:07.028971 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25227cee-96df-4cbd-a93c-07730bc4fad0 None admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:35:07.033364 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=100 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:35:07.077034 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003c1a2d-a281-4c33-90ff-35cdbdf42fb7 None admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:35:07.115825 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdd1649-802d-4b3d-8495-4896f7c41177 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:35:07.116470 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdd1649-802d-4b3d-8495-4896f7c41177 None admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:07.116762 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdd1649-802d-4b3d-8495-4896f7c41177 None admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:07.117038 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdd1649-802d-4b3d-8495-4896f7c41177 None admin] PATH_INFO: `/v3/projects/83cdf66c40584b3fbfa7a4ce60b58017` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:07.118216 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fdd1649-802d-4b3d-8495-4896f7c41177 None admin] RBAC: Authorizing `identity:get_project(project_id=83cdf66c40584b3fbfa7a4ce60b58017)` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:35:07.122261 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fdd1649-802d-4b3d-8495-4896f7c41177 None admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:35:07.125214 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 63/127] 10.222.0.42 () {56 vars in 1186 bytes} [Sun Oct 30 00:35:06 2022] GET /identity/v3/projects/83cdf66c40584b3fbfa7a4ce60b58017 => generated 312 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 30 00:35:07.130937 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdd1649-802d-4b3d-8495-4896f7c41177 None admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:35:07.137346 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25227cee-96df-4cbd-a93c-07730bc4fad0 None admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:35:07.173833 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c082478c-2235-45fa-a77a-5f7c324c1ccf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:35:07.174853 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c082478c-2235-45fa-a77a-5f7c324c1ccf None admin] REQUEST_METHOD: `PUT` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:07.175220 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c082478c-2235-45fa-a77a-5f7c324c1ccf None admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:07.175498 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c082478c-2235-45fa-a77a-5f7c324c1ccf None admin] PATH_INFO: `/v3/projects/cbc9734c46db44918000791ce8bbb4e8/users/fc82d28a26eb41a784999dacd8a2b33c/roles/992ffb31c434469696dce212bcf0cebc` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:07.177408 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c082478c-2235-45fa-a77a-5f7c324c1ccf None admin] RBAC: Authorizing `identity:create_grant(project_id=cbc9734c46db44918000791ce8bbb4e8, user_id=fc82d28a26eb41a784999dacd8a2b33c, role_id=992ffb31c434469696dce212bcf0cebc)` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:35:07.178867 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c082478c-2235-45fa-a77a-5f7c324c1ccf None admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:35:07.207232 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 65/128] 10.222.0.42 () {58 vars in 1439 bytes} [Sun Oct 30 00:35:07 2022] PUT /identity/v3/projects/cbc9734c46db44918000791ce8bbb4e8/users/fc82d28a26eb41a784999dacd8a2b33c/roles/992ffb31c434469696dce212bcf0cebc => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 00:35:07.250837 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdd1649-802d-4b3d-8495-4896f7c41177 None admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:35:07.285161 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=100 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:35:07.291384 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4966aef-7e4e-4427-bda8-2d60c24b3c92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:35:07.292341 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4966aef-7e4e-4427-bda8-2d60c24b3c92 None admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:07.292622 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4966aef-7e4e-4427-bda8-2d60c24b3c92 None admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:07.292893 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4966aef-7e4e-4427-bda8-2d60c24b3c92 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:07.293642 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4966aef-7e4e-4427-bda8-2d60c24b3c92 None admin] RBAC: Adding query filter params (role.id=1c93019874174c4b91118d9ce2347e47, scope.project.id=83cdf66c40584b3fbfa7a4ce60b58017, user.id=da70f1c161a64061818e8e4c38b75efc) {{(pid=87956) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:35:07.293951 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4966aef-7e4e-4427-bda8-2d60c24b3c92 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:35:07.295461 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4966aef-7e4e-4427-bda8-2d60c24b3c92 None admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:35:07.302295 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 64/129] 10.222.0.42 () {56 vars in 1374 bytes} [Sun Oct 30 00:35:07 2022] GET /identity/v3/role_assignments?user.id=da70f1c161a64061818e8e4c38b75efc&scope.project.id=83cdf66c40584b3fbfa7a4ce60b58017&role.id=1c93019874174c4b91118d9ce2347e47 => generated 608 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 30 00:35:08.505073 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199b3a5c-f6fe-49d9-9f97-9a559248dd33 None None] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:08.505585 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199b3a5c-f6fe-49d9-9f97-9a559248dd33 None None] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:08.505585 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199b3a5c-f6fe-49d9-9f97-9a559248dd33 None None] PATH_INFO: `/` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:08.506873 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 66/130] 10.222.0.42 () {54 vars in 927 bytes} [Sun Oct 30 00:35:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:35:08.512725 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096de809-d823-4216-b665-dd3055750907 None None] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:08.513147 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096de809-d823-4216-b665-dd3055750907 None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:08.513398 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096de809-d823-4216-b665-dd3055750907 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:08.532318 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.auth.core [None req-096de809-d823-4216-b665-dd3055750907 None None] MFA Rules not processed for user `eb55b6cbca4945abb21b0e49eb745e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=87956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:35:08.533510 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-096de809-d823-4216-b665-dd3055750907 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:35:08.602882 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 65/131] 10.222.0.42 () {58 vars in 1024 bytes} [Sun Oct 30 00:35:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 30 00:35:08.864376 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199b3a5c-f6fe-49d9-9f97-9a559248dd33 None None] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:35:08.892406 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:35:08.968605 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199b3a5c-f6fe-49d9-9f97-9a559248dd33 None None] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:35:09.004210 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5703bfca-2aba-4d55-a22c-c2623a65ddcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:35:09.004844 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5703bfca-2aba-4d55-a22c-c2623a65ddcc None admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:09.005120 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5703bfca-2aba-4d55-a22c-c2623a65ddcc None admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:09.005390 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5703bfca-2aba-4d55-a22c-c2623a65ddcc None admin] PATH_INFO: `/v3/domains/default` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:09.006530 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5703bfca-2aba-4d55-a22c-c2623a65ddcc None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:35:09.008006 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5703bfca-2aba-4d55-a22c-c2623a65ddcc None admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:35:09.009570 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 67/132] 10.222.0.42 () {56 vars in 1108 bytes} [Sun Oct 30 00:35:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:35:09.015350 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096de809-d823-4216-b665-dd3055750907 None None] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:35:09.113406 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096de809-d823-4216-b665-dd3055750907 None None] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:35:09.138609 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=100 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:35:09.147249 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9e567d-19cd-40b3-b366-545f61189910 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:35:09.147881 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9e567d-19cd-40b3-b366-545f61189910 None admin] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:09.148149 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9e567d-19cd-40b3-b366-545f61189910 None admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:09.148422 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9e567d-19cd-40b3-b366-545f61189910 None admin] PATH_INFO: `/v3/users` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:09.149079 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9e567d-19cd-40b3-b366-545f61189910 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:35:09.150522 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9e567d-19cd-40b3-b366-545f61189910 None admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:35:09.172654 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 66/133] 10.222.0.42 () {60 vars in 1132 bytes} [Sun Oct 30 00:35:09 2022] POST /identity/v3/users => generated 283 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 00:35:09.330650 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924d213e-6dc6-4d64-8533-221dcaf3ae30 None None] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:09.330892 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924d213e-6dc6-4d64-8533-221dcaf3ae30 None None] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:09.331191 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924d213e-6dc6-4d64-8533-221dcaf3ae30 None None] PATH_INFO: `/` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:09.332578 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 68/134] 10.222.0.42 () {54 vars in 927 bytes} [Sun Oct 30 00:35:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:35:09.338329 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603930c9-022d-4e32-b4f3-3f903e2c9b6f None None] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:09.338624 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603930c9-022d-4e32-b4f3-3f903e2c9b6f None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:09.338901 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603930c9-022d-4e32-b4f3-3f903e2c9b6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:09.360063 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.auth.core [None req-603930c9-022d-4e32-b4f3-3f903e2c9b6f None None] MFA Rules not processed for user `eb55b6cbca4945abb21b0e49eb745e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=87956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:35:09.361267 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-603930c9-022d-4e32-b4f3-3f903e2c9b6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:35:09.430295 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 67/135] 10.222.0.42 () {58 vars in 1024 bytes} [Sun Oct 30 00:35:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 30 00:35:09.694143 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924d213e-6dc6-4d64-8533-221dcaf3ae30 None None] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:35:09.791634 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=100 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:35:09.799656 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924d213e-6dc6-4d64-8533-221dcaf3ae30 None None] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:35:09.834482 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb7b120-94e5-4ef8-a58d-b0b3402adce5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:35:09.837015 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb7b120-94e5-4ef8-a58d-b0b3402adce5 None admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:09.837314 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb7b120-94e5-4ef8-a58d-b0b3402adce5 None admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:09.837573 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb7b120-94e5-4ef8-a58d-b0b3402adce5 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:09.848615 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb7b120-94e5-4ef8-a58d-b0b3402adce5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 30 00:35:09.853502 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application [None req-afb7b120-94e5-4ef8-a58d-b0b3402adce5 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 30 00:35:09.853502 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:35:09.853502 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:35:09.853502 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:35:09.853502 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:35:09.853502 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:35:09.853502 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:35:09.853502 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:35:09.853502 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:35:09.853502 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:35:09.853502 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:35:09.853502 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:35:09.853502 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 30 00:35:09.853502 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 30 00:35:09.853502 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 30 00:35:09.853502 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 30 00:35:09.854434 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 30 00:35:09.854434 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 30 00:35:09.854434 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 30 00:35:09.854434 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 30 00:35:09.854434 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:35:09.854434 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:35:09.854434 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:35:09.854434 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:35:09.854434 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:35:09.854434 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:35:09.854434 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:35:09.854434 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application with Lock( Oct 30 00:35:09.854434 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:35:09.854434 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:35:09.854434 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:35:09.854434 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:35:09.855363 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:35:09.855363 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:35:09.855363 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:35:09.855363 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:35:09.855363 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 30 00:35:09.855363 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 30 00:35:09.855363 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 30 00:35:09.855363 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 30 00:35:09.855363 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 30 00:35:09.855363 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 30 00:35:09.855363 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 30 00:35:09.855363 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application Oct 30 00:35:09.855363 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 69/136] 10.222.0.42 () {56 vars in 1099 bytes} [Sun Oct 30 00:35:09 2022] GET /identity/v3/roles/reader => generated 84 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:35:09.862161 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603930c9-022d-4e32-b4f3-3f903e2c9b6f None None] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:35:09.962590 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603930c9-022d-4e32-b4f3-3f903e2c9b6f None None] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:35:09.976561 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:35:09.999266 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560bc1a3-1c05-4621-ab44-a17a9ff57471 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:35:09.999896 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560bc1a3-1c05-4621-ab44-a17a9ff57471 None admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:10.000177 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560bc1a3-1c05-4621-ab44-a17a9ff57471 None admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:10.000451 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560bc1a3-1c05-4621-ab44-a17a9ff57471 None admin] PATH_INFO: `/v3/roles` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:10.001132 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560bc1a3-1c05-4621-ab44-a17a9ff57471 None admin] RBAC: Adding query filter params (name=reader) {{(pid=87956) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:35:10.001435 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560bc1a3-1c05-4621-ab44-a17a9ff57471 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:35:10.002818 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560bc1a3-1c05-4621-ab44-a17a9ff57471 None admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:35:10.011560 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 68/137] 10.222.0.42 () {56 vars in 1101 bytes} [Sun Oct 30 00:35:09 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:35:10.017330 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb7b120-94e5-4ef8-a58d-b0b3402adce5 None admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:35:10.120352 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb7b120-94e5-4ef8-a58d-b0b3402adce5 None admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:35:10.156813 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08ed044-ac80-41bd-953e-3989ba20b0c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:35:10.157477 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08ed044-ac80-41bd-953e-3989ba20b0c0 None admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:10.157756 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08ed044-ac80-41bd-953e-3989ba20b0c0 None admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:10.158029 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08ed044-ac80-41bd-953e-3989ba20b0c0 None admin] PATH_INFO: `/v3/users/fc82d28a26eb41a784999dacd8a2b33c` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:10.159244 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08ed044-ac80-41bd-953e-3989ba20b0c0 None admin] RBAC: Authorizing `identity:get_user(user_id=fc82d28a26eb41a784999dacd8a2b33c)` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:35:10.160731 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08ed044-ac80-41bd-953e-3989ba20b0c0 None admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:35:10.162348 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 70/138] 10.222.0.42 () {56 vars in 1177 bytes} [Sun Oct 30 00:35:10 2022] GET /identity/v3/users/fc82d28a26eb41a784999dacd8a2b33c => generated 289 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:35:10.168325 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560bc1a3-1c05-4621-ab44-a17a9ff57471 None admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:35:10.268124 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560bc1a3-1c05-4621-ab44-a17a9ff57471 None admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:35:10.302377 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c5c594-4710-4207-84f7-efaae853ff59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:35:10.302998 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c5c594-4710-4207-84f7-efaae853ff59 None admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:10.303363 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c5c594-4710-4207-84f7-efaae853ff59 None admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:10.303641 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c5c594-4710-4207-84f7-efaae853ff59 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:10.351505 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=100 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:35:10.379292 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c5c594-4710-4207-84f7-efaae853ff59 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:35:10.380910 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c5c594-4710-4207-84f7-efaae853ff59 None admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:35:10.487134 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 69/139] 10.222.0.42 () {58 vars in 1282 bytes} [Sun Oct 30 00:35:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 30 00:35:10.488589 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08ed044-ac80-41bd-953e-3989ba20b0c0 None admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:35:10.513900 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=100 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:35:10.590932 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08ed044-ac80-41bd-953e-3989ba20b0c0 None admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:35:10.625053 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc20094-8ba4-4be4-b9c6-5410685146ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:35:10.625683 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc20094-8ba4-4be4-b9c6-5410685146ae None admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:10.625962 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc20094-8ba4-4be4-b9c6-5410685146ae None admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:10.626236 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc20094-8ba4-4be4-b9c6-5410685146ae None admin] PATH_INFO: `/v3/projects/cbc9734c46db44918000791ce8bbb4e8` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:10.627389 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc20094-8ba4-4be4-b9c6-5410685146ae None admin] RBAC: Authorizing `identity:get_project(project_id=cbc9734c46db44918000791ce8bbb4e8)` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:35:10.628823 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc20094-8ba4-4be4-b9c6-5410685146ae None admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:35:10.630639 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 71/140] 10.222.0.42 () {56 vars in 1186 bytes} [Sun Oct 30 00:35:10 2022] GET /identity/v3/projects/cbc9734c46db44918000791ce8bbb4e8 => generated 298 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:35:10.636769 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c5c594-4710-4207-84f7-efaae853ff59 None admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:35:10.715998 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=100 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:35:10.740642 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c5c594-4710-4207-84f7-efaae853ff59 None admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:35:10.774105 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9615dc-8443-447a-946f-576bcc027b39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:35:10.774720 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9615dc-8443-447a-946f-576bcc027b39 None admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:10.774997 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9615dc-8443-447a-946f-576bcc027b39 None admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:10.775292 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9615dc-8443-447a-946f-576bcc027b39 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:10.776021 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9615dc-8443-447a-946f-576bcc027b39 None admin] RBAC: Adding query filter params (role.id=992ffb31c434469696dce212bcf0cebc, scope.project.id=cbc9734c46db44918000791ce8bbb4e8, user.id=fc82d28a26eb41a784999dacd8a2b33c) {{(pid=87956) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:35:10.776325 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9615dc-8443-447a-946f-576bcc027b39 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:35:10.777765 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9615dc-8443-447a-946f-576bcc027b39 None admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:35:10.783633 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 70/141] 10.222.0.42 () {56 vars in 1374 bytes} [Sun Oct 30 00:35:10 2022] GET /identity/v3/role_assignments?user.id=fc82d28a26eb41a784999dacd8a2b33c&scope.project.id=cbc9734c46db44918000791ce8bbb4e8&role.id=992ffb31c434469696dce212bcf0cebc => generated 608 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 30 00:35:11.418703 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bdcab8-581c-4cd3-991a-c603bb744d9a None None] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:11.419407 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bdcab8-581c-4cd3-991a-c603bb744d9a None None] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:11.419407 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bdcab8-581c-4cd3-991a-c603bb744d9a None None] PATH_INFO: `/` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:11.420499 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 72/142] 10.222.0.42 () {54 vars in 927 bytes} [Sun Oct 30 00:35:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:35:11.425988 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de384af5-d499-4ad9-b07d-2e34ad94137d None None] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:11.426389 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de384af5-d499-4ad9-b07d-2e34ad94137d None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:11.426586 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de384af5-d499-4ad9-b07d-2e34ad94137d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:11.445557 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.auth.core [None req-de384af5-d499-4ad9-b07d-2e34ad94137d None None] MFA Rules not processed for user `eb55b6cbca4945abb21b0e49eb745e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=87956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:35:11.446761 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-de384af5-d499-4ad9-b07d-2e34ad94137d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:35:11.520683 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 71/143] 10.222.0.42 () {58 vars in 1024 bytes} [Sun Oct 30 00:35:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 30 00:35:11.620945 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d563a1-0fb9-4219-a8ff-500737ac65b4 None None] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:11.621274 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d563a1-0fb9-4219-a8ff-500737ac65b4 None None] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:11.621451 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d563a1-0fb9-4219-a8ff-500737ac65b4 None None] PATH_INFO: `/` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:11.622985 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 73/144] 10.222.0.42 () {54 vars in 927 bytes} [Sun Oct 30 00:35:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:35:11.627956 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c262fc5-aae4-4ad6-8a12-34ae17b9184b None None] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:11.628244 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c262fc5-aae4-4ad6-8a12-34ae17b9184b None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:11.628490 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c262fc5-aae4-4ad6-8a12-34ae17b9184b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:11.647326 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.auth.core [None req-9c262fc5-aae4-4ad6-8a12-34ae17b9184b None None] MFA Rules not processed for user `eb55b6cbca4945abb21b0e49eb745e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=87956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:35:11.648501 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-9c262fc5-aae4-4ad6-8a12-34ae17b9184b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:35:11.686510 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac59931d-40e9-4fdd-8705-44b4edb150dd None None] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:11.686669 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac59931d-40e9-4fdd-8705-44b4edb150dd None None] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:11.686955 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac59931d-40e9-4fdd-8705-44b4edb150dd None None] PATH_INFO: `/` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:11.688385 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 74/145] 10.222.0.42 () {54 vars in 927 bytes} [Sun Oct 30 00:35:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 30 00:35:11.694371 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a8dee4-602f-4c39-8e04-1e6b95870cf3 None None] REQUEST_METHOD: `POST` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:11.694658 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a8dee4-602f-4c39-8e04-1e6b95870cf3 None None] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:11.694929 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a8dee4-602f-4c39-8e04-1e6b95870cf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:11.712676 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.auth.core [None req-b7a8dee4-602f-4c39-8e04-1e6b95870cf3 None None] MFA Rules not processed for user `eb55b6cbca4945abb21b0e49eb745e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=87955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:35:11.713216 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=100 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:35:11.714018 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-b7a8dee4-602f-4c39-8e04-1e6b95870cf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:35:11.719915 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 72/146] 10.222.0.42 () {58 vars in 1024 bytes} [Sun Oct 30 00:35:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 30 00:35:11.780744 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 75/147] 10.222.0.42 () {58 vars in 1024 bytes} [Sun Oct 30 00:35:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 30 00:35:11.784408 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c262fc5-aae4-4ad6-8a12-34ae17b9184b None None] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:35:11.883817 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c262fc5-aae4-4ad6-8a12-34ae17b9184b None None] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:35:11.917387 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2d9b71-6864-4bb3-9926-33bfb553b097 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:35:11.918018 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2d9b71-6864-4bb3-9926-33bfb553b097 None admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:11.918298 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2d9b71-6864-4bb3-9926-33bfb553b097 None admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:11.918572 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2d9b71-6864-4bb3-9926-33bfb553b097 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:11.928721 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2d9b71-6864-4bb3-9926-33bfb553b097 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 30 00:35:11.933705 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application [None req-ef2d9b71-6864-4bb3-9926-33bfb553b097 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 30 00:35:11.933705 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:35:11.933705 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:35:11.933705 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:35:11.933705 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:35:11.933705 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:35:11.933705 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:35:11.933705 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:35:11.933705 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:35:11.933705 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:35:11.933705 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:35:11.933705 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:35:11.933705 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 30 00:35:11.933705 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 30 00:35:11.933705 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 30 00:35:11.933705 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 30 00:35:11.934523 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 30 00:35:11.934523 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 30 00:35:11.934523 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 30 00:35:11.934523 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 30 00:35:11.934523 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:35:11.934523 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:35:11.934523 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:35:11.934523 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:35:11.934523 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:35:11.934523 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:35:11.934523 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:35:11.934523 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application with Lock( Oct 30 00:35:11.934523 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:35:11.934523 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:35:11.934523 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:35:11.934523 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:35:11.935315 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:35:11.935315 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:35:11.935315 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:35:11.935315 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:35:11.935315 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 30 00:35:11.935315 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 30 00:35:11.935315 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 30 00:35:11.935315 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 30 00:35:11.935315 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 30 00:35:11.935315 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 30 00:35:11.935315 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 30 00:35:11.935315 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application Oct 30 00:35:11.935315 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 73/148] 10.222.0.42 () {56 vars in 1096 bytes} [Sun Oct 30 00:35:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:35:11.942152 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a8dee4-602f-4c39-8e04-1e6b95870cf3 None None] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:35:11.963775 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=100 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:35:11.984880 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2d9b71-6864-4bb3-9926-33bfb553b097 None admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:35:12.044252 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a8dee4-602f-4c39-8e04-1e6b95870cf3 None None] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:35:12.046399 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=100 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:35:12.078183 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35521621-043f-49f5-b9c4-89a6da3e2c82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:35:12.078788 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35521621-043f-49f5-b9c4-89a6da3e2c82 None admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:12.079071 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35521621-043f-49f5-b9c4-89a6da3e2c82 None admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:12.079383 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35521621-043f-49f5-b9c4-89a6da3e2c82 None admin] PATH_INFO: `/v3/roles` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:12.080027 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35521621-043f-49f5-b9c4-89a6da3e2c82 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:35:12.080337 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35521621-043f-49f5-b9c4-89a6da3e2c82 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:35:12.081700 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35521621-043f-49f5-b9c4-89a6da3e2c82 None admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:35:12.089568 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 76/149] 10.222.0.42 () {56 vars in 1099 bytes} [Sun Oct 30 00:35:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:35:12.094510 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35521621-043f-49f5-b9c4-89a6da3e2c82 None admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:35:12.094587 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2d9b71-6864-4bb3-9926-33bfb553b097 None admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:35:12.125176 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec04fcd-c059-4605-9e60-a1570ac0d49a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:35:12.125810 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec04fcd-c059-4605-9e60-a1570ac0d49a None admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:12.126087 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec04fcd-c059-4605-9e60-a1570ac0d49a None admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:12.126357 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec04fcd-c059-4605-9e60-a1570ac0d49a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:12.136348 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec04fcd-c059-4605-9e60-a1570ac0d49a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 30 00:35:12.141196 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application [None req-9ec04fcd-c059-4605-9e60-a1570ac0d49a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 30 00:35:12.141196 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:35:12.141196 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:35:12.141196 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:35:12.141196 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:35:12.141196 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:35:12.141196 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:35:12.141196 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:35:12.141196 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:35:12.141196 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:35:12.141196 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:35:12.141196 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:35:12.141196 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 30 00:35:12.141196 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 30 00:35:12.141196 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 30 00:35:12.141196 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 30 00:35:12.142161 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 30 00:35:12.142161 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 30 00:35:12.142161 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 30 00:35:12.142161 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 30 00:35:12.142161 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:35:12.142161 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:35:12.142161 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:35:12.142161 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:35:12.142161 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:35:12.142161 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:35:12.142161 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:35:12.142161 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application with Lock( Oct 30 00:35:12.142161 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:35:12.142161 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:35:12.142161 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:35:12.142161 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:35:12.142948 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:35:12.142948 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:35:12.142948 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:35:12.142948 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:35:12.142948 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 30 00:35:12.142948 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 30 00:35:12.142948 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 30 00:35:12.142948 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 30 00:35:12.142948 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 30 00:35:12.142948 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 30 00:35:12.142948 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 30 00:35:12.142948 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application Oct 30 00:35:12.142948 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 74/150] 10.222.0.42 () {56 vars in 1114 bytes} [Sun Oct 30 00:35:11 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 30 00:35:12.143745 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec04fcd-c059-4605-9e60-a1570ac0d49a None admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:35:12.175648 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=100 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:35:12.194567 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35521621-043f-49f5-b9c4-89a6da3e2c82 None admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:35:12.227809 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ab3761-7dcd-4942-b398-03d98f849e79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:35:12.228424 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ab3761-7dcd-4942-b398-03d98f849e79 None admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:12.228692 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ab3761-7dcd-4942-b398-03d98f849e79 None admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:12.228956 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ab3761-7dcd-4942-b398-03d98f849e79 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:12.230434 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ab3761-7dcd-4942-b398-03d98f849e79 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:35:12.231909 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ab3761-7dcd-4942-b398-03d98f849e79 None admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:35:12.233466 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 77/151] 10.222.0.42 () {56 vars in 1108 bytes} [Sun Oct 30 00:35:12 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:35:12.234220 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ab3761-7dcd-4942-b398-03d98f849e79 None admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:35:12.243183 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec04fcd-c059-4605-9e60-a1570ac0d49a None admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:35:12.260047 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=100 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:35:12.277005 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bbdc92-212c-4f67-b486-bdc0db93eb1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:35:12.277638 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bbdc92-212c-4f67-b486-bdc0db93eb1d None admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:12.277909 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bbdc92-212c-4f67-b486-bdc0db93eb1d None admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:12.278173 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bbdc92-212c-4f67-b486-bdc0db93eb1d None admin] PATH_INFO: `/v3/users/dc85948d96c749deba13e835cdcbbce6` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:12.290821 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3bbdc92-212c-4f67-b486-bdc0db93eb1d None admin] RBAC: Authorizing `identity:get_user(user_id=dc85948d96c749deba13e835cdcbbce6)` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:35:12.292317 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3bbdc92-212c-4f67-b486-bdc0db93eb1d None admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:35:12.293924 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 75/152] 10.222.0.42 () {56 vars in 1177 bytes} [Sun Oct 30 00:35:12 2022] GET /identity/v3/users/dc85948d96c749deba13e835cdcbbce6 => generated 283 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:35:12.294658 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bbdc92-212c-4f67-b486-bdc0db93eb1d None admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:35:12.332504 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ab3761-7dcd-4942-b398-03d98f849e79 None admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:35:12.364527 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801e70f2-428b-4596-b08e-93c6318f29e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:35:12.365146 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801e70f2-428b-4596-b08e-93c6318f29e4 None admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:12.365418 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801e70f2-428b-4596-b08e-93c6318f29e4 None admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:12.365698 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801e70f2-428b-4596-b08e-93c6318f29e4 None admin] PATH_INFO: `/v3/roles` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:12.366331 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801e70f2-428b-4596-b08e-93c6318f29e4 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:35:12.366624 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801e70f2-428b-4596-b08e-93c6318f29e4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:35:12.367987 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801e70f2-428b-4596-b08e-93c6318f29e4 None admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:35:12.375735 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 78/153] 10.222.0.42 () {56 vars in 1111 bytes} [Sun Oct 30 00:35:12 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:35:12.376579 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801e70f2-428b-4596-b08e-93c6318f29e4 None admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:35:12.391449 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=100 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:35:12.395534 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bbdc92-212c-4f67-b486-bdc0db93eb1d None admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:35:12.429160 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46397053-fe2c-460f-b443-9250ac0d3488 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:35:12.429791 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46397053-fe2c-460f-b443-9250ac0d3488 None admin] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:12.430381 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46397053-fe2c-460f-b443-9250ac0d3488 None admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:12.430381 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46397053-fe2c-460f-b443-9250ac0d3488 None admin] PATH_INFO: `/v3/users` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:12.430952 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46397053-fe2c-460f-b443-9250ac0d3488 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:35:12.432412 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46397053-fe2c-460f-b443-9250ac0d3488 None admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:35:12.453285 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 76/154] 10.222.0.42 () {60 vars in 1132 bytes} [Sun Oct 30 00:35:12 2022] POST /identity/v3/users => generated 297 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 00:35:12.454026 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46397053-fe2c-460f-b443-9250ac0d3488 None admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:35:12.480866 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801e70f2-428b-4596-b08e-93c6318f29e4 None admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:35:12.510912 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:35:12.521928 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5450c5-ab0b-4ad7-88c3-867822586fc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:35:12.523129 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5450c5-ab0b-4ad7-88c3-867822586fc9 None admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:12.523448 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5450c5-ab0b-4ad7-88c3-867822586fc9 None admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:12.523721 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5450c5-ab0b-4ad7-88c3-867822586fc9 None admin] PATH_INFO: `/v3/projects/0ca99d2d3e3d4195b47b4479559371ef` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:12.525292 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5450c5-ab0b-4ad7-88c3-867822586fc9 None admin] RBAC: Authorizing `identity:get_project(project_id=0ca99d2d3e3d4195b47b4479559371ef)` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:35:12.527119 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5450c5-ab0b-4ad7-88c3-867822586fc9 None admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:35:12.529067 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 79/155] 10.222.0.42 () {56 vars in 1186 bytes} [Sun Oct 30 00:35:12 2022] GET /identity/v3/projects/0ca99d2d3e3d4195b47b4479559371ef => generated 302 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:35:12.534900 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5450c5-ab0b-4ad7-88c3-867822586fc9 None admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:35:12.595914 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46397053-fe2c-460f-b443-9250ac0d3488 None admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:35:12.628304 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=100 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:35:12.635147 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac5f133-ee1e-42d4-a53e-86a39acdab30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:35:12.635836 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac5f133-ee1e-42d4-a53e-86a39acdab30 None admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:12.636120 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac5f133-ee1e-42d4-a53e-86a39acdab30 None admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:12.637118 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac5f133-ee1e-42d4-a53e-86a39acdab30 None admin] PATH_INFO: `/v3/users/dc85948d96c749deba13e835cdcbbce6` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:12.638517 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac5f133-ee1e-42d4-a53e-86a39acdab30 None admin] RBAC: Authorizing `identity:get_user(user_id=dc85948d96c749deba13e835cdcbbce6)` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:35:12.639917 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac5f133-ee1e-42d4-a53e-86a39acdab30 None admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:35:12.640831 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 77/156] 10.222.0.42 () {56 vars in 1177 bytes} [Sun Oct 30 00:35:12 2022] GET /identity/v3/users/dc85948d96c749deba13e835cdcbbce6 => generated 283 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:35:12.646373 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac5f133-ee1e-42d4-a53e-86a39acdab30 None admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:35:12.660261 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5450c5-ab0b-4ad7-88c3-867822586fc9 None admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:35:12.700429 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa883615-03b3-4c5d-9889-2dc7dac12578 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:35:12.701093 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa883615-03b3-4c5d-9889-2dc7dac12578 None admin] REQUEST_METHOD: `PUT` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:12.701367 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa883615-03b3-4c5d-9889-2dc7dac12578 None admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:12.701633 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa883615-03b3-4c5d-9889-2dc7dac12578 None admin] PATH_INFO: `/v3/projects/0ca99d2d3e3d4195b47b4479559371ef/users/dc85948d96c749deba13e835cdcbbce6/roles/6ccaa8c11f29456fb4e4eeccb21616c7` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:12.703634 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa883615-03b3-4c5d-9889-2dc7dac12578 None admin] RBAC: Authorizing `identity:create_grant(project_id=0ca99d2d3e3d4195b47b4479559371ef, user_id=dc85948d96c749deba13e835cdcbbce6, role_id=6ccaa8c11f29456fb4e4eeccb21616c7)` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:35:12.705010 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa883615-03b3-4c5d-9889-2dc7dac12578 None admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:35:12.721361 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 80/157] 10.222.0.42 () {58 vars in 1439 bytes} [Sun Oct 30 00:35:12 2022] PUT /identity/v3/projects/0ca99d2d3e3d4195b47b4479559371ef/users/dc85948d96c749deba13e835cdcbbce6/roles/6ccaa8c11f29456fb4e4eeccb21616c7 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 00:35:12.765169 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=100 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:35:12.768347 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac5f133-ee1e-42d4-a53e-86a39acdab30 None admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:35:12.809506 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0ab78d-52e2-4f22-856e-32557505d34b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:35:12.810339 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0ab78d-52e2-4f22-856e-32557505d34b None admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:12.810620 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0ab78d-52e2-4f22-856e-32557505d34b None admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:12.810955 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0ab78d-52e2-4f22-856e-32557505d34b None admin] PATH_INFO: `/v3/projects/0ca99d2d3e3d4195b47b4479559371ef` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:12.813687 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0ab78d-52e2-4f22-856e-32557505d34b None admin] RBAC: Authorizing `identity:get_project(project_id=0ca99d2d3e3d4195b47b4479559371ef)` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:35:12.815328 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0ab78d-52e2-4f22-856e-32557505d34b None admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:35:12.817670 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 78/158] 10.222.0.42 () {56 vars in 1186 bytes} [Sun Oct 30 00:35:12 2022] GET /identity/v3/projects/0ca99d2d3e3d4195b47b4479559371ef => generated 302 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 30 00:35:12.823776 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa883615-03b3-4c5d-9889-2dc7dac12578 None admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:35:12.934542 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa883615-03b3-4c5d-9889-2dc7dac12578 None admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:35:12.970345 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404c86fb-5452-4b0b-a8c0-78874b34d5f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:35:12.970930 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404c86fb-5452-4b0b-a8c0-78874b34d5f6 None admin] REQUEST_METHOD: `PUT` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:12.971227 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404c86fb-5452-4b0b-a8c0-78874b34d5f6 None admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:12.971509 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404c86fb-5452-4b0b-a8c0-78874b34d5f6 None admin] PATH_INFO: `/v3/projects/0ca99d2d3e3d4195b47b4479559371ef/users/dc85948d96c749deba13e835cdcbbce6/roles/7f42beaeb9e84fd8961e2fa0ae82d034` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:12.973784 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404c86fb-5452-4b0b-a8c0-78874b34d5f6 None admin] RBAC: Authorizing `identity:create_grant(project_id=0ca99d2d3e3d4195b47b4479559371ef, user_id=dc85948d96c749deba13e835cdcbbce6, role_id=7f42beaeb9e84fd8961e2fa0ae82d034)` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:35:12.975565 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404c86fb-5452-4b0b-a8c0-78874b34d5f6 None admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:35:12.986545 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:35:12.991383 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 81/159] 10.222.0.42 () {58 vars in 1439 bytes} [Sun Oct 30 00:35:12 2022] PUT /identity/v3/projects/0ca99d2d3e3d4195b47b4479559371ef/users/dc85948d96c749deba13e835cdcbbce6/roles/7f42beaeb9e84fd8961e2fa0ae82d034 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 00:35:14.774474 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceacc130-ce7c-4435-85eb-8e7ffacd211f None None] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:14.775049 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceacc130-ce7c-4435-85eb-8e7ffacd211f None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:14.775049 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceacc130-ce7c-4435-85eb-8e7ffacd211f None None] PATH_INFO: `/` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:14.776806 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 79/160] 10.222.0.42 () {54 vars in 927 bytes} [Sun Oct 30 00:35:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:35:14.782633 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304c7c21-1bbf-411b-a5e5-bf373fdb29d3 None None] REQUEST_METHOD: `POST` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:14.783166 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304c7c21-1bbf-411b-a5e5-bf373fdb29d3 None None] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:14.783166 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304c7c21-1bbf-411b-a5e5-bf373fdb29d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:14.802970 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.auth.core [None req-304c7c21-1bbf-411b-a5e5-bf373fdb29d3 None None] MFA Rules not processed for user `eb55b6cbca4945abb21b0e49eb745e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=87955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:35:14.804405 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-304c7c21-1bbf-411b-a5e5-bf373fdb29d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:35:14.870005 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3873719a-59ee-4af0-b8ae-edae61416bd6 None None] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:14.870325 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3873719a-59ee-4af0-b8ae-edae61416bd6 None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:14.871567 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3873719a-59ee-4af0-b8ae-edae61416bd6 None None] PATH_INFO: `/` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:14.872260 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 80/161] 10.222.0.42 () {54 vars in 927 bytes} [Sun Oct 30 00:35:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:35:14.877306 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dc2f95-49cc-4326-bdc1-2005988a2365 None None] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:14.877607 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dc2f95-49cc-4326-bdc1-2005988a2365 None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:14.877820 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 82/162] 10.222.0.42 () {58 vars in 1024 bytes} [Sun Oct 30 00:35:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 30 00:35:14.877918 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dc2f95-49cc-4326-bdc1-2005988a2365 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:14.882479 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e4976b-fe66-45ad-a47a-642017d4eb2c None None] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:14.882761 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e4976b-fe66-45ad-a47a-642017d4eb2c None None] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:14.883039 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e4976b-fe66-45ad-a47a-642017d4eb2c None None] PATH_INFO: `/` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:14.884399 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 83/163] 10.222.0.42 () {54 vars in 927 bytes} [Sun Oct 30 00:35:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 30 00:35:14.889398 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db45f4f1-7cf5-4984-b4d6-33e8f9dac9a0 None None] REQUEST_METHOD: `POST` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:14.889678 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db45f4f1-7cf5-4984-b4d6-33e8f9dac9a0 None None] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:14.889952 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db45f4f1-7cf5-4984-b4d6-33e8f9dac9a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:14.899340 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.auth.core [None req-39dc2f95-49cc-4326-bdc1-2005988a2365 None None] MFA Rules not processed for user `eb55b6cbca4945abb21b0e49eb745e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=87956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:35:14.900854 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-39dc2f95-49cc-4326-bdc1-2005988a2365 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:35:14.911764 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.auth.core [None req-db45f4f1-7cf5-4984-b4d6-33e8f9dac9a0 None None] MFA Rules not processed for user `eb55b6cbca4945abb21b0e49eb745e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=87955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:35:14.913801 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-db45f4f1-7cf5-4984-b4d6-33e8f9dac9a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:35:14.990378 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 81/164] 10.222.0.42 () {58 vars in 1024 bytes} [Sun Oct 30 00:35:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 30 00:35:14.995912 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 84/165] 10.222.0.42 () {58 vars in 1024 bytes} [Sun Oct 30 00:35:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 30 00:35:15.170591 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39dc2f95-49cc-4326-bdc1-2005988a2365 None None] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:35:15.172499 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43299fd5-853b-4ee5-a40c-c109d1d3d6b9 None None] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:15.172786 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43299fd5-853b-4ee5-a40c-c109d1d3d6b9 None None] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:15.173068 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43299fd5-853b-4ee5-a40c-c109d1d3d6b9 None None] PATH_INFO: `/` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:15.174436 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 85/166] 10.222.0.42 () {54 vars in 927 bytes} [Sun Oct 30 00:35:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:35:15.183285 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c23047b-48ec-4993-b615-40958235c536 None None] REQUEST_METHOD: `POST` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:15.188353 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c23047b-48ec-4993-b615-40958235c536 None None] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:15.188353 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c23047b-48ec-4993-b615-40958235c536 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:15.209370 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.auth.core [None req-7c23047b-48ec-4993-b615-40958235c536 None None] MFA Rules not processed for user `eb55b6cbca4945abb21b0e49eb745e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=87955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:35:15.210583 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-7c23047b-48ec-4993-b615-40958235c536 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:35:15.273331 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=100 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:35:15.286784 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 86/167] 10.222.0.42 () {58 vars in 1024 bytes} [Sun Oct 30 00:35:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 30 00:35:15.295323 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=100 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:35:15.295447 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c23047b-48ec-4993-b615-40958235c536 None None] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:35:15.295530 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39dc2f95-49cc-4326-bdc1-2005988a2365 None None] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:35:15.336341 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c455cca-ca05-4572-b7ef-42b43c7bb856 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:35:15.336945 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c455cca-ca05-4572-b7ef-42b43c7bb856 None admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:15.337182 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c455cca-ca05-4572-b7ef-42b43c7bb856 None admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:15.337482 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c455cca-ca05-4572-b7ef-42b43c7bb856 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:15.350309 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c455cca-ca05-4572-b7ef-42b43c7bb856 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 30 00:35:15.357853 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application [None req-7c455cca-ca05-4572-b7ef-42b43c7bb856 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 30 00:35:15.357853 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:35:15.357853 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:35:15.357853 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:35:15.357853 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:35:15.357853 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:35:15.357853 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:35:15.357853 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:35:15.357853 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:35:15.357853 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:35:15.357853 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:35:15.357853 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:35:15.357853 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 30 00:35:15.357853 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 30 00:35:15.357853 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 30 00:35:15.357853 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 30 00:35:15.358840 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 30 00:35:15.358840 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 30 00:35:15.358840 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 30 00:35:15.358840 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 30 00:35:15.358840 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:35:15.358840 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:35:15.358840 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:35:15.358840 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:35:15.358840 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:35:15.358840 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:35:15.358840 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:35:15.358840 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application with Lock( Oct 30 00:35:15.358840 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:35:15.358840 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:35:15.358840 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:35:15.358840 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:35:15.360009 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:35:15.360009 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:35:15.360009 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:35:15.360009 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:35:15.360009 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 30 00:35:15.360009 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 30 00:35:15.360009 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 30 00:35:15.360009 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 30 00:35:15.360009 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 30 00:35:15.360009 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 30 00:35:15.360009 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 30 00:35:15.360009 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application Oct 30 00:35:15.360009 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 82/168] 10.222.0.42 () {56 vars in 1099 bytes} [Sun Oct 30 00:35:15 2022] GET /identity/v3/roles/member => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:35:15.360673 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c455cca-ca05-4572-b7ef-42b43c7bb856 None admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:35:15.408522 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c23047b-48ec-4993-b615-40958235c536 None None] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:35:15.447955 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8f7bee-906c-4c61-95b8-c07a3602d2dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:35:15.449406 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8f7bee-906c-4c61-95b8-c07a3602d2dd None admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:15.449406 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8f7bee-906c-4c61-95b8-c07a3602d2dd None admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:15.449406 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8f7bee-906c-4c61-95b8-c07a3602d2dd None admin] PATH_INFO: `/v3/domains/default` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:15.450690 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8f7bee-906c-4c61-95b8-c07a3602d2dd None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:35:15.452147 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8f7bee-906c-4c61-95b8-c07a3602d2dd None admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:35:15.453736 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 87/169] 10.222.0.42 () {56 vars in 1108 bytes} [Sun Oct 30 00:35:15 2022] GET /identity/v3/domains/default => generated 199 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:35:15.454485 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8f7bee-906c-4c61-95b8-c07a3602d2dd None admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:35:15.480253 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c455cca-ca05-4572-b7ef-42b43c7bb856 None admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:35:15.515330 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=100 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:35:15.517828 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c2b3cf-d22a-45e8-a4f5-d2752788de8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:35:15.518511 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c2b3cf-d22a-45e8-a4f5-d2752788de8e None admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:15.518777 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c2b3cf-d22a-45e8-a4f5-d2752788de8e None admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:15.519177 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c2b3cf-d22a-45e8-a4f5-d2752788de8e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:15.529631 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c2b3cf-d22a-45e8-a4f5-d2752788de8e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 30 00:35:15.534471 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application [None req-86c2b3cf-d22a-45e8-a4f5-d2752788de8e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 30 00:35:15.534471 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:35:15.534471 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:35:15.534471 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:35:15.534471 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:35:15.534471 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:35:15.534471 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:35:15.534471 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:35:15.534471 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:35:15.534471 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:35:15.534471 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:35:15.534471 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:35:15.534471 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 30 00:35:15.534471 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 30 00:35:15.534471 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 30 00:35:15.534471 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 30 00:35:15.535394 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 30 00:35:15.535394 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 30 00:35:15.535394 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 30 00:35:15.535394 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 30 00:35:15.535394 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:35:15.535394 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:35:15.535394 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:35:15.535394 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:35:15.535394 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:35:15.535394 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:35:15.535394 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:35:15.535394 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application with Lock( Oct 30 00:35:15.535394 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:35:15.535394 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:35:15.535394 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:35:15.535394 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:35:15.536156 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:35:15.536156 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:35:15.536156 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:35:15.536156 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:35:15.536156 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 30 00:35:15.536156 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 30 00:35:15.536156 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 30 00:35:15.536156 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 30 00:35:15.536156 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 30 00:35:15.536156 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 30 00:35:15.536156 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 30 00:35:15.536156 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application Oct 30 00:35:15.536156 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 83/170] 10.222.0.42 () {56 vars in 1096 bytes} [Sun Oct 30 00:35:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:35:15.541329 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c2b3cf-d22a-45e8-a4f5-d2752788de8e None admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:35:15.562249 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8f7bee-906c-4c61-95b8-c07a3602d2dd None admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:35:15.563510 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=100 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:35:15.595836 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ef02cc-9abf-4c9e-847c-d113b326debe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:35:15.596364 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ef02cc-9abf-4c9e-847c-d113b326debe None admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:15.596635 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ef02cc-9abf-4c9e-847c-d113b326debe None admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:15.596900 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ef02cc-9abf-4c9e-847c-d113b326debe None admin] PATH_INFO: `/v3/roles` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:15.597554 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ef02cc-9abf-4c9e-847c-d113b326debe None admin] RBAC: Adding query filter params (name=member) {{(pid=87955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:35:15.597878 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ef02cc-9abf-4c9e-847c-d113b326debe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:35:15.599412 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ef02cc-9abf-4c9e-847c-d113b326debe None admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:35:15.607385 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 88/171] 10.222.0.42 () {56 vars in 1101 bytes} [Sun Oct 30 00:35:15 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:35:15.607385 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ef02cc-9abf-4c9e-847c-d113b326debe None admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:35:15.649870 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c2b3cf-d22a-45e8-a4f5-d2752788de8e None admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:35:15.682825 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb86a2e-2365-4b39-ba03-adabef847a59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:35:15.683467 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb86a2e-2365-4b39-ba03-adabef847a59 None admin] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:15.683750 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb86a2e-2365-4b39-ba03-adabef847a59 None admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:15.684023 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb86a2e-2365-4b39-ba03-adabef847a59 None admin] PATH_INFO: `/v3/users` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:15.684679 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb86a2e-2365-4b39-ba03-adabef847a59 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:35:15.686127 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb86a2e-2365-4b39-ba03-adabef847a59 None admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:35:15.702695 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ef02cc-9abf-4c9e-847c-d113b326debe None admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:35:15.707800 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 84/172] 10.222.0.42 () {60 vars in 1132 bytes} [Sun Oct 30 00:35:15 2022] POST /identity/v3/users => generated 297 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 00:35:15.708538 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb86a2e-2365-4b39-ba03-adabef847a59 None admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:35:15.741995 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=100 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:35:15.763412 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59984b4-14e5-4e56-9c38-a115866a6fa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:35:15.764301 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59984b4-14e5-4e56-9c38-a115866a6fa2 None admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:15.764582 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59984b4-14e5-4e56-9c38-a115866a6fa2 None admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:15.764848 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59984b4-14e5-4e56-9c38-a115866a6fa2 None admin] PATH_INFO: `/v3/roles` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:15.765990 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59984b4-14e5-4e56-9c38-a115866a6fa2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:35:15.766291 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59984b4-14e5-4e56-9c38-a115866a6fa2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:35:15.767814 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59984b4-14e5-4e56-9c38-a115866a6fa2 None admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:35:15.785682 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 89/173] 10.222.0.42 () {56 vars in 1099 bytes} [Sun Oct 30 00:35:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:35:15.785682 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59984b4-14e5-4e56-9c38-a115866a6fa2 None admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:35:15.793714 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:35:15.824366 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb86a2e-2365-4b39-ba03-adabef847a59 None admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:35:15.862281 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1c5074-7ae3-4d8b-9c1c-f2e5cc27da1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:35:15.862967 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1c5074-7ae3-4d8b-9c1c-f2e5cc27da1d None admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:15.863340 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1c5074-7ae3-4d8b-9c1c-f2e5cc27da1d None admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:15.863757 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1c5074-7ae3-4d8b-9c1c-f2e5cc27da1d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:15.875192 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1c5074-7ae3-4d8b-9c1c-f2e5cc27da1d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 30 00:35:15.881242 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application [None req-fa1c5074-7ae3-4d8b-9c1c-f2e5cc27da1d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 30 00:35:15.881242 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:35:15.881242 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:35:15.881242 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:35:15.881242 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:35:15.881242 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:35:15.881242 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:35:15.881242 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:35:15.881242 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:35:15.881242 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:35:15.881242 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:35:15.881242 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:35:15.881242 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 30 00:35:15.881242 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 30 00:35:15.881242 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 30 00:35:15.881242 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 30 00:35:15.882143 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 30 00:35:15.882143 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 30 00:35:15.882143 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 30 00:35:15.882143 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 30 00:35:15.882143 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:35:15.882143 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:35:15.882143 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:35:15.882143 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:35:15.882143 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:35:15.882143 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:35:15.882143 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:35:15.882143 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application with Lock( Oct 30 00:35:15.882143 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:35:15.882143 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:35:15.882143 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:35:15.882143 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:35:15.882922 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:35:15.882922 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:35:15.882922 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:35:15.882922 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:35:15.882922 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 30 00:35:15.882922 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 30 00:35:15.882922 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 30 00:35:15.882922 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 30 00:35:15.882922 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 30 00:35:15.882922 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 30 00:35:15.882922 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 30 00:35:15.882922 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application Oct 30 00:35:15.882922 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 85/174] 10.222.0.42 () {56 vars in 1114 bytes} [Sun Oct 30 00:35:15 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:35:15.883607 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1c5074-7ae3-4d8b-9c1c-f2e5cc27da1d None admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:35:15.910128 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59984b4-14e5-4e56-9c38-a115866a6fa2 None admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:35:15.952446 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ff9a4b-8f48-4215-b872-a5db28dcafe1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:35:15.953662 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ff9a4b-8f48-4215-b872-a5db28dcafe1 None admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:15.954102 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ff9a4b-8f48-4215-b872-a5db28dcafe1 None admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:15.954510 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ff9a4b-8f48-4215-b872-a5db28dcafe1 None admin] PATH_INFO: `/v3/users/2c5c2f7eb309443182125f5833fcf664` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:15.969503 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ff9a4b-8f48-4215-b872-a5db28dcafe1 None admin] RBAC: Authorizing `identity:get_user(user_id=2c5c2f7eb309443182125f5833fcf664)` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:35:15.971173 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ff9a4b-8f48-4215-b872-a5db28dcafe1 None admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:35:15.973100 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 90/175] 10.222.0.42 () {56 vars in 1177 bytes} [Sun Oct 30 00:35:15 2022] GET /identity/v3/users/2c5c2f7eb309443182125f5833fcf664 => generated 297 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:35:15.974040 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ff9a4b-8f48-4215-b872-a5db28dcafe1 None admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:35:16.004757 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1c5074-7ae3-4d8b-9c1c-f2e5cc27da1d None admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:35:16.024450 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=100 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:35:16.056955 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8bbc5c-908f-4f8f-9133-1e30a9203301 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:35:16.057813 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8bbc5c-908f-4f8f-9133-1e30a9203301 None admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:16.057930 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8bbc5c-908f-4f8f-9133-1e30a9203301 None admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:16.058144 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8bbc5c-908f-4f8f-9133-1e30a9203301 None admin] PATH_INFO: `/v3/users/dc85948d96c749deba13e835cdcbbce6` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:16.060623 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8bbc5c-908f-4f8f-9133-1e30a9203301 None admin] RBAC: Authorizing `identity:get_user(user_id=dc85948d96c749deba13e835cdcbbce6)` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:35:16.062079 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8bbc5c-908f-4f8f-9133-1e30a9203301 None admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:35:16.063728 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 86/176] 10.222.0.42 () {56 vars in 1177 bytes} [Sun Oct 30 00:35:15 2022] GET /identity/v3/users/dc85948d96c749deba13e835cdcbbce6 => generated 283 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:35:16.064488 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8bbc5c-908f-4f8f-9133-1e30a9203301 None admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:35:16.075896 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=100 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:35:16.101748 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ff9a4b-8f48-4215-b872-a5db28dcafe1 None admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:35:16.138702 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592afb12-432b-4458-b7dd-3f2199ea96c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:35:16.139418 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592afb12-432b-4458-b7dd-3f2199ea96c4 None admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:16.139991 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592afb12-432b-4458-b7dd-3f2199ea96c4 None admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:16.140425 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592afb12-432b-4458-b7dd-3f2199ea96c4 None admin] PATH_INFO: `/v3/roles` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:16.141204 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592afb12-432b-4458-b7dd-3f2199ea96c4 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:35:16.141500 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592afb12-432b-4458-b7dd-3f2199ea96c4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:35:16.142866 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592afb12-432b-4458-b7dd-3f2199ea96c4 None admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:35:16.152653 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 91/177] 10.222.0.42 () {56 vars in 1111 bytes} [Sun Oct 30 00:35:15 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:35:16.153484 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592afb12-432b-4458-b7dd-3f2199ea96c4 None admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:35:16.181882 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8bbc5c-908f-4f8f-9133-1e30a9203301 None admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:35:16.218334 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7789087e-7a3b-4e0f-96d9-b9429a8c7d46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:35:16.219069 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7789087e-7a3b-4e0f-96d9-b9429a8c7d46 None admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:16.219397 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7789087e-7a3b-4e0f-96d9-b9429a8c7d46 None admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:16.219763 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7789087e-7a3b-4e0f-96d9-b9429a8c7d46 None admin] PATH_INFO: `/v3/projects/0ca99d2d3e3d4195b47b4479559371ef` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:16.220904 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7789087e-7a3b-4e0f-96d9-b9429a8c7d46 None admin] RBAC: Authorizing `identity:get_project(project_id=0ca99d2d3e3d4195b47b4479559371ef)` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:35:16.222550 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7789087e-7a3b-4e0f-96d9-b9429a8c7d46 None admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:35:16.224514 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 87/178] 10.222.0.42 () {56 vars in 1186 bytes} [Sun Oct 30 00:35:16 2022] GET /identity/v3/projects/0ca99d2d3e3d4195b47b4479559371ef => generated 302 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:35:16.225357 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7789087e-7a3b-4e0f-96d9-b9429a8c7d46 None admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:35:16.277595 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592afb12-432b-4458-b7dd-3f2199ea96c4 None admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:35:16.279275 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=100 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:35:16.315805 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091a1e58-3b13-44e1-b3bb-e2eae6da662f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:35:16.316661 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091a1e58-3b13-44e1-b3bb-e2eae6da662f None admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:16.317092 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091a1e58-3b13-44e1-b3bb-e2eae6da662f None admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:16.317464 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091a1e58-3b13-44e1-b3bb-e2eae6da662f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:16.319992 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=100 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:35:16.352054 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7789087e-7a3b-4e0f-96d9-b9429a8c7d46 None admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:35:16.390781 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5308d7d6-f819-40ba-a495-e6a40f903233 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:35:16.391388 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5308d7d6-f819-40ba-a495-e6a40f903233 None admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:16.391663 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5308d7d6-f819-40ba-a495-e6a40f903233 None admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:16.391930 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5308d7d6-f819-40ba-a495-e6a40f903233 None admin] PATH_INFO: `/v3/users/dc85948d96c749deba13e835cdcbbce6` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:16.393308 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5308d7d6-f819-40ba-a495-e6a40f903233 None admin] RBAC: Authorizing `identity:get_user(user_id=dc85948d96c749deba13e835cdcbbce6)` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:35:16.395411 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5308d7d6-f819-40ba-a495-e6a40f903233 None admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:35:16.396911 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091a1e58-3b13-44e1-b3bb-e2eae6da662f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:35:16.401858 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 88/179] 10.222.0.42 () {56 vars in 1177 bytes} [Sun Oct 30 00:35:16 2022] GET /identity/v3/users/dc85948d96c749deba13e835cdcbbce6 => generated 283 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:35:16.401858 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5308d7d6-f819-40ba-a495-e6a40f903233 None admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:35:16.404608 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091a1e58-3b13-44e1-b3bb-e2eae6da662f None admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:35:16.524653 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 92/180] 10.222.0.42 () {58 vars in 1282 bytes} [Sun Oct 30 00:35:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 30 00:35:16.525590 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091a1e58-3b13-44e1-b3bb-e2eae6da662f None admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:35:16.525984 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5308d7d6-f819-40ba-a495-e6a40f903233 None admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:35:16.528216 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=100 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:35:16.566107 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4948a2-9c6a-4f42-82d3-93b7bc50ce99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:35:16.567159 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4948a2-9c6a-4f42-82d3-93b7bc50ce99 None admin] REQUEST_METHOD: `PUT` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:16.567462 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4948a2-9c6a-4f42-82d3-93b7bc50ce99 None admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:16.567743 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4948a2-9c6a-4f42-82d3-93b7bc50ce99 None admin] PATH_INFO: `/v3/projects/0ca99d2d3e3d4195b47b4479559371ef/users/2c5c2f7eb309443182125f5833fcf664/roles/1c93019874174c4b91118d9ce2347e47` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:16.570419 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4948a2-9c6a-4f42-82d3-93b7bc50ce99 None admin] RBAC: Authorizing `identity:create_grant(project_id=0ca99d2d3e3d4195b47b4479559371ef, user_id=2c5c2f7eb309443182125f5833fcf664, role_id=1c93019874174c4b91118d9ce2347e47)` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:35:16.572155 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4948a2-9c6a-4f42-82d3-93b7bc50ce99 None admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:35:16.584117 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:35:16.595296 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 89/181] 10.222.0.42 () {58 vars in 1439 bytes} [Sun Oct 30 00:35:16 2022] PUT /identity/v3/projects/0ca99d2d3e3d4195b47b4479559371ef/users/2c5c2f7eb309443182125f5833fcf664/roles/1c93019874174c4b91118d9ce2347e47 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 00:35:16.596640 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4948a2-9c6a-4f42-82d3-93b7bc50ce99 None admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:35:16.689179 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091a1e58-3b13-44e1-b3bb-e2eae6da662f None admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:35:16.763090 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639e1ec3-96c8-41fb-b252-74906e161db0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:35:16.764100 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639e1ec3-96c8-41fb-b252-74906e161db0 None admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:16.764563 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639e1ec3-96c8-41fb-b252-74906e161db0 None admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:16.765037 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639e1ec3-96c8-41fb-b252-74906e161db0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:16.799732 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4948a2-9c6a-4f42-82d3-93b7bc50ce99 None admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:35:16.857631 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ad2d52-cc32-4782-ac2a-7391fb311fe7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:35:16.858540 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ad2d52-cc32-4782-ac2a-7391fb311fe7 None admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:16.858833 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ad2d52-cc32-4782-ac2a-7391fb311fe7 None admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:16.859256 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ad2d52-cc32-4782-ac2a-7391fb311fe7 None admin] PATH_INFO: `/v3/projects/0ca99d2d3e3d4195b47b4479559371ef` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:16.863125 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ad2d52-cc32-4782-ac2a-7391fb311fe7 None admin] RBAC: Authorizing `identity:get_project(project_id=0ca99d2d3e3d4195b47b4479559371ef)` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:35:16.864625 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ad2d52-cc32-4782-ac2a-7391fb311fe7 None admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:35:16.866567 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 90/182] 10.222.0.42 () {56 vars in 1186 bytes} [Sun Oct 30 00:35:16 2022] GET /identity/v3/projects/0ca99d2d3e3d4195b47b4479559371ef => generated 302 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:35:16.875248 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ad2d52-cc32-4782-ac2a-7391fb311fe7 None admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:35:16.893722 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639e1ec3-96c8-41fb-b252-74906e161db0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:35:16.895222 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639e1ec3-96c8-41fb-b252-74906e161db0 None admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:35:16.897313 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=100 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:35:16.962174 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=100 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:35:17.006383 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ad2d52-cc32-4782-ac2a-7391fb311fe7 None admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:35:17.058434 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e4962c-117c-48a6-8849-a55b441a2e44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:35:17.059047 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e4962c-117c-48a6-8849-a55b441a2e44 None admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:17.059360 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e4962c-117c-48a6-8849-a55b441a2e44 None admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:17.059630 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e4962c-117c-48a6-8849-a55b441a2e44 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:17.060349 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e4962c-117c-48a6-8849-a55b441a2e44 None admin] RBAC: Adding query filter params (role.id=6ccaa8c11f29456fb4e4eeccb21616c7, scope.project.id=0ca99d2d3e3d4195b47b4479559371ef, user.id=dc85948d96c749deba13e835cdcbbce6) {{(pid=87956) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:35:17.060650 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e4962c-117c-48a6-8849-a55b441a2e44 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:35:17.062092 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e4962c-117c-48a6-8849-a55b441a2e44 None admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:35:17.072975 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 91/183] 10.222.0.42 () {56 vars in 1374 bytes} [Sun Oct 30 00:35:16 2022] GET /identity/v3/role_assignments?user.id=dc85948d96c749deba13e835cdcbbce6&scope.project.id=0ca99d2d3e3d4195b47b4479559371ef&role.id=6ccaa8c11f29456fb4e4eeccb21616c7 => generated 608 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 30 00:35:17.085971 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 93/184] 10.222.0.42 () {58 vars in 1282 bytes} [Sun Oct 30 00:35:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 561 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 30 00:35:17.092259 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e4962c-117c-48a6-8849-a55b441a2e44 None admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:35:17.229995 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e4962c-117c-48a6-8849-a55b441a2e44 None admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:35:17.265078 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=100 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:35:17.278463 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aab9291-2378-4b11-98d1-b934a0203da8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:35:17.278463 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aab9291-2378-4b11-98d1-b934a0203da8 None admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:17.278761 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aab9291-2378-4b11-98d1-b934a0203da8 None admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:17.278972 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aab9291-2378-4b11-98d1-b934a0203da8 None admin] PATH_INFO: `/v3/projects/0ca99d2d3e3d4195b47b4479559371ef` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:17.281121 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aab9291-2378-4b11-98d1-b934a0203da8 None admin] RBAC: Authorizing `identity:get_project(project_id=0ca99d2d3e3d4195b47b4479559371ef)` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:35:17.281479 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aab9291-2378-4b11-98d1-b934a0203da8 None admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:35:17.283113 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 92/185] 10.222.0.42 () {56 vars in 1186 bytes} [Sun Oct 30 00:35:17 2022] GET /identity/v3/projects/0ca99d2d3e3d4195b47b4479559371ef => generated 302 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:35:17.289070 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639e1ec3-96c8-41fb-b252-74906e161db0 None admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:35:17.387738 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639e1ec3-96c8-41fb-b252-74906e161db0 None admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:35:17.389273 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=100 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:35:17.422758 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99638ec9-3aec-434c-a316-4887198b91c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:35:17.423396 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99638ec9-3aec-434c-a316-4887198b91c4 None admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:17.423668 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99638ec9-3aec-434c-a316-4887198b91c4 None admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:17.423977 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99638ec9-3aec-434c-a316-4887198b91c4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:17.424702 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99638ec9-3aec-434c-a316-4887198b91c4 None admin] RBAC: Adding query filter params (role.id=7f42beaeb9e84fd8961e2fa0ae82d034, scope.project.id=0ca99d2d3e3d4195b47b4479559371ef, user.id=dc85948d96c749deba13e835cdcbbce6) {{(pid=87955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:35:17.425001 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99638ec9-3aec-434c-a316-4887198b91c4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:35:17.426451 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99638ec9-3aec-434c-a316-4887198b91c4 None admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:35:17.432671 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 94/186] 10.222.0.42 () {56 vars in 1374 bytes} [Sun Oct 30 00:35:17 2022] GET /identity/v3/role_assignments?user.id=dc85948d96c749deba13e835cdcbbce6&scope.project.id=0ca99d2d3e3d4195b47b4479559371ef&role.id=7f42beaeb9e84fd8961e2fa0ae82d034 => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:35:18.115040 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adf101f-a992-49a5-8623-92d874d0b3b9 None None] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:18.115596 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adf101f-a992-49a5-8623-92d874d0b3b9 None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:18.115596 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adf101f-a992-49a5-8623-92d874d0b3b9 None None] PATH_INFO: `/` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:18.116903 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 93/187] 10.222.0.42 () {54 vars in 927 bytes} [Sun Oct 30 00:35:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:35:18.122300 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef47f6a-93e3-4b2f-9e3d-1006b965d87b None None] REQUEST_METHOD: `POST` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:18.122708 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef47f6a-93e3-4b2f-9e3d-1006b965d87b None None] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:18.122798 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef47f6a-93e3-4b2f-9e3d-1006b965d87b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:18.141066 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.auth.core [None req-0ef47f6a-93e3-4b2f-9e3d-1006b965d87b None None] MFA Rules not processed for user `eb55b6cbca4945abb21b0e49eb745e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=87955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:35:18.142242 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-0ef47f6a-93e3-4b2f-9e3d-1006b965d87b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:35:18.186426 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5946c1-7768-43f2-a1fe-19c468c15d9c None None] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:18.186765 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5946c1-7768-43f2-a1fe-19c468c15d9c None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:18.186924 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5946c1-7768-43f2-a1fe-19c468c15d9c None None] PATH_INFO: `/` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:18.188490 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 94/188] 10.222.0.42 () {54 vars in 927 bytes} [Sun Oct 30 00:35:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 30 00:35:18.193465 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ab94b7-748e-45fc-a7b9-f12d01d5d66f None None] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:18.193707 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ab94b7-748e-45fc-a7b9-f12d01d5d66f None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:18.193990 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ab94b7-748e-45fc-a7b9-f12d01d5d66f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:18.211760 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.auth.core [None req-32ab94b7-748e-45fc-a7b9-f12d01d5d66f None None] MFA Rules not processed for user `eb55b6cbca4945abb21b0e49eb745e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=87956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:35:18.213281 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-32ab94b7-748e-45fc-a7b9-f12d01d5d66f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:35:18.219239 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 95/189] 10.222.0.42 () {58 vars in 1024 bytes} [Sun Oct 30 00:35:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 30 00:35:18.285662 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 95/190] 10.222.0.42 () {58 vars in 1024 bytes} [Sun Oct 30 00:35:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 30 00:35:18.476585 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef47f6a-93e3-4b2f-9e3d-1006b965d87b None None] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:35:18.557675 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ab94b7-748e-45fc-a7b9-f12d01d5d66f None None] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:35:18.570639 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=100 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:35:18.577285 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef47f6a-93e3-4b2f-9e3d-1006b965d87b None None] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:35:18.611633 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54294af6-24d2-4f39-a32a-eacacb710d59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:35:18.612271 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54294af6-24d2-4f39-a32a-eacacb710d59 None admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:18.612626 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54294af6-24d2-4f39-a32a-eacacb710d59 None admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:18.612898 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54294af6-24d2-4f39-a32a-eacacb710d59 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:18.624136 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54294af6-24d2-4f39-a32a-eacacb710d59 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 30 00:35:18.628866 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application [None req-54294af6-24d2-4f39-a32a-eacacb710d59 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 30 00:35:18.628866 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:35:18.628866 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:35:18.628866 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:35:18.628866 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:35:18.628866 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:35:18.628866 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:35:18.628866 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:35:18.628866 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:35:18.628866 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:35:18.628866 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:35:18.628866 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:35:18.628866 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 30 00:35:18.628866 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 30 00:35:18.628866 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 30 00:35:18.628866 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 30 00:35:18.629926 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 30 00:35:18.629926 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 30 00:35:18.629926 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 30 00:35:18.629926 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 30 00:35:18.629926 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:35:18.629926 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:35:18.629926 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:35:18.629926 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:35:18.629926 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:35:18.629926 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:35:18.629926 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:35:18.629926 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application with Lock( Oct 30 00:35:18.629926 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:35:18.629926 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:35:18.629926 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:35:18.629926 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:35:18.632295 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:35:18.632295 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:35:18.632295 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:35:18.632295 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:35:18.632295 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 30 00:35:18.632295 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 30 00:35:18.632295 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 30 00:35:18.632295 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 30 00:35:18.632295 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 30 00:35:18.632295 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 30 00:35:18.632295 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 30 00:35:18.632295 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application Oct 30 00:35:18.632295 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 96/191] 10.222.0.42 () {56 vars in 1099 bytes} [Sun Oct 30 00:35:18 2022] GET /identity/v3/roles/reader => generated 84 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:35:18.635550 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54294af6-24d2-4f39-a32a-eacacb710d59 None admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:35:18.669235 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ab94b7-748e-45fc-a7b9-f12d01d5d66f None None] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:35:18.702963 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=100 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:35:18.713219 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e93d44-2312-4a09-9005-a508c3d75e73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:35:18.713864 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e93d44-2312-4a09-9005-a508c3d75e73 None admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:18.714167 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e93d44-2312-4a09-9005-a508c3d75e73 None admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:18.714870 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e93d44-2312-4a09-9005-a508c3d75e73 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:18.716418 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e93d44-2312-4a09-9005-a508c3d75e73 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:35:18.718397 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e93d44-2312-4a09-9005-a508c3d75e73 None admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:35:18.720322 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 96/192] 10.222.0.42 () {56 vars in 1108 bytes} [Sun Oct 30 00:35:18 2022] GET /identity/v3/domains/default => generated 199 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:35:18.725765 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e93d44-2312-4a09-9005-a508c3d75e73 None admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:35:18.737893 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54294af6-24d2-4f39-a32a-eacacb710d59 None admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:35:18.773186 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a979ab74-bb78-4896-a246-1fb6028ddf02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:35:18.773791 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a979ab74-bb78-4896-a246-1fb6028ddf02 None admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:18.774164 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a979ab74-bb78-4896-a246-1fb6028ddf02 None admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:18.774436 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a979ab74-bb78-4896-a246-1fb6028ddf02 None admin] PATH_INFO: `/v3/roles` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:18.775096 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a979ab74-bb78-4896-a246-1fb6028ddf02 None admin] RBAC: Adding query filter params (name=reader) {{(pid=87955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:35:18.775419 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a979ab74-bb78-4896-a246-1fb6028ddf02 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:35:18.776790 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a979ab74-bb78-4896-a246-1fb6028ddf02 None admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:35:18.785821 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 97/193] 10.222.0.42 () {56 vars in 1101 bytes} [Sun Oct 30 00:35:18 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:35:18.791361 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a979ab74-bb78-4896-a246-1fb6028ddf02 None admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:35:18.813013 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=100 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:35:18.828706 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e93d44-2312-4a09-9005-a508c3d75e73 None admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:35:18.864184 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948c3118-f564-4502-888d-39f14ef56f86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:35:18.864894 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948c3118-f564-4502-888d-39f14ef56f86 None admin] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:18.865098 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948c3118-f564-4502-888d-39f14ef56f86 None admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:18.865350 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948c3118-f564-4502-888d-39f14ef56f86 None admin] PATH_INFO: `/v3/users` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:18.866006 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948c3118-f564-4502-888d-39f14ef56f86 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:35:18.867472 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948c3118-f564-4502-888d-39f14ef56f86 None admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:35:18.891022 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 97/194] 10.222.0.42 () {60 vars in 1132 bytes} [Sun Oct 30 00:35:18 2022] POST /identity/v3/users => generated 293 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 30 00:35:18.904234 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a979ab74-bb78-4896-a246-1fb6028ddf02 None admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:35:18.942220 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db4652f-8bcf-47c5-b676-f91af5dba5d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:35:18.942883 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db4652f-8bcf-47c5-b676-f91af5dba5d1 None admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:18.943144 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db4652f-8bcf-47c5-b676-f91af5dba5d1 None admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:18.943463 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db4652f-8bcf-47c5-b676-f91af5dba5d1 None admin] PATH_INFO: `/v3/users/5ac4353dab7846308a8ab2f27cf010ef` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:18.961623 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db4652f-8bcf-47c5-b676-f91af5dba5d1 None admin] RBAC: Authorizing `identity:get_user(user_id=5ac4353dab7846308a8ab2f27cf010ef)` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:35:18.964248 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db4652f-8bcf-47c5-b676-f91af5dba5d1 None admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:35:18.966298 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 98/195] 10.222.0.42 () {56 vars in 1177 bytes} [Sun Oct 30 00:35:18 2022] GET /identity/v3/users/5ac4353dab7846308a8ab2f27cf010ef => generated 297 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 30 00:35:18.974345 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948c3118-f564-4502-888d-39f14ef56f86 None admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:35:19.031861 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:35:19.073070 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f6b9dd-81c5-488e-ae0e-1a9bbc608df5 None None] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:19.073361 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f6b9dd-81c5-488e-ae0e-1a9bbc608df5 None None] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:19.073635 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f6b9dd-81c5-488e-ae0e-1a9bbc608df5 None None] PATH_INFO: `/` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:19.074995 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 99/196] 10.222.0.42 () {54 vars in 927 bytes} [Sun Oct 30 00:35:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 30 00:35:19.080316 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e411375f-e489-451f-bb31-91943e1ce8fc None None] REQUEST_METHOD: `POST` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:19.080599 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e411375f-e489-451f-bb31-91943e1ce8fc None None] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:19.080908 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e411375f-e489-451f-bb31-91943e1ce8fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:19.101328 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948c3118-f564-4502-888d-39f14ef56f86 None admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:35:19.101599 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.auth.core [None req-e411375f-e489-451f-bb31-91943e1ce8fc None None] MFA Rules not processed for user `eb55b6cbca4945abb21b0e49eb745e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=87955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:35:19.102806 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-e411375f-e489-451f-bb31-91943e1ce8fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:35:19.143983 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b720b0-21ee-4c2e-aaa1-a48bbc3a0389 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:35:19.144641 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b720b0-21ee-4c2e-aaa1-a48bbc3a0389 None admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:19.144925 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b720b0-21ee-4c2e-aaa1-a48bbc3a0389 None admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:19.145194 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b720b0-21ee-4c2e-aaa1-a48bbc3a0389 None admin] PATH_INFO: `/v3/projects/0ca99d2d3e3d4195b47b4479559371ef` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:19.146342 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b720b0-21ee-4c2e-aaa1-a48bbc3a0389 None admin] RBAC: Authorizing `identity:get_project(project_id=0ca99d2d3e3d4195b47b4479559371ef)` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:35:19.148622 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b720b0-21ee-4c2e-aaa1-a48bbc3a0389 None admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:35:19.150449 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 98/197] 10.222.0.42 () {56 vars in 1186 bytes} [Sun Oct 30 00:35:18 2022] GET /identity/v3/projects/0ca99d2d3e3d4195b47b4479559371ef => generated 302 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:35:19.156250 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b720b0-21ee-4c2e-aaa1-a48bbc3a0389 None admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:35:19.183622 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 100/198] 10.222.0.42 () {58 vars in 1024 bytes} [Sun Oct 30 00:35:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 30 00:35:19.276479 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b720b0-21ee-4c2e-aaa1-a48bbc3a0389 None admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:35:19.298833 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=100 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:35:19.313214 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137c1b8d-dcfb-40f4-9301-6527fa914a47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:35:19.313920 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137c1b8d-dcfb-40f4-9301-6527fa914a47 None admin] REQUEST_METHOD: `PUT` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:19.314223 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137c1b8d-dcfb-40f4-9301-6527fa914a47 None admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:19.314495 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137c1b8d-dcfb-40f4-9301-6527fa914a47 None admin] PATH_INFO: `/v3/projects/0ca99d2d3e3d4195b47b4479559371ef/users/5ac4353dab7846308a8ab2f27cf010ef/roles/992ffb31c434469696dce212bcf0cebc` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:19.316580 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137c1b8d-dcfb-40f4-9301-6527fa914a47 None admin] RBAC: Authorizing `identity:create_grant(project_id=0ca99d2d3e3d4195b47b4479559371ef, user_id=5ac4353dab7846308a8ab2f27cf010ef, role_id=992ffb31c434469696dce212bcf0cebc)` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:35:19.318105 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137c1b8d-dcfb-40f4-9301-6527fa914a47 None admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:35:19.335318 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 99/199] 10.222.0.42 () {58 vars in 1439 bytes} [Sun Oct 30 00:35:19 2022] PUT /identity/v3/projects/0ca99d2d3e3d4195b47b4479559371ef/users/5ac4353dab7846308a8ab2f27cf010ef/roles/992ffb31c434469696dce212bcf0cebc => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 00:35:19.455004 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e411375f-e489-451f-bb31-91943e1ce8fc None None] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:35:19.464128 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=100 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:35:19.561427 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e411375f-e489-451f-bb31-91943e1ce8fc None None] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:35:19.597479 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa6e390-e245-4ddc-aeab-f0740873e890 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:35:19.598117 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa6e390-e245-4ddc-aeab-f0740873e890 None admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:19.598384 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa6e390-e245-4ddc-aeab-f0740873e890 None admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:19.598647 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa6e390-e245-4ddc-aeab-f0740873e890 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:19.609250 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa6e390-e245-4ddc-aeab-f0740873e890 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 30 00:35:19.614148 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application [None req-faa6e390-e245-4ddc-aeab-f0740873e890 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 30 00:35:19.614148 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:35:19.614148 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:35:19.614148 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:35:19.614148 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:35:19.614148 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:35:19.614148 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:35:19.614148 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:35:19.614148 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:35:19.614148 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:35:19.614148 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:35:19.614148 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:35:19.614148 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 30 00:35:19.614148 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 30 00:35:19.614148 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 30 00:35:19.614148 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 30 00:35:19.615009 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 30 00:35:19.615009 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 30 00:35:19.615009 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 30 00:35:19.615009 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 30 00:35:19.615009 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:35:19.615009 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:35:19.615009 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:35:19.615009 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:35:19.615009 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:35:19.615009 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:35:19.615009 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:35:19.615009 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application with Lock( Oct 30 00:35:19.615009 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:35:19.615009 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:35:19.615009 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:35:19.615009 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:35:19.615868 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:35:19.615868 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:35:19.615868 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:35:19.615868 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:35:19.615868 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 30 00:35:19.615868 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 30 00:35:19.615868 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 30 00:35:19.615868 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 30 00:35:19.615868 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 30 00:35:19.615868 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 30 00:35:19.615868 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 30 00:35:19.615868 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application Oct 30 00:35:19.615868 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 101/200] 10.222.0.42 () {56 vars in 1099 bytes} [Sun Oct 30 00:35:19 2022] GET /identity/v3/roles/member => generated 84 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:35:19.622426 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137c1b8d-dcfb-40f4-9301-6527fa914a47 None admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:35:19.728239 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137c1b8d-dcfb-40f4-9301-6527fa914a47 None admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:35:19.762807 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d94f03e-6919-4e7d-a6be-0b626fc6deb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:35:19.763456 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d94f03e-6919-4e7d-a6be-0b626fc6deb1 None admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:19.763737 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d94f03e-6919-4e7d-a6be-0b626fc6deb1 None admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:19.764008 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d94f03e-6919-4e7d-a6be-0b626fc6deb1 None admin] PATH_INFO: `/v3/roles` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:19.764686 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d94f03e-6919-4e7d-a6be-0b626fc6deb1 None admin] RBAC: Adding query filter params (name=member) {{(pid=87956) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:35:19.764993 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d94f03e-6919-4e7d-a6be-0b626fc6deb1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:35:19.766377 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d94f03e-6919-4e7d-a6be-0b626fc6deb1 None admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:35:19.775110 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 100/201] 10.222.0.42 () {56 vars in 1101 bytes} [Sun Oct 30 00:35:19 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 30 00:35:19.780934 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa6e390-e245-4ddc-aeab-f0740873e890 None admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:35:19.849390 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=100 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:35:19.889241 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa6e390-e245-4ddc-aeab-f0740873e890 None admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:35:19.923689 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8509a464-8a41-4c6d-93f2-8cc669e7237a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:35:19.924743 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8509a464-8a41-4c6d-93f2-8cc669e7237a None admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:19.925214 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8509a464-8a41-4c6d-93f2-8cc669e7237a None admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:19.925676 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8509a464-8a41-4c6d-93f2-8cc669e7237a None admin] PATH_INFO: `/v3/users/2c5c2f7eb309443182125f5833fcf664` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:19.927006 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8509a464-8a41-4c6d-93f2-8cc669e7237a None admin] RBAC: Authorizing `identity:get_user(user_id=2c5c2f7eb309443182125f5833fcf664)` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:35:19.928672 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8509a464-8a41-4c6d-93f2-8cc669e7237a None admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:35:19.930825 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 102/202] 10.222.0.42 () {56 vars in 1177 bytes} [Sun Oct 30 00:35:19 2022] GET /identity/v3/users/2c5c2f7eb309443182125f5833fcf664 => generated 297 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:35:19.936145 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d94f03e-6919-4e7d-a6be-0b626fc6deb1 None admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:35:19.987593 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:35:20.045711 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d94f03e-6919-4e7d-a6be-0b626fc6deb1 None admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:35:20.087919 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebd294e-cd7d-48de-bbf2-82b43e95eef0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:35:20.088544 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebd294e-cd7d-48de-bbf2-82b43e95eef0 None admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:20.088825 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebd294e-cd7d-48de-bbf2-82b43e95eef0 None admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:20.089100 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebd294e-cd7d-48de-bbf2-82b43e95eef0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:20.157590 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebd294e-cd7d-48de-bbf2-82b43e95eef0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:35:20.159163 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebd294e-cd7d-48de-bbf2-82b43e95eef0 None admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:35:20.207085 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=100 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:35:20.261343 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 101/203] 10.222.0.42 () {58 vars in 1282 bytes} [Sun Oct 30 00:35:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 30 00:35:20.266934 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8509a464-8a41-4c6d-93f2-8cc669e7237a None admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:35:20.370562 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8509a464-8a41-4c6d-93f2-8cc669e7237a None admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:35:20.404844 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afb0f90-1c3b-42de-88a7-49f3bf0bc8e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:35:20.405870 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afb0f90-1c3b-42de-88a7-49f3bf0bc8e5 None admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:20.406341 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afb0f90-1c3b-42de-88a7-49f3bf0bc8e5 None admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:20.406800 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afb0f90-1c3b-42de-88a7-49f3bf0bc8e5 None admin] PATH_INFO: `/v3/projects/0ca99d2d3e3d4195b47b4479559371ef` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:20.408207 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0afb0f90-1c3b-42de-88a7-49f3bf0bc8e5 None admin] RBAC: Authorizing `identity:get_project(project_id=0ca99d2d3e3d4195b47b4479559371ef)` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:35:20.409984 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0afb0f90-1c3b-42de-88a7-49f3bf0bc8e5 None admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:35:20.412240 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 103/204] 10.222.0.42 () {56 vars in 1186 bytes} [Sun Oct 30 00:35:20 2022] GET /identity/v3/projects/0ca99d2d3e3d4195b47b4479559371ef => generated 302 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:35:20.421036 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebd294e-cd7d-48de-bbf2-82b43e95eef0 None admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:35:20.518792 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebd294e-cd7d-48de-bbf2-82b43e95eef0 None admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:35:20.553417 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426201ca-1c8e-4d0c-9a6f-72c804bfddad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:35:20.554084 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426201ca-1c8e-4d0c-9a6f-72c804bfddad None admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:20.554473 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426201ca-1c8e-4d0c-9a6f-72c804bfddad None admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:20.554755 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426201ca-1c8e-4d0c-9a6f-72c804bfddad None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:20.555593 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426201ca-1c8e-4d0c-9a6f-72c804bfddad None admin] RBAC: Adding query filter params (role.id=1c93019874174c4b91118d9ce2347e47, scope.project.id=0ca99d2d3e3d4195b47b4479559371ef, user.id=2c5c2f7eb309443182125f5833fcf664) {{(pid=87956) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:35:20.555910 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426201ca-1c8e-4d0c-9a6f-72c804bfddad None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:35:20.557359 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426201ca-1c8e-4d0c-9a6f-72c804bfddad None admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:35:20.563760 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 102/205] 10.222.0.42 () {56 vars in 1374 bytes} [Sun Oct 30 00:35:20 2022] GET /identity/v3/role_assignments?user.id=2c5c2f7eb309443182125f5833fcf664&scope.project.id=0ca99d2d3e3d4195b47b4479559371ef&role.id=1c93019874174c4b91118d9ce2347e47 => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:35:21.254147 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0935749-9efb-42f9-81d6-4ed0db592995 None None] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:21.254394 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0935749-9efb-42f9-81d6-4ed0db592995 None None] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:21.254858 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0935749-9efb-42f9-81d6-4ed0db592995 None None] PATH_INFO: `/` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:21.256443 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 104/206] 10.222.0.42 () {54 vars in 927 bytes} [Sun Oct 30 00:35:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:35:21.261945 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d812a0-5308-41e5-9ffd-051821e4be8a None None] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:21.262397 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d812a0-5308-41e5-9ffd-051821e4be8a None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:21.262469 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d812a0-5308-41e5-9ffd-051821e4be8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:21.275746 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=100 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:35:21.281219 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.auth.core [None req-a4d812a0-5308-41e5-9ffd-051821e4be8a None None] MFA Rules not processed for user `eb55b6cbca4945abb21b0e49eb745e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=87956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:35:21.282412 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-a4d812a0-5308-41e5-9ffd-051821e4be8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:35:21.327075 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530075ff-9277-4a39-821e-6cbd5315434e None None] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:21.327614 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530075ff-9277-4a39-821e-6cbd5315434e None None] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:21.327614 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530075ff-9277-4a39-821e-6cbd5315434e None None] PATH_INFO: `/` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:21.328850 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 105/207] 10.222.0.42 () {54 vars in 927 bytes} [Sun Oct 30 00:35:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 30 00:35:21.333798 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0c0409-d038-4628-8486-a0cf53487be4 None None] REQUEST_METHOD: `POST` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:21.334271 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0c0409-d038-4628-8486-a0cf53487be4 None None] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:21.334679 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0c0409-d038-4628-8486-a0cf53487be4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:21.341614 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=100 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:35:21.354183 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.auth.core [None req-0f0c0409-d038-4628-8486-a0cf53487be4 None None] MFA Rules not processed for user `eb55b6cbca4945abb21b0e49eb745e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=87955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:35:21.354626 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 103/208] 10.222.0.42 () {58 vars in 1024 bytes} [Sun Oct 30 00:35:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 30 00:35:21.355837 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-0f0c0409-d038-4628-8486-a0cf53487be4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:35:21.427725 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 106/209] 10.222.0.42 () {58 vars in 1024 bytes} [Sun Oct 30 00:35:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 30 00:35:21.498770 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8037601c-2ab9-4a87-9330-2d010061ac8a None None] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:21.499131 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8037601c-2ab9-4a87-9330-2d010061ac8a None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:21.499352 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8037601c-2ab9-4a87-9330-2d010061ac8a None None] PATH_INFO: `/` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:21.501025 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 104/210] 10.222.0.42 () {54 vars in 927 bytes} [Sun Oct 30 00:35:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:35:21.506158 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ff1a08-ff5a-44d3-80ab-5279ef3a6f5d None None] REQUEST_METHOD: `POST` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:21.506445 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ff1a08-ff5a-44d3-80ab-5279ef3a6f5d None None] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:21.506719 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ff1a08-ff5a-44d3-80ab-5279ef3a6f5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:21.525503 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.auth.core [None req-b9ff1a08-ff5a-44d3-80ab-5279ef3a6f5d None None] MFA Rules not processed for user `eb55b6cbca4945abb21b0e49eb745e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=87955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:35:21.526682 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-b9ff1a08-ff5a-44d3-80ab-5279ef3a6f5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:35:21.594316 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 107/211] 10.222.0.42 () {58 vars in 1024 bytes} [Sun Oct 30 00:35:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 30 00:35:21.615985 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8037601c-2ab9-4a87-9330-2d010061ac8a None None] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:35:21.688594 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ff1a08-ff5a-44d3-80ab-5279ef3a6f5d None None] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:35:21.721180 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8037601c-2ab9-4a87-9330-2d010061ac8a None None] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:35:21.748364 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=100 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:35:21.756970 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfdbc73-6b3f-4e0c-9a63-f05b41df631d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:35:21.757606 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfdbc73-6b3f-4e0c-9a63-f05b41df631d None admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:21.757884 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfdbc73-6b3f-4e0c-9a63-f05b41df631d None admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:21.758153 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfdbc73-6b3f-4e0c-9a63-f05b41df631d None admin] PATH_INFO: `/v3/roles/member` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:21.760898 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=100 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:35:21.770011 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfdbc73-6b3f-4e0c-9a63-f05b41df631d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 30 00:35:21.774879 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application [None req-6bfdbc73-6b3f-4e0c-9a63-f05b41df631d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 30 00:35:21.774879 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:35:21.774879 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:35:21.774879 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:35:21.774879 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:35:21.774879 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:35:21.774879 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:35:21.774879 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:35:21.774879 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:35:21.774879 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:35:21.774879 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:35:21.774879 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:35:21.774879 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 30 00:35:21.774879 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 30 00:35:21.774879 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 30 00:35:21.774879 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 30 00:35:21.775998 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 30 00:35:21.775998 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 30 00:35:21.775998 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 30 00:35:21.775998 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 30 00:35:21.775998 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:35:21.775998 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:35:21.775998 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:35:21.775998 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:35:21.775998 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:35:21.775998 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:35:21.775998 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:35:21.775998 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application with Lock( Oct 30 00:35:21.775998 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:35:21.775998 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:35:21.775998 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:35:21.775998 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:35:21.776863 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:35:21.776863 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:35:21.776863 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:35:21.776863 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:35:21.776863 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 30 00:35:21.776863 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 30 00:35:21.776863 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 30 00:35:21.776863 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 30 00:35:21.776863 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 30 00:35:21.776863 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 30 00:35:21.776863 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 30 00:35:21.776863 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application Oct 30 00:35:21.776863 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 105/212] 10.222.0.42 () {56 vars in 1099 bytes} [Sun Oct 30 00:35:21 2022] GET /identity/v3/roles/member => generated 84 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:35:21.781894 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfdbc73-6b3f-4e0c-9a63-f05b41df631d None admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:35:21.794652 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ff1a08-ff5a-44d3-80ab-5279ef3a6f5d None None] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:35:21.829903 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896cd230-a967-4e90-bf2a-b68055a0bcd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:35:21.830548 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896cd230-a967-4e90-bf2a-b68055a0bcd3 None admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:21.830845 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896cd230-a967-4e90-bf2a-b68055a0bcd3 None admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:21.831143 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896cd230-a967-4e90-bf2a-b68055a0bcd3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:21.832255 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896cd230-a967-4e90-bf2a-b68055a0bcd3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:35:21.833681 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896cd230-a967-4e90-bf2a-b68055a0bcd3 None admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:35:21.835513 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 108/213] 10.222.0.42 () {56 vars in 1108 bytes} [Sun Oct 30 00:35:21 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:35:21.840985 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896cd230-a967-4e90-bf2a-b68055a0bcd3 None admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:35:21.899573 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfdbc73-6b3f-4e0c-9a63-f05b41df631d None admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:35:21.934265 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf35267-2797-4bc6-8c9d-ac0f40142787 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:35:21.934880 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf35267-2797-4bc6-8c9d-ac0f40142787 None admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:21.935303 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf35267-2797-4bc6-8c9d-ac0f40142787 None admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:21.935427 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf35267-2797-4bc6-8c9d-ac0f40142787 None admin] PATH_INFO: `/v3/roles` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:21.936228 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf35267-2797-4bc6-8c9d-ac0f40142787 None admin] RBAC: Adding query filter params (name=member) {{(pid=87956) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:35:21.936529 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf35267-2797-4bc6-8c9d-ac0f40142787 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:35:21.937919 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf35267-2797-4bc6-8c9d-ac0f40142787 None admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:35:21.941766 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896cd230-a967-4e90-bf2a-b68055a0bcd3 None admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:35:21.950223 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 106/214] 10.222.0.42 () {56 vars in 1101 bytes} [Sun Oct 30 00:35:21 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:35:21.951025 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf35267-2797-4bc6-8c9d-ac0f40142787 None admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:35:21.971914 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=100 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:35:21.978354 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f916a0-6535-4fe6-acb4-8db3a7d35ddc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:35:21.978957 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f916a0-6535-4fe6-acb4-8db3a7d35ddc None admin] REQUEST_METHOD: `POST` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:21.979265 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f916a0-6535-4fe6-acb4-8db3a7d35ddc None admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:21.979535 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f916a0-6535-4fe6-acb4-8db3a7d35ddc None admin] PATH_INFO: `/v3/users` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:21.980188 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f916a0-6535-4fe6-acb4-8db3a7d35ddc None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:35:21.981626 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f916a0-6535-4fe6-acb4-8db3a7d35ddc None admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:35:22.003244 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 109/215] 10.222.0.42 () {60 vars in 1132 bytes} [Sun Oct 30 00:35:21 2022] POST /identity/v3/users => generated 293 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 00:35:22.004050 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f916a0-6535-4fe6-acb4-8db3a7d35ddc None admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:35:22.018409 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=100 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:35:22.066086 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf35267-2797-4bc6-8c9d-ac0f40142787 None admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:35:22.105835 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69f16e0-a960-4745-bf6f-8c216dc2e462 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:35:22.106496 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69f16e0-a960-4745-bf6f-8c216dc2e462 None admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:22.106776 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69f16e0-a960-4745-bf6f-8c216dc2e462 None admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:22.107049 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69f16e0-a960-4745-bf6f-8c216dc2e462 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:22.118693 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69f16e0-a960-4745-bf6f-8c216dc2e462 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 30 00:35:22.124169 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application [None req-d69f16e0-a960-4745-bf6f-8c216dc2e462 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 30 00:35:22.124169 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:35:22.124169 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:35:22.124169 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:35:22.124169 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:35:22.124169 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:35:22.124169 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:35:22.124169 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:35:22.124169 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:35:22.124169 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:35:22.124169 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:35:22.124169 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:35:22.124169 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 30 00:35:22.124169 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 30 00:35:22.124169 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 30 00:35:22.124169 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 30 00:35:22.125287 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 30 00:35:22.125287 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 30 00:35:22.125287 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 30 00:35:22.125287 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 30 00:35:22.125287 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:35:22.125287 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:35:22.125287 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:35:22.125287 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:35:22.125287 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:35:22.125287 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:35:22.125287 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:35:22.125287 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application with Lock( Oct 30 00:35:22.125287 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:35:22.125287 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:35:22.125287 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:35:22.125287 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:35:22.126139 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:35:22.126139 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:35:22.126139 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:35:22.126139 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:35:22.126139 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 30 00:35:22.126139 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 30 00:35:22.126139 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 30 00:35:22.126139 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 30 00:35:22.126139 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 30 00:35:22.126139 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 30 00:35:22.126139 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 30 00:35:22.126139 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application Oct 30 00:35:22.126139 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 107/216] 10.222.0.42 () {56 vars in 1099 bytes} [Sun Oct 30 00:35:21 2022] GET /identity/v3/roles/reader => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:35:22.131518 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69f16e0-a960-4745-bf6f-8c216dc2e462 None admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:35:22.136024 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f916a0-6535-4fe6-acb4-8db3a7d35ddc None admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:35:22.175874 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c57102-10c2-46cf-9810-830265e0d752 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:35:22.176433 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c57102-10c2-46cf-9810-830265e0d752 None admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:22.176710 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c57102-10c2-46cf-9810-830265e0d752 None admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:22.177339 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c57102-10c2-46cf-9810-830265e0d752 None admin] PATH_INFO: `/v3/users/33aad194404240c3b539965c05af86c7` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:22.195520 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c57102-10c2-46cf-9810-830265e0d752 None admin] RBAC: Authorizing `identity:get_user(user_id=33aad194404240c3b539965c05af86c7)` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:35:22.196227 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c57102-10c2-46cf-9810-830265e0d752 None admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:35:22.197931 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 110/217] 10.222.0.42 () {56 vars in 1177 bytes} [Sun Oct 30 00:35:22 2022] GET /identity/v3/users/33aad194404240c3b539965c05af86c7 => generated 293 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:35:22.203675 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c57102-10c2-46cf-9810-830265e0d752 None admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:35:22.244121 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69f16e0-a960-4745-bf6f-8c216dc2e462 None admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:35:22.259531 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:35:22.266211 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=100 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:35:22.286032 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1209c513-1194-455c-bbb4-5f2b193ab1c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:35:22.286569 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1209c513-1194-455c-bbb4-5f2b193ab1c9 None admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:22.286844 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1209c513-1194-455c-bbb4-5f2b193ab1c9 None admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:22.287145 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1209c513-1194-455c-bbb4-5f2b193ab1c9 None admin] PATH_INFO: `/v3/roles` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:22.288116 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1209c513-1194-455c-bbb4-5f2b193ab1c9 None admin] RBAC: Adding query filter params (name=reader) {{(pid=87956) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:35:22.289014 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1209c513-1194-455c-bbb4-5f2b193ab1c9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:35:22.290731 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1209c513-1194-455c-bbb4-5f2b193ab1c9 None admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:35:22.302432 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 108/218] 10.222.0.42 () {56 vars in 1101 bytes} [Sun Oct 30 00:35:22 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 30 00:35:22.309398 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1209c513-1194-455c-bbb4-5f2b193ab1c9 None admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:35:22.331588 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c57102-10c2-46cf-9810-830265e0d752 None admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:35:22.382735 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6474d2cf-8fee-4fbf-b803-e2c31d9abd34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:35:22.383646 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6474d2cf-8fee-4fbf-b803-e2c31d9abd34 None admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:22.383927 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6474d2cf-8fee-4fbf-b803-e2c31d9abd34 None admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:22.384695 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6474d2cf-8fee-4fbf-b803-e2c31d9abd34 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:22.385454 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6474d2cf-8fee-4fbf-b803-e2c31d9abd34 None admin] RBAC: Adding query filter params (role.id=1c93019874174c4b91118d9ce2347e47, user.id=33aad194404240c3b539965c05af86c7, scope.system=all) {{(pid=87955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:35:22.386037 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6474d2cf-8fee-4fbf-b803-e2c31d9abd34 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:35:22.391642 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6474d2cf-8fee-4fbf-b803-e2c31d9abd34 None admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:35:22.397928 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 111/219] 10.222.0.42 () {56 vars in 1308 bytes} [Sun Oct 30 00:35:22 2022] GET /identity/v3/role_assignments?user.id=33aad194404240c3b539965c05af86c7&scope.system=all&role.id=1c93019874174c4b91118d9ce2347e47 => generated 226 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:35:22.422256 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1209c513-1194-455c-bbb4-5f2b193ab1c9 None admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:35:22.462493 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43de6215-b66b-4cb5-ad44-4513ac269018 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:35:22.463075 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43de6215-b66b-4cb5-ad44-4513ac269018 None admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:22.463387 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43de6215-b66b-4cb5-ad44-4513ac269018 None admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:22.463653 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43de6215-b66b-4cb5-ad44-4513ac269018 None admin] PATH_INFO: `/v3/users/5ac4353dab7846308a8ab2f27cf010ef` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:22.464980 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43de6215-b66b-4cb5-ad44-4513ac269018 None admin] RBAC: Authorizing `identity:get_user(user_id=5ac4353dab7846308a8ab2f27cf010ef)` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:35:22.466480 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43de6215-b66b-4cb5-ad44-4513ac269018 None admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:35:22.468690 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 109/220] 10.222.0.42 () {56 vars in 1177 bytes} [Sun Oct 30 00:35:22 2022] GET /identity/v3/users/5ac4353dab7846308a8ab2f27cf010ef => generated 297 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 30 00:35:22.474232 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6474d2cf-8fee-4fbf-b803-e2c31d9abd34 None admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:35:22.586134 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6474d2cf-8fee-4fbf-b803-e2c31d9abd34 None admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:35:22.597348 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=100 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:35:22.625854 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766bd290-12d6-4acb-94e0-b2d49eb4df48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:35:22.626585 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766bd290-12d6-4acb-94e0-b2d49eb4df48 None admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:22.626991 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766bd290-12d6-4acb-94e0-b2d49eb4df48 None admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:22.627314 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766bd290-12d6-4acb-94e0-b2d49eb4df48 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:22.699801 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766bd290-12d6-4acb-94e0-b2d49eb4df48 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:35:22.701270 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766bd290-12d6-4acb-94e0-b2d49eb4df48 None admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:35:22.806150 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 112/221] 10.222.0.42 () {58 vars in 1282 bytes} [Sun Oct 30 00:35:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 30 00:35:22.812292 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43de6215-b66b-4cb5-ad44-4513ac269018 None admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:35:22.862634 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=100 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:35:22.922300 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43de6215-b66b-4cb5-ad44-4513ac269018 None admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:35:22.957447 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7bc82b-3016-434a-933a-87c4d343d1b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:35:22.958092 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7bc82b-3016-434a-933a-87c4d343d1b6 None admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:22.958447 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7bc82b-3016-434a-933a-87c4d343d1b6 None admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:22.958714 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7bc82b-3016-434a-933a-87c4d343d1b6 None admin] PATH_INFO: `/v3/projects/0ca99d2d3e3d4195b47b4479559371ef` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:22.959877 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7bc82b-3016-434a-933a-87c4d343d1b6 None admin] RBAC: Authorizing `identity:get_project(project_id=0ca99d2d3e3d4195b47b4479559371ef)` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:35:22.961679 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7bc82b-3016-434a-933a-87c4d343d1b6 None admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:35:22.963645 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 110/222] 10.222.0.42 () {56 vars in 1186 bytes} [Sun Oct 30 00:35:22 2022] GET /identity/v3/projects/0ca99d2d3e3d4195b47b4479559371ef => generated 302 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:35:22.969464 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766bd290-12d6-4acb-94e0-b2d49eb4df48 None admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:35:22.980063 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=100 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:35:23.079014 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766bd290-12d6-4acb-94e0-b2d49eb4df48 None admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:35:23.114520 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c0ec06-760c-4a5c-a42a-e20459807c0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:35:23.115150 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c0ec06-760c-4a5c-a42a-e20459807c0d None admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:23.115450 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c0ec06-760c-4a5c-a42a-e20459807c0d None admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:23.115717 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c0ec06-760c-4a5c-a42a-e20459807c0d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:23.116448 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c0ec06-760c-4a5c-a42a-e20459807c0d None admin] RBAC: Adding query filter params (role.id=992ffb31c434469696dce212bcf0cebc, scope.project.id=0ca99d2d3e3d4195b47b4479559371ef, user.id=5ac4353dab7846308a8ab2f27cf010ef) {{(pid=87955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:35:23.116749 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c0ec06-760c-4a5c-a42a-e20459807c0d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:35:23.118196 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c0ec06-760c-4a5c-a42a-e20459807c0d None admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:35:23.124963 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 113/223] 10.222.0.42 () {56 vars in 1374 bytes} [Sun Oct 30 00:35:22 2022] GET /identity/v3/role_assignments?user.id=5ac4353dab7846308a8ab2f27cf010ef&scope.project.id=0ca99d2d3e3d4195b47b4479559371ef&role.id=992ffb31c434469696dce212bcf0cebc => generated 608 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:35:24.337949 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4968f31f-4c70-4c47-a908-9021cadb9ad5 None None] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:24.338487 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4968f31f-4c70-4c47-a908-9021cadb9ad5 None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:24.338487 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4968f31f-4c70-4c47-a908-9021cadb9ad5 None None] PATH_INFO: `/` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:24.339965 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 111/224] 10.222.0.42 () {54 vars in 927 bytes} [Sun Oct 30 00:35:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:35:24.345202 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa10533-630c-4b67-acfe-0179eed26b6d None None] REQUEST_METHOD: `POST` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:24.345663 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa10533-630c-4b67-acfe-0179eed26b6d None None] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:24.345739 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa10533-630c-4b67-acfe-0179eed26b6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:24.364591 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.auth.core [None req-8aa10533-630c-4b67-acfe-0179eed26b6d None None] MFA Rules not processed for user `eb55b6cbca4945abb21b0e49eb745e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=87955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:35:24.365791 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-8aa10533-630c-4b67-acfe-0179eed26b6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:35:24.413848 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e23b94-91e8-4756-8923-a88b358a3094 None None] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:24.414145 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e23b94-91e8-4756-8923-a88b358a3094 None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:24.414686 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e23b94-91e8-4756-8923-a88b358a3094 None None] PATH_INFO: `/` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:24.416084 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 112/225] 10.222.0.42 () {54 vars in 927 bytes} [Sun Oct 30 00:35:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:35:24.421835 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e1c7b5-2c5a-4325-ad14-1200674f183d None None] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:24.422149 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e1c7b5-2c5a-4325-ad14-1200674f183d None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:24.422445 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e1c7b5-2c5a-4325-ad14-1200674f183d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:24.438603 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 114/226] 10.222.0.42 () {58 vars in 1024 bytes} [Sun Oct 30 00:35:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 30 00:35:24.440599 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.auth.core [None req-a7e1c7b5-2c5a-4325-ad14-1200674f183d None None] MFA Rules not processed for user `eb55b6cbca4945abb21b0e49eb745e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=87956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:35:24.441809 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-a7e1c7b5-2c5a-4325-ad14-1200674f183d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:35:24.511399 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 113/227] 10.222.0.42 () {58 vars in 1024 bytes} [Sun Oct 30 00:35:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 30 00:35:24.638770 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ff8bcc-0677-4b81-a44c-13d2de25fd7a None None] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:24.638968 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ff8bcc-0677-4b81-a44c-13d2de25fd7a None None] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:24.639252 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ff8bcc-0677-4b81-a44c-13d2de25fd7a None None] PATH_INFO: `/` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:24.640642 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 115/228] 10.222.0.42 () {54 vars in 927 bytes} [Sun Oct 30 00:35:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:35:24.646226 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148e0542-ddb1-421b-9c26-0e66ce8169db None None] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:24.646496 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148e0542-ddb1-421b-9c26-0e66ce8169db None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:24.646795 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148e0542-ddb1-421b-9c26-0e66ce8169db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:24.666089 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.auth.core [None req-148e0542-ddb1-421b-9c26-0e66ce8169db None None] MFA Rules not processed for user `eb55b6cbca4945abb21b0e49eb745e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=87956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:35:24.667329 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-148e0542-ddb1-421b-9c26-0e66ce8169db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:35:24.709720 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=100 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:35:24.712247 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ff8bcc-0677-4b81-a44c-13d2de25fd7a None None] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:35:24.715485 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=100 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:35:24.740277 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 114/229] 10.222.0.42 () {58 vars in 1024 bytes} [Sun Oct 30 00:35:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 30 00:35:24.781136 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148e0542-ddb1-421b-9c26-0e66ce8169db None None] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:35:24.837898 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ff8bcc-0677-4b81-a44c-13d2de25fd7a None None] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:35:24.875454 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c78c49d-573d-4afa-a57e-26c4db4fcf36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:35:24.876198 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c78c49d-573d-4afa-a57e-26c4db4fcf36 None admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:24.876473 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c78c49d-573d-4afa-a57e-26c4db4fcf36 None admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:24.876740 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c78c49d-573d-4afa-a57e-26c4db4fcf36 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:24.887292 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c78c49d-573d-4afa-a57e-26c4db4fcf36 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 30 00:35:24.887539 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148e0542-ddb1-421b-9c26-0e66ce8169db None None] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:35:24.892485 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application [None req-1c78c49d-573d-4afa-a57e-26c4db4fcf36 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 30 00:35:24.892485 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:35:24.892485 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:35:24.892485 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:35:24.892485 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:35:24.892485 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:35:24.892485 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:35:24.892485 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:35:24.892485 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:35:24.892485 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:35:24.892485 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:35:24.892485 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:35:24.892485 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 30 00:35:24.892485 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 30 00:35:24.892485 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 30 00:35:24.892485 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 30 00:35:24.893399 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 30 00:35:24.893399 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 30 00:35:24.893399 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 30 00:35:24.893399 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 30 00:35:24.893399 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:35:24.893399 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:35:24.893399 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:35:24.893399 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:35:24.893399 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:35:24.893399 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:35:24.893399 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:35:24.893399 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application with Lock( Oct 30 00:35:24.893399 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:35:24.893399 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:35:24.893399 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:35:24.893399 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:35:24.894826 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:35:24.894826 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:35:24.894826 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:35:24.894826 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:35:24.894826 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 30 00:35:24.894826 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 30 00:35:24.894826 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 30 00:35:24.894826 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 30 00:35:24.894826 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 30 00:35:24.894826 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 30 00:35:24.894826 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 30 00:35:24.894826 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application Oct 30 00:35:24.894826 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 116/230] 10.222.0.42 () {56 vars in 1099 bytes} [Sun Oct 30 00:35:24 2022] GET /identity/v3/roles/reader => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 30 00:35:24.899942 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c78c49d-573d-4afa-a57e-26c4db4fcf36 None admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:35:24.925967 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5043106a-36b3-4217-a7b0-f044acb98e7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:35:24.926616 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5043106a-36b3-4217-a7b0-f044acb98e7d None admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:24.926894 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5043106a-36b3-4217-a7b0-f044acb98e7d None admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:24.927161 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5043106a-36b3-4217-a7b0-f044acb98e7d None admin] PATH_INFO: `/v3/domains/default` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:24.928316 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5043106a-36b3-4217-a7b0-f044acb98e7d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:35:24.929859 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5043106a-36b3-4217-a7b0-f044acb98e7d None admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:35:24.931523 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 115/231] 10.222.0.42 () {56 vars in 1108 bytes} [Sun Oct 30 00:35:24 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 30 00:35:24.936705 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5043106a-36b3-4217-a7b0-f044acb98e7d None admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:35:24.966106 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=100 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:35:24.985268 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=100 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:35:25.012264 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c78c49d-573d-4afa-a57e-26c4db4fcf36 None admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:35:25.048206 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6955eb61-5bf6-4481-beab-6b4f43bd11d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:35:25.048842 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6955eb61-5bf6-4481-beab-6b4f43bd11d1 None admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:25.049138 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6955eb61-5bf6-4481-beab-6b4f43bd11d1 None admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:25.049405 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6955eb61-5bf6-4481-beab-6b4f43bd11d1 None admin] PATH_INFO: `/v3/roles` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:25.050077 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6955eb61-5bf6-4481-beab-6b4f43bd11d1 None admin] RBAC: Adding query filter params (name=reader) {{(pid=87955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:35:25.050374 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6955eb61-5bf6-4481-beab-6b4f43bd11d1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:35:25.051222 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5043106a-36b3-4217-a7b0-f044acb98e7d None admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:35:25.051797 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6955eb61-5bf6-4481-beab-6b4f43bd11d1 None admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:35:25.060105 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 117/232] 10.222.0.42 () {56 vars in 1101 bytes} [Sun Oct 30 00:35:24 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 30 00:35:25.065925 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6955eb61-5bf6-4481-beab-6b4f43bd11d1 None admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:35:25.086053 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c68f62-6c6e-4099-98bd-783697fc6772 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:35:25.086705 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c68f62-6c6e-4099-98bd-783697fc6772 None admin] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:25.086979 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c68f62-6c6e-4099-98bd-783697fc6772 None admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:25.087229 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c68f62-6c6e-4099-98bd-783697fc6772 None admin] PATH_INFO: `/v3/groups` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:25.087900 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c68f62-6c6e-4099-98bd-783697fc6772 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:35:25.089321 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c68f62-6c6e-4099-98bd-783697fc6772 None admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:35:25.119231 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 116/233] 10.222.0.42 () {60 vars in 1134 bytes} [Sun Oct 30 00:35:24 2022] POST /identity/v3/groups => generated 229 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 30 00:35:25.119231 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c68f62-6c6e-4099-98bd-783697fc6772 None admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:35:25.178613 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6955eb61-5bf6-4481-beab-6b4f43bd11d1 None admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:35:25.203921 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=100 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:35:25.215859 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8dca5ce-5044-4015-bdbb-716d8085de66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:35:25.216509 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8dca5ce-5044-4015-bdbb-716d8085de66 None admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:25.216782 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8dca5ce-5044-4015-bdbb-716d8085de66 None admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:25.217056 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8dca5ce-5044-4015-bdbb-716d8085de66 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:25.224320 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c68f62-6c6e-4099-98bd-783697fc6772 None admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:35:25.227317 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:35:25.228525 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8dca5ce-5044-4015-bdbb-716d8085de66 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 30 00:35:25.234082 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application [None req-b8dca5ce-5044-4015-bdbb-716d8085de66 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 30 00:35:25.234082 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:35:25.234082 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:35:25.234082 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:35:25.234082 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:35:25.234082 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:35:25.234082 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:35:25.234082 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:35:25.234082 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:35:25.234082 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:35:25.234082 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:35:25.234082 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:35:25.234082 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 30 00:35:25.234082 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 30 00:35:25.234082 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 30 00:35:25.234082 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 30 00:35:25.235502 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 30 00:35:25.235502 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 30 00:35:25.235502 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 30 00:35:25.235502 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 30 00:35:25.235502 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:35:25.235502 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:35:25.235502 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:35:25.235502 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:35:25.235502 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:35:25.235502 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:35:25.235502 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:35:25.235502 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application with Lock( Oct 30 00:35:25.235502 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:35:25.235502 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:35:25.235502 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:35:25.235502 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:35:25.236314 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:35:25.236314 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:35:25.236314 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:35:25.236314 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:35:25.236314 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 30 00:35:25.236314 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 30 00:35:25.236314 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 30 00:35:25.236314 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 30 00:35:25.236314 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 30 00:35:25.236314 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 30 00:35:25.236314 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 30 00:35:25.236314 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application Oct 30 00:35:25.236314 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 118/234] 10.222.0.42 () {56 vars in 1099 bytes} [Sun Oct 30 00:35:25 2022] GET /identity/v3/roles/member => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:35:25.241525 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8dca5ce-5044-4015-bdbb-716d8085de66 None admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:35:25.273341 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b43adc-1f2f-413c-b688-cfa497e7ce4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:35:25.273341 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b43adc-1f2f-413c-b688-cfa497e7ce4c None admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:25.273667 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b43adc-1f2f-413c-b688-cfa497e7ce4c None admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:25.273816 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b43adc-1f2f-413c-b688-cfa497e7ce4c None admin] PATH_INFO: `/v3/users/c878e410871641af84a2dc2d545a496b` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:25.289733 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b43adc-1f2f-413c-b688-cfa497e7ce4c None admin] RBAC: Authorizing `identity:get_user(user_id=c878e410871641af84a2dc2d545a496b)` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:35:25.291293 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b43adc-1f2f-413c-b688-cfa497e7ce4c None admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:35:25.293472 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 117/235] 10.222.0.42 () {56 vars in 1177 bytes} [Sun Oct 30 00:35:25 2022] GET /identity/v3/users/c878e410871641af84a2dc2d545a496b => generated 293 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:35:25.299909 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b43adc-1f2f-413c-b688-cfa497e7ce4c None admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:35:25.357930 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8dca5ce-5044-4015-bdbb-716d8085de66 None admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:35:25.395363 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f01b21-f489-411e-9df9-62c9a38de38e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:35:25.395939 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f01b21-f489-411e-9df9-62c9a38de38e None admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:25.396211 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f01b21-f489-411e-9df9-62c9a38de38e None admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:25.396478 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f01b21-f489-411e-9df9-62c9a38de38e None admin] PATH_INFO: `/v3/roles` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:25.397353 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f01b21-f489-411e-9df9-62c9a38de38e None admin] RBAC: Adding query filter params (name=member) {{(pid=87955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:35:25.397972 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f01b21-f489-411e-9df9-62c9a38de38e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:35:25.399699 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f01b21-f489-411e-9df9-62c9a38de38e None admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:35:25.406320 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b43adc-1f2f-413c-b688-cfa497e7ce4c None admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:35:25.414505 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 119/236] 10.222.0.42 () {56 vars in 1101 bytes} [Sun Oct 30 00:35:25 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:35:25.415552 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f01b21-f489-411e-9df9-62c9a38de38e None admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:35:25.442074 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d3ccbd-ad7f-43e5-b451-e3deebd2ea5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:35:25.442994 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d3ccbd-ad7f-43e5-b451-e3deebd2ea5e None admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:25.443294 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d3ccbd-ad7f-43e5-b451-e3deebd2ea5e None admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:25.443563 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d3ccbd-ad7f-43e5-b451-e3deebd2ea5e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:25.444298 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d3ccbd-ad7f-43e5-b451-e3deebd2ea5e None admin] RBAC: Adding query filter params (role.id=992ffb31c434469696dce212bcf0cebc, user.id=c878e410871641af84a2dc2d545a496b, scope.system=all) {{(pid=87956) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:35:25.444601 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d3ccbd-ad7f-43e5-b451-e3deebd2ea5e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:35:25.446041 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d3ccbd-ad7f-43e5-b451-e3deebd2ea5e None admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:35:25.452058 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 118/237] 10.222.0.42 () {56 vars in 1308 bytes} [Sun Oct 30 00:35:25 2022] GET /identity/v3/role_assignments?user.id=c878e410871641af84a2dc2d545a496b&scope.system=all&role.id=992ffb31c434469696dce212bcf0cebc => generated 226 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 30 00:35:25.466348 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=100 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:35:25.529530 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f01b21-f489-411e-9df9-62c9a38de38e None admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:35:25.567824 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3aaac53-6ad0-496e-8c66-3d6805f5f71e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:35:25.568469 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3aaac53-6ad0-496e-8c66-3d6805f5f71e None admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:25.568743 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3aaac53-6ad0-496e-8c66-3d6805f5f71e None admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:25.569007 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3aaac53-6ad0-496e-8c66-3d6805f5f71e None admin] PATH_INFO: `/v3/users/33aad194404240c3b539965c05af86c7` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:25.570146 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3aaac53-6ad0-496e-8c66-3d6805f5f71e None admin] RBAC: Authorizing `identity:get_user(user_id=33aad194404240c3b539965c05af86c7)` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:35:25.571633 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3aaac53-6ad0-496e-8c66-3d6805f5f71e None admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:35:25.573458 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 120/238] 10.222.0.42 () {56 vars in 1177 bytes} [Sun Oct 30 00:35:25 2022] GET /identity/v3/users/33aad194404240c3b539965c05af86c7 => generated 293 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 30 00:35:25.579487 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d3ccbd-ad7f-43e5-b451-e3deebd2ea5e None admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:35:25.610631 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=100 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:35:25.687099 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d3ccbd-ad7f-43e5-b451-e3deebd2ea5e None admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:35:25.722675 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4e342f-999f-42a0-93f8-93e7841d0711 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:35:25.723339 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4e342f-999f-42a0-93f8-93e7841d0711 None admin] REQUEST_METHOD: `PUT` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:25.723621 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4e342f-999f-42a0-93f8-93e7841d0711 None admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:25.723894 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4e342f-999f-42a0-93f8-93e7841d0711 None admin] PATH_INFO: `/v3/system/users/33aad194404240c3b539965c05af86c7/roles/1c93019874174c4b91118d9ce2347e47` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:25.725356 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4e342f-999f-42a0-93f8-93e7841d0711 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=33aad194404240c3b539965c05af86c7, role_id=1c93019874174c4b91118d9ce2347e47)` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:35:25.726791 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4e342f-999f-42a0-93f8-93e7841d0711 None admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:35:25.738272 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 119/239] 10.222.0.42 () {58 vars in 1334 bytes} [Sun Oct 30 00:35:25 2022] PUT /identity/v3/system/users/33aad194404240c3b539965c05af86c7/roles/1c93019874174c4b91118d9ce2347e47 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 00:35:27.374622 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb189fe-2489-4a5a-834a-ed45afbe913c None None] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:27.375155 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb189fe-2489-4a5a-834a-ed45afbe913c None None] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:27.375155 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb189fe-2489-4a5a-834a-ed45afbe913c None None] PATH_INFO: `/` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:27.376790 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 121/240] 10.222.0.42 () {54 vars in 927 bytes} [Sun Oct 30 00:35:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:35:27.382187 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c100c8-c3bf-4f7f-84b5-03c84c6cb06e None None] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:27.382587 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c100c8-c3bf-4f7f-84b5-03c84c6cb06e None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:27.382749 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c100c8-c3bf-4f7f-84b5-03c84c6cb06e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:27.401858 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.auth.core [None req-d4c100c8-c3bf-4f7f-84b5-03c84c6cb06e None None] MFA Rules not processed for user `eb55b6cbca4945abb21b0e49eb745e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=87956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:35:27.403134 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-d4c100c8-c3bf-4f7f-84b5-03c84c6cb06e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:35:27.474764 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 120/241] 10.222.0.42 () {58 vars in 1024 bytes} [Sun Oct 30 00:35:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 30 00:35:27.601906 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f675032-53be-4e1f-80b7-9df89ed4e2ff None None] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:27.602141 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f675032-53be-4e1f-80b7-9df89ed4e2ff None None] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:27.602413 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f675032-53be-4e1f-80b7-9df89ed4e2ff None None] PATH_INFO: `/` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:27.604016 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 122/242] 10.222.0.42 () {54 vars in 927 bytes} [Sun Oct 30 00:35:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:35:27.609464 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc73789a-e05b-4de6-b766-a18911c9e14a None None] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:27.609725 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc73789a-e05b-4de6-b766-a18911c9e14a None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:27.610023 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc73789a-e05b-4de6-b766-a18911c9e14a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:27.628732 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.auth.core [None req-cc73789a-e05b-4de6-b766-a18911c9e14a None None] MFA Rules not processed for user `eb55b6cbca4945abb21b0e49eb745e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=87956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:35:27.629858 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-cc73789a-e05b-4de6-b766-a18911c9e14a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:35:27.644938 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:35:27.699566 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 121/243] 10.222.0.42 () {58 vars in 1024 bytes} [Sun Oct 30 00:35:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 30 00:35:27.754746 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f675032-53be-4e1f-80b7-9df89ed4e2ff None None] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:35:27.868850 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f675032-53be-4e1f-80b7-9df89ed4e2ff None None] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:35:27.882672 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396b99cf-33c1-49d1-ad65-a3112a9910d5 None None] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:27.882957 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396b99cf-33c1-49d1-ad65-a3112a9910d5 None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:27.883325 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396b99cf-33c1-49d1-ad65-a3112a9910d5 None None] PATH_INFO: `/` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:27.884974 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 122/244] 10.222.0.42 () {54 vars in 927 bytes} [Sun Oct 30 00:35:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 30 00:35:27.888445 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=100 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:35:27.889993 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3c73df-2ffc-4945-8fec-ba2250a0e8a7 None None] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:27.890304 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3c73df-2ffc-4945-8fec-ba2250a0e8a7 None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:27.890571 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3c73df-2ffc-4945-8fec-ba2250a0e8a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:27.910196 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.auth.core [None req-2c3c73df-2ffc-4945-8fec-ba2250a0e8a7 None None] MFA Rules not processed for user `eb55b6cbca4945abb21b0e49eb745e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=87956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:35:27.910984 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4192752d-5ebe-4478-9c2f-92cac280b14a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:35:27.911419 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-2c3c73df-2ffc-4945-8fec-ba2250a0e8a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:35:27.911664 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4192752d-5ebe-4478-9c2f-92cac280b14a None admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:27.911939 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4192752d-5ebe-4478-9c2f-92cac280b14a None admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:27.912207 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4192752d-5ebe-4478-9c2f-92cac280b14a None admin] PATH_INFO: `/v3/domains/default` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:27.913327 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4192752d-5ebe-4478-9c2f-92cac280b14a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:35:27.914844 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4192752d-5ebe-4478-9c2f-92cac280b14a None admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:35:27.916689 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 123/245] 10.222.0.42 () {56 vars in 1108 bytes} [Sun Oct 30 00:35:27 2022] GET /identity/v3/domains/default => generated 199 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:35:27.922140 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4192752d-5ebe-4478-9c2f-92cac280b14a None admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:35:27.988248 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 123/246] 10.222.0.42 () {58 vars in 1024 bytes} [Sun Oct 30 00:35:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 30 00:35:27.989094 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3c73df-2ffc-4945-8fec-ba2250a0e8a7 None None] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:35:28.027086 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4192752d-5ebe-4478-9c2f-92cac280b14a None admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:35:28.065190 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5b784d-9c70-4fa6-b77b-292b7aebfd63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:35:28.067430 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5b784d-9c70-4fa6-b77b-292b7aebfd63 None admin] REQUEST_METHOD: `POST` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:28.067430 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5b784d-9c70-4fa6-b77b-292b7aebfd63 None admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:28.067430 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5b784d-9c70-4fa6-b77b-292b7aebfd63 None admin] PATH_INFO: `/v3/groups` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:28.067767 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5b784d-9c70-4fa6-b77b-292b7aebfd63 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:35:28.069160 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5b784d-9c70-4fa6-b77b-292b7aebfd63 None admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:35:28.083160 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=100 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:35:28.088098 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 124/247] 10.222.0.42 () {60 vars in 1134 bytes} [Sun Oct 30 00:35:27 2022] POST /identity/v3/groups => generated 226 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 30 00:35:28.105969 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3c73df-2ffc-4945-8fec-ba2250a0e8a7 None None] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:35:28.147302 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae0e5f2-e634-4a27-b14a-4df2996a18ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:35:28.147915 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae0e5f2-e634-4a27-b14a-4df2996a18ac None admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:28.148195 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae0e5f2-e634-4a27-b14a-4df2996a18ac None admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:28.148549 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae0e5f2-e634-4a27-b14a-4df2996a18ac None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:28.162552 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae0e5f2-e634-4a27-b14a-4df2996a18ac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 30 00:35:28.167955 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application [None req-3ae0e5f2-e634-4a27-b14a-4df2996a18ac None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 30 00:35:28.167955 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:35:28.167955 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:35:28.167955 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:35:28.167955 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:35:28.167955 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:35:28.167955 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:35:28.167955 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:35:28.167955 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:35:28.167955 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:35:28.167955 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:35:28.167955 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:35:28.167955 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 30 00:35:28.167955 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 30 00:35:28.167955 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 30 00:35:28.167955 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 30 00:35:28.168908 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 30 00:35:28.168908 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 30 00:35:28.168908 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 30 00:35:28.168908 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 30 00:35:28.168908 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:35:28.168908 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:35:28.168908 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:35:28.168908 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:35:28.168908 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:35:28.168908 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:35:28.168908 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:35:28.168908 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application with Lock( Oct 30 00:35:28.168908 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:35:28.168908 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:35:28.168908 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:35:28.168908 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:35:28.170610 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:35:28.170610 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:35:28.170610 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:35:28.170610 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:35:28.170610 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 30 00:35:28.170610 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 30 00:35:28.170610 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 30 00:35:28.170610 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 30 00:35:28.170610 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 30 00:35:28.170610 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 30 00:35:28.170610 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 30 00:35:28.170610 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application Oct 30 00:35:28.170610 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 124/248] 10.222.0.42 () {56 vars in 1099 bytes} [Sun Oct 30 00:35:27 2022] GET /identity/v3/roles/reader => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:35:28.175496 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5b784d-9c70-4fa6-b77b-292b7aebfd63 None admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:35:28.226035 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:35:28.255509 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae0e5f2-e634-4a27-b14a-4df2996a18ac None admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:35:28.291246 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5b784d-9c70-4fa6-b77b-292b7aebfd63 None admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:35:28.330124 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33214db-b945-4d47-bb3b-090fcfccb6fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:35:28.330758 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33214db-b945-4d47-bb3b-090fcfccb6fb None admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:28.331037 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33214db-b945-4d47-bb3b-090fcfccb6fb None admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:28.331341 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33214db-b945-4d47-bb3b-090fcfccb6fb None admin] PATH_INFO: `/v3/roles` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:28.332034 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33214db-b945-4d47-bb3b-090fcfccb6fb None admin] RBAC: Adding query filter params (name=reader) {{(pid=87955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:35:28.332383 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33214db-b945-4d47-bb3b-090fcfccb6fb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:35:28.333832 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33214db-b945-4d47-bb3b-090fcfccb6fb None admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:35:28.345750 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 125/249] 10.222.0.42 () {56 vars in 1101 bytes} [Sun Oct 30 00:35:28 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:35:28.349460 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33214db-b945-4d47-bb3b-090fcfccb6fb None admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:35:28.380164 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae0e5f2-e634-4a27-b14a-4df2996a18ac None admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:35:28.423726 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa486de-5050-47fb-9804-e866d4f96b60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:35:28.424364 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa486de-5050-47fb-9804-e866d4f96b60 None admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:28.424554 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa486de-5050-47fb-9804-e866d4f96b60 None admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:28.424847 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa486de-5050-47fb-9804-e866d4f96b60 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:28.434221 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=100 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:35:28.438719 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa486de-5050-47fb-9804-e866d4f96b60 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 30 00:35:28.443609 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application [None req-afa486de-5050-47fb-9804-e866d4f96b60 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 30 00:35:28.443609 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:35:28.443609 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:35:28.443609 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:35:28.443609 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:35:28.443609 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:35:28.443609 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:35:28.443609 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:35:28.443609 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:35:28.443609 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:35:28.443609 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:35:28.443609 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:35:28.443609 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 30 00:35:28.443609 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 30 00:35:28.443609 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 30 00:35:28.443609 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 30 00:35:28.444481 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 30 00:35:28.444481 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 30 00:35:28.444481 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 30 00:35:28.444481 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 30 00:35:28.444481 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:35:28.444481 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:35:28.444481 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:35:28.444481 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:35:28.444481 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:35:28.444481 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:35:28.444481 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:35:28.444481 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application with Lock( Oct 30 00:35:28.444481 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:35:28.444481 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:35:28.444481 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:35:28.444481 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:35:28.445271 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:35:28.445271 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:35:28.445271 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:35:28.445271 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:35:28.445271 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 30 00:35:28.445271 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 30 00:35:28.445271 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 30 00:35:28.445271 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 30 00:35:28.445271 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 30 00:35:28.445271 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 30 00:35:28.445271 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 30 00:35:28.445271 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application Oct 30 00:35:28.445271 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 125/250] 10.222.0.42 () {56 vars in 1099 bytes} [Sun Oct 30 00:35:28 2022] GET /identity/v3/roles/member => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:35:28.450833 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa486de-5050-47fb-9804-e866d4f96b60 None admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:35:28.478921 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33214db-b945-4d47-bb3b-090fcfccb6fb None admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:35:28.481449 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=100 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:35:28.518511 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e575b5e0-8e32-42e9-b956-1bd6ea25e069 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:35:28.519158 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e575b5e0-8e32-42e9-b956-1bd6ea25e069 None admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:28.519583 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e575b5e0-8e32-42e9-b956-1bd6ea25e069 None admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:28.519738 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e575b5e0-8e32-42e9-b956-1bd6ea25e069 None admin] PATH_INFO: `/v3/users/c878e410871641af84a2dc2d545a496b` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:28.521786 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e575b5e0-8e32-42e9-b956-1bd6ea25e069 None admin] RBAC: Authorizing `identity:get_user(user_id=c878e410871641af84a2dc2d545a496b)` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:35:28.523292 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e575b5e0-8e32-42e9-b956-1bd6ea25e069 None admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:35:28.524929 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 126/251] 10.222.0.42 () {56 vars in 1177 bytes} [Sun Oct 30 00:35:28 2022] GET /identity/v3/users/c878e410871641af84a2dc2d545a496b => generated 293 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:35:28.532061 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e575b5e0-8e32-42e9-b956-1bd6ea25e069 None admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:35:28.594791 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa486de-5050-47fb-9804-e866d4f96b60 None admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:35:28.640750 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef35f6ae-2217-4028-b16c-0f2107873a43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:35:28.642170 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef35f6ae-2217-4028-b16c-0f2107873a43 None admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:28.642664 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef35f6ae-2217-4028-b16c-0f2107873a43 None admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:28.643107 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef35f6ae-2217-4028-b16c-0f2107873a43 None admin] PATH_INFO: `/v3/roles` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:28.643997 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef35f6ae-2217-4028-b16c-0f2107873a43 None admin] RBAC: Adding query filter params (name=member) {{(pid=87956) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:35:28.644855 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef35f6ae-2217-4028-b16c-0f2107873a43 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:35:28.647057 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef35f6ae-2217-4028-b16c-0f2107873a43 None admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:35:28.660187 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 126/252] 10.222.0.42 () {56 vars in 1101 bytes} [Sun Oct 30 00:35:28 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 30 00:35:28.670151 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef35f6ae-2217-4028-b16c-0f2107873a43 None admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:35:28.678927 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e575b5e0-8e32-42e9-b956-1bd6ea25e069 None admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:35:28.723878 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe63d587-316f-4d59-939a-8bbc1455579a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:35:28.724582 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe63d587-316f-4d59-939a-8bbc1455579a None admin] REQUEST_METHOD: `PUT` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:28.724866 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe63d587-316f-4d59-939a-8bbc1455579a None admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:28.725146 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe63d587-316f-4d59-939a-8bbc1455579a None admin] PATH_INFO: `/v3/system/users/c878e410871641af84a2dc2d545a496b/roles/992ffb31c434469696dce212bcf0cebc` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:28.726582 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe63d587-316f-4d59-939a-8bbc1455579a None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=c878e410871641af84a2dc2d545a496b, role_id=992ffb31c434469696dce212bcf0cebc)` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:35:28.728011 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe63d587-316f-4d59-939a-8bbc1455579a None admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:35:28.738431 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=100 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:35:28.740025 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 127/253] 10.222.0.42 () {58 vars in 1334 bytes} [Sun Oct 30 00:35:28 2022] PUT /identity/v3/system/users/c878e410871641af84a2dc2d545a496b/roles/992ffb31c434469696dce212bcf0cebc => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 00:35:28.792629 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef35f6ae-2217-4028-b16c-0f2107873a43 None admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:35:28.833432 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e14820-443d-4441-aa3d-3236b28745dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:35:28.834488 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e14820-443d-4441-aa3d-3236b28745dd None admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:28.834764 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e14820-443d-4441-aa3d-3236b28745dd None admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:28.835078 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e14820-443d-4441-aa3d-3236b28745dd None admin] PATH_INFO: `/v3/users/33aad194404240c3b539965c05af86c7` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:28.836452 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e14820-443d-4441-aa3d-3236b28745dd None admin] RBAC: Authorizing `identity:get_user(user_id=33aad194404240c3b539965c05af86c7)` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:35:28.838058 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e14820-443d-4441-aa3d-3236b28745dd None admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:35:28.840126 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 127/254] 10.222.0.42 () {56 vars in 1177 bytes} [Sun Oct 30 00:35:28 2022] GET /identity/v3/users/33aad194404240c3b539965c05af86c7 => generated 293 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 30 00:35:28.846146 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe63d587-316f-4d59-939a-8bbc1455579a None admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:35:28.887212 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:35:28.968989 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe63d587-316f-4d59-939a-8bbc1455579a None admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:35:29.006877 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aace423-934e-4dcc-bb01-8b7b772aa8b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:35:29.007546 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aace423-934e-4dcc-bb01-8b7b772aa8b6 None admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:29.007824 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aace423-934e-4dcc-bb01-8b7b772aa8b6 None admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:29.008089 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aace423-934e-4dcc-bb01-8b7b772aa8b6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:29.008818 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aace423-934e-4dcc-bb01-8b7b772aa8b6 None admin] RBAC: Adding query filter params (role.id=1c93019874174c4b91118d9ce2347e47, user.id=33aad194404240c3b539965c05af86c7, scope.system=all) {{(pid=87955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:35:29.009132 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aace423-934e-4dcc-bb01-8b7b772aa8b6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:35:29.010596 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aace423-934e-4dcc-bb01-8b7b772aa8b6 None admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:35:29.025114 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 128/255] 10.222.0.42 () {56 vars in 1308 bytes} [Sun Oct 30 00:35:28 2022] GET /identity/v3/role_assignments?user.id=33aad194404240c3b539965c05af86c7&scope.system=all&role.id=1c93019874174c4b91118d9ce2347e47 => generated 510 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 30 00:35:30.602537 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f21fa3-dd7e-447e-906e-376c6e11aa23 None None] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:30.603082 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f21fa3-dd7e-447e-906e-376c6e11aa23 None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:30.603082 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f21fa3-dd7e-447e-906e-376c6e11aa23 None None] PATH_INFO: `/` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:30.604649 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 128/256] 10.222.0.42 () {54 vars in 927 bytes} [Sun Oct 30 00:35:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:35:30.610703 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e771779-9eb2-439a-aa17-ab5721dbaad5 None None] REQUEST_METHOD: `POST` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:30.611120 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e771779-9eb2-439a-aa17-ab5721dbaad5 None None] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:30.611335 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e771779-9eb2-439a-aa17-ab5721dbaad5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:30.631058 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.auth.core [None req-7e771779-9eb2-439a-aa17-ab5721dbaad5 None None] MFA Rules not processed for user `eb55b6cbca4945abb21b0e49eb745e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=87955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:35:30.632440 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-7e771779-9eb2-439a-aa17-ab5721dbaad5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:35:30.705017 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 129/257] 10.222.0.42 () {58 vars in 1024 bytes} [Sun Oct 30 00:35:30 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Oct 30 00:35:30.985836 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f21fa3-dd7e-447e-906e-376c6e11aa23 None None] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:35:31.000285 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f21fa3-dd7e-447e-906e-376c6e11aa23 None None] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:35:31.005195 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed54698-8ccd-4047-bfbd-4fc6ac17b1ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:35:31.005831 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed54698-8ccd-4047-bfbd-4fc6ac17b1ae admin admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:31.006105 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed54698-8ccd-4047-bfbd-4fc6ac17b1ae admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:31.006368 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed54698-8ccd-4047-bfbd-4fc6ac17b1ae admin admin] PATH_INFO: `/v3/roles/member` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:31.018128 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed54698-8ccd-4047-bfbd-4fc6ac17b1ae admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 30 00:35:31.023014 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application [None req-5ed54698-8ccd-4047-bfbd-4fc6ac17b1ae admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 30 00:35:31.023014 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:35:31.023014 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:35:31.023014 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:35:31.023014 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:35:31.023014 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:35:31.023014 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:35:31.023014 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:35:31.023014 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:35:31.023014 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:35:31.023014 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:35:31.023014 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:35:31.023014 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 30 00:35:31.023014 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 30 00:35:31.023014 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 30 00:35:31.023014 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 30 00:35:31.023952 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 30 00:35:31.023952 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 30 00:35:31.023952 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 30 00:35:31.023952 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 30 00:35:31.023952 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:35:31.023952 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:35:31.023952 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:35:31.023952 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:35:31.023952 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:35:31.023952 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:35:31.023952 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:35:31.023952 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application with Lock( Oct 30 00:35:31.023952 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:35:31.023952 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:35:31.023952 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:35:31.023952 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:35:31.024761 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:35:31.024761 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:35:31.024761 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:35:31.024761 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:35:31.024761 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 30 00:35:31.024761 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 30 00:35:31.024761 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 30 00:35:31.024761 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 30 00:35:31.024761 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 30 00:35:31.024761 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 30 00:35:31.024761 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 30 00:35:31.024761 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application Oct 30 00:35:31.026832 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 129/258] 10.222.0.42 () {56 vars in 1120 bytes} [Sun Oct 30 00:35:30 2022] GET /identity/v3/roles/member => generated 84 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:35:31.032931 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e771779-9eb2-439a-aa17-ab5721dbaad5 None None] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:35:31.043088 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e771779-9eb2-439a-aa17-ab5721dbaad5 None None] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:35:31.047656 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9230019-9002-4a4d-ba55-fa582c9dbef6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:35:31.048302 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9230019-9002-4a4d-ba55-fa582c9dbef6 admin admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:31.048575 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9230019-9002-4a4d-ba55-fa582c9dbef6 admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:31.048844 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9230019-9002-4a4d-ba55-fa582c9dbef6 admin admin] PATH_INFO: `/v3/roles` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:31.049530 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9230019-9002-4a4d-ba55-fa582c9dbef6 admin admin] RBAC: Adding query filter params (name=member) {{(pid=87955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:35:31.049818 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9230019-9002-4a4d-ba55-fa582c9dbef6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:35:31.051703 dv-cinder-861491-6-smb devstack@keystone.service[87955]: WARNING py.warnings [None req-a9230019-9002-4a4d-ba55-fa582c9dbef6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 30 00:35:31.051703 dv-cinder-861491-6-smb devstack@keystone.service[87955]: warnings.warn(msg) Oct 30 00:35:31.051703 dv-cinder-861491-6-smb devstack@keystone.service[87955]: Oct 30 00:35:31.052685 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9230019-9002-4a4d-ba55-fa582c9dbef6 admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:35:31.065935 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 130/259] 10.222.0.42 () {56 vars in 1122 bytes} [Sun Oct 30 00:35:31 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:35:31.071921 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed54698-8ccd-4047-bfbd-4fc6ac17b1ae admin admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:35:31.084668 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed54698-8ccd-4047-bfbd-4fc6ac17b1ae admin admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:35:31.089085 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e46d7a-9e34-471c-be7a-d63bdf17a5a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:35:31.089721 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e46d7a-9e34-471c-be7a-d63bdf17a5a4 admin admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:31.089989 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e46d7a-9e34-471c-be7a-d63bdf17a5a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:31.090252 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e46d7a-9e34-471c-be7a-d63bdf17a5a4 admin admin] PATH_INFO: `/v3/groups/65f1096068354e63897b038ecbeeffc7` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:31.097031 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e46d7a-9e34-471c-be7a-d63bdf17a5a4 admin admin] RBAC: Authorizing `identity:get_group(group_id=65f1096068354e63897b038ecbeeffc7)` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:35:31.098911 dv-cinder-861491-6-smb devstack@keystone.service[87956]: WARNING py.warnings [None req-e5e46d7a-9e34-471c-be7a-d63bdf17a5a4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 30 00:35:31.098911 dv-cinder-861491-6-smb devstack@keystone.service[87956]: warnings.warn(msg) Oct 30 00:35:31.098911 dv-cinder-861491-6-smb devstack@keystone.service[87956]: Oct 30 00:35:31.100175 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e46d7a-9e34-471c-be7a-d63bdf17a5a4 admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:35:31.102081 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 130/260] 10.222.0.42 () {56 vars in 1201 bytes} [Sun Oct 30 00:35:31 2022] GET /identity/v3/groups/65f1096068354e63897b038ecbeeffc7 => generated 226 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:35:31.107668 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9230019-9002-4a4d-ba55-fa582c9dbef6 admin admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:35:31.119026 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9230019-9002-4a4d-ba55-fa582c9dbef6 admin admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:35:31.123618 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd38f51e-7dce-4b32-9ab2-125085b85738 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:35:31.124302 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd38f51e-7dce-4b32-9ab2-125085b85738 admin admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:31.124576 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd38f51e-7dce-4b32-9ab2-125085b85738 admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:31.124844 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd38f51e-7dce-4b32-9ab2-125085b85738 admin admin] PATH_INFO: `/v3/projects/cbc9734c46db44918000791ce8bbb4e8` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:31.125951 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd38f51e-7dce-4b32-9ab2-125085b85738 admin admin] RBAC: Authorizing `identity:get_project(project_id=cbc9734c46db44918000791ce8bbb4e8)` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:35:31.128167 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd38f51e-7dce-4b32-9ab2-125085b85738 admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:35:31.129879 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 131/261] 10.222.0.42 () {56 vars in 1207 bytes} [Sun Oct 30 00:35:31 2022] GET /identity/v3/projects/cbc9734c46db44918000791ce8bbb4e8 => generated 298 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:35:31.135859 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e46d7a-9e34-471c-be7a-d63bdf17a5a4 admin admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:35:31.148605 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e46d7a-9e34-471c-be7a-d63bdf17a5a4 admin admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:35:31.153048 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efaf66f5-2981-471b-9f03-5f4c74f446a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:35:31.153736 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efaf66f5-2981-471b-9f03-5f4c74f446a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:31.154037 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efaf66f5-2981-471b-9f03-5f4c74f446a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:31.154302 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efaf66f5-2981-471b-9f03-5f4c74f446a1 admin admin] PATH_INFO: `/v3/projects/cbc9734c46db44918000791ce8bbb4e8/groups/65f1096068354e63897b038ecbeeffc7/roles/1c93019874174c4b91118d9ce2347e47` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:31.156410 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efaf66f5-2981-471b-9f03-5f4c74f446a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cbc9734c46db44918000791ce8bbb4e8, group_id=65f1096068354e63897b038ecbeeffc7, role_id=1c93019874174c4b91118d9ce2347e47)` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:35:31.157577 dv-cinder-861491-6-smb devstack@keystone.service[87956]: WARNING py.warnings [None req-efaf66f5-2981-471b-9f03-5f4c74f446a1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 30 00:35:31.157577 dv-cinder-861491-6-smb devstack@keystone.service[87956]: warnings.warn(msg) Oct 30 00:35:31.157577 dv-cinder-861491-6-smb devstack@keystone.service[87956]: Oct 30 00:35:31.159634 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efaf66f5-2981-471b-9f03-5f4c74f446a1 admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:35:31.179560 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 131/262] 10.222.0.42 () {58 vars in 1463 bytes} [Sun Oct 30 00:35:31 2022] PUT /identity/v3/projects/cbc9734c46db44918000791ce8bbb4e8/groups/65f1096068354e63897b038ecbeeffc7/roles/1c93019874174c4b91118d9ce2347e47 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 00:35:31.363143 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721dd56c-a1a6-4f3a-9df3-d82bdeaee69b None None] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:31.363607 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721dd56c-a1a6-4f3a-9df3-d82bdeaee69b None None] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:31.363778 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721dd56c-a1a6-4f3a-9df3-d82bdeaee69b None None] PATH_INFO: `/` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:31.365459 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 132/263] 10.222.0.42 () {54 vars in 927 bytes} [Sun Oct 30 00:35:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:35:31.371609 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5866ab6d-5efd-4bda-8af0-899dc259bf89 None None] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:31.372158 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5866ab6d-5efd-4bda-8af0-899dc259bf89 None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:31.372700 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5866ab6d-5efd-4bda-8af0-899dc259bf89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:31.404256 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.auth.core [None req-5866ab6d-5efd-4bda-8af0-899dc259bf89 None None] MFA Rules not processed for user `eb55b6cbca4945abb21b0e49eb745e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=87956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:35:31.405908 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-5866ab6d-5efd-4bda-8af0-899dc259bf89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:35:31.477783 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 132/264] 10.222.0.42 () {58 vars in 1024 bytes} [Sun Oct 30 00:35:31 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Oct 30 00:35:31.712144 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821d5210-2d85-4423-9d7d-311bb09114db None None] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:31.712655 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821d5210-2d85-4423-9d7d-311bb09114db None None] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:31.712655 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821d5210-2d85-4423-9d7d-311bb09114db None None] PATH_INFO: `/` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:31.713941 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 133/265] 10.222.0.42 () {54 vars in 927 bytes} [Sun Oct 30 00:35:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:35:31.720823 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bc1601-cd20-4c5a-8f35-87827056175d None None] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:31.721772 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bc1601-cd20-4c5a-8f35-87827056175d None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:31.722252 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bc1601-cd20-4c5a-8f35-87827056175d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:31.745333 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.auth.core [None req-b9bc1601-cd20-4c5a-8f35-87827056175d None None] MFA Rules not processed for user `eb55b6cbca4945abb21b0e49eb745e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=87956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:35:31.746947 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-b9bc1601-cd20-4c5a-8f35-87827056175d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:35:31.795341 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:35:31.827057 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 133/266] 10.222.0.42 () {58 vars in 1024 bytes} [Sun Oct 30 00:35:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 30 00:35:31.885184 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95282742-1c9b-488d-b1f8-807c51a3e16e None None] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:31.885853 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95282742-1c9b-488d-b1f8-807c51a3e16e None None] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:31.886326 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95282742-1c9b-488d-b1f8-807c51a3e16e None None] PATH_INFO: `/` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:31.887946 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 134/267] 10.222.0.42 () {54 vars in 927 bytes} [Sun Oct 30 00:35:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:35:31.893838 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f90c0f-5155-4fa6-80ca-8bfc12354641 None None] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:31.894385 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f90c0f-5155-4fa6-80ca-8bfc12354641 None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:31.894869 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f90c0f-5155-4fa6-80ca-8bfc12354641 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:31.917203 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.auth.core [None req-55f90c0f-5155-4fa6-80ca-8bfc12354641 None None] MFA Rules not processed for user `eb55b6cbca4945abb21b0e49eb745e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=87956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:35:31.918771 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-55f90c0f-5155-4fa6-80ca-8bfc12354641 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:35:31.930278 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 134/268] 10.222.0.42 () {58 vars in 1024 bytes} [Sun Oct 30 00:35:31 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Oct 30 00:35:32.004225 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95282742-1c9b-488d-b1f8-807c51a3e16e None None] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:35:32.017481 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95282742-1c9b-488d-b1f8-807c51a3e16e None None] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:35:32.022252 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0a697d-c444-4935-9ada-b22a67e68750 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:35:32.023118 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0a697d-c444-4935-9ada-b22a67e68750 admin admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:32.023609 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0a697d-c444-4935-9ada-b22a67e68750 admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:32.024070 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0a697d-c444-4935-9ada-b22a67e68750 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:32.039616 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0a697d-c444-4935-9ada-b22a67e68750 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 30 00:35:32.044830 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application [None req-df0a697d-c444-4935-9ada-b22a67e68750 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 30 00:35:32.044830 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:35:32.044830 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:35:32.044830 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:35:32.044830 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:35:32.044830 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:35:32.044830 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:35:32.044830 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:35:32.044830 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:35:32.044830 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:35:32.044830 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:35:32.044830 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:35:32.044830 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 30 00:35:32.044830 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 30 00:35:32.044830 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 30 00:35:32.044830 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 30 00:35:32.045722 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 30 00:35:32.045722 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 30 00:35:32.045722 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 30 00:35:32.045722 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 30 00:35:32.045722 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:35:32.045722 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:35:32.045722 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:35:32.045722 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:35:32.045722 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:35:32.045722 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:35:32.045722 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:35:32.045722 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application with Lock( Oct 30 00:35:32.045722 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:35:32.045722 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:35:32.045722 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:35:32.045722 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:35:32.046525 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:35:32.046525 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:35:32.046525 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:35:32.046525 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:35:32.046525 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 30 00:35:32.046525 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 30 00:35:32.046525 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 30 00:35:32.046525 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 30 00:35:32.046525 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 30 00:35:32.046525 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 30 00:35:32.046525 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 30 00:35:32.046525 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application Oct 30 00:35:32.049121 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 135/269] 10.222.0.42 () {56 vars in 1135 bytes} [Sun Oct 30 00:35:32 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:35:32.055329 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f90c0f-5155-4fa6-80ca-8bfc12354641 None None] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:35:32.066007 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f90c0f-5155-4fa6-80ca-8bfc12354641 None None] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:35:32.073805 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9799b66f-6093-4d70-ae24-9c8e468e61d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:35:32.074485 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9799b66f-6093-4d70-ae24-9c8e468e61d7 admin admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:32.074761 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9799b66f-6093-4d70-ae24-9c8e468e61d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:32.075033 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9799b66f-6093-4d70-ae24-9c8e468e61d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:32.075844 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9799b66f-6093-4d70-ae24-9c8e468e61d7 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87956) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:35:32.076152 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9799b66f-6093-4d70-ae24-9c8e468e61d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:35:32.077256 dv-cinder-861491-6-smb devstack@keystone.service[87956]: WARNING py.warnings [None req-9799b66f-6093-4d70-ae24-9c8e468e61d7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 30 00:35:32.077256 dv-cinder-861491-6-smb devstack@keystone.service[87956]: warnings.warn(msg) Oct 30 00:35:32.077256 dv-cinder-861491-6-smb devstack@keystone.service[87956]: Oct 30 00:35:32.078148 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9799b66f-6093-4d70-ae24-9c8e468e61d7 admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:35:32.091286 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 135/270] 10.222.0.42 () {56 vars in 1132 bytes} [Sun Oct 30 00:35:32 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:35:32.097215 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0a697d-c444-4935-9ada-b22a67e68750 admin admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:35:32.109574 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0a697d-c444-4935-9ada-b22a67e68750 admin admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:35:32.114105 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84295384-f843-4540-9b86-f0282782245e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:35:32.114731 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84295384-f843-4540-9b86-f0282782245e admin admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:32.115005 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84295384-f843-4540-9b86-f0282782245e admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:32.115317 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84295384-f843-4540-9b86-f0282782245e admin admin] PATH_INFO: `/v3/groups/65f1096068354e63897b038ecbeeffc7` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:32.119871 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84295384-f843-4540-9b86-f0282782245e admin admin] RBAC: Authorizing `identity:get_group(group_id=65f1096068354e63897b038ecbeeffc7)` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:35:32.120913 dv-cinder-861491-6-smb devstack@keystone.service[87955]: WARNING py.warnings [None req-84295384-f843-4540-9b86-f0282782245e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 30 00:35:32.120913 dv-cinder-861491-6-smb devstack@keystone.service[87955]: warnings.warn(msg) Oct 30 00:35:32.120913 dv-cinder-861491-6-smb devstack@keystone.service[87955]: Oct 30 00:35:32.122138 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84295384-f843-4540-9b86-f0282782245e admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:35:32.123850 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 136/271] 10.222.0.42 () {56 vars in 1201 bytes} [Sun Oct 30 00:35:32 2022] GET /identity/v3/groups/65f1096068354e63897b038ecbeeffc7 => generated 226 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:35:32.129631 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9799b66f-6093-4d70-ae24-9c8e468e61d7 admin admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:35:32.144281 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9799b66f-6093-4d70-ae24-9c8e468e61d7 admin admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:35:32.148834 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd3a084-e8bb-4778-bed6-254a94a19270 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:35:32.149466 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd3a084-e8bb-4778-bed6-254a94a19270 admin admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:32.149741 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd3a084-e8bb-4778-bed6-254a94a19270 admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:32.150012 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd3a084-e8bb-4778-bed6-254a94a19270 admin admin] PATH_INFO: `/v3/projects/cbc9734c46db44918000791ce8bbb4e8` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:32.155952 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd3a084-e8bb-4778-bed6-254a94a19270 admin admin] RBAC: Authorizing `identity:get_project(project_id=cbc9734c46db44918000791ce8bbb4e8)` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:35:32.158032 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd3a084-e8bb-4778-bed6-254a94a19270 admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:35:32.159922 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 136/272] 10.222.0.42 () {56 vars in 1207 bytes} [Sun Oct 30 00:35:32 2022] GET /identity/v3/projects/cbc9734c46db44918000791ce8bbb4e8 => generated 298 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 30 00:35:32.165508 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84295384-f843-4540-9b86-f0282782245e admin admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:35:32.180411 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84295384-f843-4540-9b86-f0282782245e admin admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:35:32.184915 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5c7704-7e50-4600-b00f-e1436ee7f763 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:35:32.185580 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5c7704-7e50-4600-b00f-e1436ee7f763 admin admin] REQUEST_METHOD: `PUT` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:32.185847 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5c7704-7e50-4600-b00f-e1436ee7f763 admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:32.186176 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5c7704-7e50-4600-b00f-e1436ee7f763 admin admin] PATH_INFO: `/v3/projects/cbc9734c46db44918000791ce8bbb4e8/groups/65f1096068354e63897b038ecbeeffc7/roles/7f42beaeb9e84fd8961e2fa0ae82d034` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:32.192983 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5c7704-7e50-4600-b00f-e1436ee7f763 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cbc9734c46db44918000791ce8bbb4e8, group_id=65f1096068354e63897b038ecbeeffc7, role_id=7f42beaeb9e84fd8961e2fa0ae82d034)` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:35:32.194012 dv-cinder-861491-6-smb devstack@keystone.service[87955]: WARNING py.warnings [None req-ec5c7704-7e50-4600-b00f-e1436ee7f763 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 30 00:35:32.194012 dv-cinder-861491-6-smb devstack@keystone.service[87955]: warnings.warn(msg) Oct 30 00:35:32.194012 dv-cinder-861491-6-smb devstack@keystone.service[87955]: Oct 30 00:35:32.195981 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5c7704-7e50-4600-b00f-e1436ee7f763 admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:35:32.211734 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:35:32.218601 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 137/273] 10.222.0.42 () {58 vars in 1463 bytes} [Sun Oct 30 00:35:32 2022] PUT /identity/v3/projects/cbc9734c46db44918000791ce8bbb4e8/groups/65f1096068354e63897b038ecbeeffc7/roles/7f42beaeb9e84fd8961e2fa0ae82d034 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 00:35:32.318387 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd3a084-e8bb-4778-bed6-254a94a19270 admin admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:35:32.337203 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5c7704-7e50-4600-b00f-e1436ee7f763 admin admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:35:32.471238 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5c7704-7e50-4600-b00f-e1436ee7f763 admin admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:35:32.471589 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd3a084-e8bb-4778-bed6-254a94a19270 admin admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:35:32.481588 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2c3b2e-aa99-494c-9bd3-40ee8d303b91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:35:32.482282 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2c3b2e-aa99-494c-9bd3-40ee8d303b91 admin admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:32.482559 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2c3b2e-aa99-494c-9bd3-40ee8d303b91 admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:32.482862 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2c3b2e-aa99-494c-9bd3-40ee8d303b91 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:32.499230 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2c3b2e-aa99-494c-9bd3-40ee8d303b91 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 30 00:35:32.500934 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application [None req-0e2c3b2e-aa99-494c-9bd3-40ee8d303b91 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 30 00:35:32.500934 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:35:32.500934 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:35:32.500934 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:35:32.500934 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:35:32.500934 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:35:32.500934 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:35:32.500934 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:35:32.500934 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:35:32.500934 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:35:32.500934 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:35:32.500934 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:35:32.500934 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 30 00:35:32.500934 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 30 00:35:32.500934 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 30 00:35:32.500934 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 30 00:35:32.501801 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 30 00:35:32.501801 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 30 00:35:32.501801 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 30 00:35:32.501801 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 30 00:35:32.501801 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:35:32.501801 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:35:32.501801 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:35:32.501801 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:35:32.501801 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:35:32.501801 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:35:32.501801 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:35:32.501801 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application with Lock( Oct 30 00:35:32.501801 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:35:32.501801 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:35:32.501801 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:35:32.501801 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:35:32.502597 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:35:32.502597 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:35:32.502597 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:35:32.502597 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:35:32.502597 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 30 00:35:32.502597 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 30 00:35:32.502597 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 30 00:35:32.502597 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 30 00:35:32.502597 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 30 00:35:32.502597 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 30 00:35:32.502597 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 30 00:35:32.502597 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application Oct 30 00:35:32.502597 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 138/274] 10.222.0.42 () {56 vars in 1120 bytes} [Sun Oct 30 00:35:32 2022] GET /identity/v3/roles/member => generated 84 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:35:32.508209 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2c3b2e-aa99-494c-9bd3-40ee8d303b91 admin admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:35:32.520304 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2c3b2e-aa99-494c-9bd3-40ee8d303b91 admin admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:35:32.530452 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb6157f-7211-4abd-a9f2-165659018b50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:35:32.531106 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb6157f-7211-4abd-a9f2-165659018b50 admin admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:32.531414 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb6157f-7211-4abd-a9f2-165659018b50 admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:32.531683 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb6157f-7211-4abd-a9f2-165659018b50 admin admin] PATH_INFO: `/v3/roles` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:32.532363 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb6157f-7211-4abd-a9f2-165659018b50 admin admin] RBAC: Adding query filter params (name=member) {{(pid=87955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:35:32.532662 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb6157f-7211-4abd-a9f2-165659018b50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:35:32.534297 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb6157f-7211-4abd-a9f2-165659018b50 admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:35:32.539625 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee89ac3-9653-4673-93a8-1bc6f5d556aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:35:32.540279 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee89ac3-9653-4673-93a8-1bc6f5d556aa None admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:32.540554 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee89ac3-9653-4673-93a8-1bc6f5d556aa None admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:32.540828 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee89ac3-9653-4673-93a8-1bc6f5d556aa None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:32.555868 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 139/275] 10.222.0.42 () {56 vars in 1122 bytes} [Sun Oct 30 00:35:32 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 30 00:35:32.564496 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee89ac3-9653-4673-93a8-1bc6f5d556aa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 30 00:35:32.570423 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application [None req-2ee89ac3-9653-4673-93a8-1bc6f5d556aa None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 30 00:35:32.570423 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:35:32.570423 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:35:32.570423 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:35:32.570423 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:35:32.570423 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:35:32.570423 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:35:32.570423 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:35:32.570423 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:35:32.570423 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:35:32.570423 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:35:32.570423 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:35:32.570423 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 30 00:35:32.570423 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 30 00:35:32.570423 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 30 00:35:32.570423 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 30 00:35:32.571381 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 30 00:35:32.571381 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 30 00:35:32.571381 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 30 00:35:32.571381 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 30 00:35:32.571381 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:35:32.571381 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:35:32.571381 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:35:32.571381 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:35:32.571381 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:35:32.571381 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:35:32.571381 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:35:32.571381 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application with Lock( Oct 30 00:35:32.571381 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:35:32.571381 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:35:32.571381 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:35:32.571381 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:35:32.572189 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:35:32.572189 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:35:32.572189 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:35:32.572189 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:35:32.572189 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 30 00:35:32.572189 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 30 00:35:32.572189 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 30 00:35:32.572189 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 30 00:35:32.572189 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 30 00:35:32.572189 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 30 00:35:32.572189 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 30 00:35:32.572189 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application Oct 30 00:35:32.572189 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 137/276] 10.222.0.42 () {56 vars in 1099 bytes} [Sun Oct 30 00:35:32 2022] GET /identity/v3/roles/reader => generated 84 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:35:32.577429 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb6157f-7211-4abd-a9f2-165659018b50 admin admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:35:32.581344 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee89ac3-9653-4673-93a8-1bc6f5d556aa None admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:35:32.587633 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb6157f-7211-4abd-a9f2-165659018b50 admin admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:35:32.595800 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d231bc11-575b-4d2d-b352-c7520421b55c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:35:32.597342 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d231bc11-575b-4d2d-b352-c7520421b55c admin admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:32.597631 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d231bc11-575b-4d2d-b352-c7520421b55c admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:32.597906 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d231bc11-575b-4d2d-b352-c7520421b55c admin admin] PATH_INFO: `/v3/groups/65f1096068354e63897b038ecbeeffc7` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:32.600958 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d231bc11-575b-4d2d-b352-c7520421b55c admin admin] RBAC: Authorizing `identity:get_group(group_id=65f1096068354e63897b038ecbeeffc7)` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:35:32.605610 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d231bc11-575b-4d2d-b352-c7520421b55c admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:35:32.607466 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 140/277] 10.222.0.42 () {56 vars in 1201 bytes} [Sun Oct 30 00:35:32 2022] GET /identity/v3/groups/65f1096068354e63897b038ecbeeffc7 => generated 226 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:35:32.618047 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d231bc11-575b-4d2d-b352-c7520421b55c admin admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:35:32.622225 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=100 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:35:32.632453 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d231bc11-575b-4d2d-b352-c7520421b55c admin admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:35:32.640198 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9db46b6-c18b-4e60-b948-ad7163f43671 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:35:32.641476 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9db46b6-c18b-4e60-b948-ad7163f43671 admin admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:32.642121 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9db46b6-c18b-4e60-b948-ad7163f43671 admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:32.642713 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9db46b6-c18b-4e60-b948-ad7163f43671 admin admin] PATH_INFO: `/v3/projects/0ca99d2d3e3d4195b47b4479559371ef` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:32.645087 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9db46b6-c18b-4e60-b948-ad7163f43671 admin admin] RBAC: Authorizing `identity:get_project(project_id=0ca99d2d3e3d4195b47b4479559371ef)` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:35:32.648208 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9db46b6-c18b-4e60-b948-ad7163f43671 admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:35:32.650909 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 141/278] 10.222.0.42 () {56 vars in 1207 bytes} [Sun Oct 30 00:35:32 2022] GET /identity/v3/projects/0ca99d2d3e3d4195b47b4479559371ef => generated 302 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 30 00:35:32.661112 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9db46b6-c18b-4e60-b948-ad7163f43671 admin admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:35:32.680046 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9db46b6-c18b-4e60-b948-ad7163f43671 admin admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:35:32.693150 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c3e882-d9f8-4e30-a5a5-d9acbffae712 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:35:32.694173 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c3e882-d9f8-4e30-a5a5-d9acbffae712 admin admin] REQUEST_METHOD: `PUT` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:32.696349 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c3e882-d9f8-4e30-a5a5-d9acbffae712 admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:32.696857 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c3e882-d9f8-4e30-a5a5-d9acbffae712 admin admin] PATH_INFO: `/v3/projects/0ca99d2d3e3d4195b47b4479559371ef/groups/65f1096068354e63897b038ecbeeffc7/roles/1c93019874174c4b91118d9ce2347e47` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:32.700532 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c3e882-d9f8-4e30-a5a5-d9acbffae712 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0ca99d2d3e3d4195b47b4479559371ef, group_id=65f1096068354e63897b038ecbeeffc7, role_id=1c93019874174c4b91118d9ce2347e47)` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:35:32.706989 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c3e882-d9f8-4e30-a5a5-d9acbffae712 admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:35:32.738357 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 142/279] 10.222.0.42 () {58 vars in 1463 bytes} [Sun Oct 30 00:35:32 2022] PUT /identity/v3/projects/0ca99d2d3e3d4195b47b4479559371ef/groups/65f1096068354e63897b038ecbeeffc7/roles/1c93019874174c4b91118d9ce2347e47 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 00:35:32.775506 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee89ac3-9653-4673-93a8-1bc6f5d556aa None admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:35:32.813483 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20201e1-e592-4ec9-9d82-c0e882fa3d02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:35:32.814542 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20201e1-e592-4ec9-9d82-c0e882fa3d02 None admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:32.815019 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20201e1-e592-4ec9-9d82-c0e882fa3d02 None admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:32.815542 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20201e1-e592-4ec9-9d82-c0e882fa3d02 None admin] PATH_INFO: `/v3/roles` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:32.816584 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20201e1-e592-4ec9-9d82-c0e882fa3d02 None admin] RBAC: Adding query filter params (name=reader) {{(pid=87956) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:35:32.817275 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20201e1-e592-4ec9-9d82-c0e882fa3d02 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:35:32.819161 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20201e1-e592-4ec9-9d82-c0e882fa3d02 None admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:35:32.829354 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 138/280] 10.222.0.42 () {56 vars in 1101 bytes} [Sun Oct 30 00:35:32 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:35:32.835339 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c3e882-d9f8-4e30-a5a5-d9acbffae712 admin admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:35:32.996782 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c3e882-d9f8-4e30-a5a5-d9acbffae712 admin admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:35:33.011760 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:35:33.045906 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fff5cb-ba95-4e85-bec9-3ba442bfb436 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:35:33.046546 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fff5cb-ba95-4e85-bec9-3ba442bfb436 None admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:33.046823 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fff5cb-ba95-4e85-bec9-3ba442bfb436 None admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:33.047089 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fff5cb-ba95-4e85-bec9-3ba442bfb436 None admin] PATH_INFO: `/v3/users/c878e410871641af84a2dc2d545a496b` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:33.050382 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55fff5cb-ba95-4e85-bec9-3ba442bfb436 None admin] RBAC: Authorizing `identity:get_user(user_id=c878e410871641af84a2dc2d545a496b)` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:35:33.050382 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55fff5cb-ba95-4e85-bec9-3ba442bfb436 None admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:35:33.052394 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 143/281] 10.222.0.42 () {56 vars in 1177 bytes} [Sun Oct 30 00:35:32 2022] GET /identity/v3/users/c878e410871641af84a2dc2d545a496b => generated 293 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 30 00:35:33.057253 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20201e1-e592-4ec9-9d82-c0e882fa3d02 None admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:35:33.177170 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=100 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:35:33.205597 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20201e1-e592-4ec9-9d82-c0e882fa3d02 None admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:35:33.241907 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7331613-c474-4b6e-8738-f07fd8eac445 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:35:33.242897 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7331613-c474-4b6e-8738-f07fd8eac445 None admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:33.243397 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7331613-c474-4b6e-8738-f07fd8eac445 None admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:33.243885 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7331613-c474-4b6e-8738-f07fd8eac445 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:33.244812 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7331613-c474-4b6e-8738-f07fd8eac445 None admin] RBAC: Adding query filter params (role.id=992ffb31c434469696dce212bcf0cebc, user.id=c878e410871641af84a2dc2d545a496b, scope.system=all) {{(pid=87956) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:35:33.245315 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7331613-c474-4b6e-8738-f07fd8eac445 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:35:33.247319 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7331613-c474-4b6e-8738-f07fd8eac445 None admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:35:33.260982 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 139/282] 10.222.0.42 () {56 vars in 1308 bytes} [Sun Oct 30 00:35:33 2022] GET /identity/v3/role_assignments?user.id=c878e410871641af84a2dc2d545a496b&scope.system=all&role.id=992ffb31c434469696dce212bcf0cebc => generated 510 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:35:33.331414 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8265d0a-0636-4b93-a48b-d0b66143cc9b None None] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:33.331735 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8265d0a-0636-4b93-a48b-d0b66143cc9b None None] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:33.331962 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8265d0a-0636-4b93-a48b-d0b66143cc9b None None] PATH_INFO: `/` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:33.334107 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 144/283] 10.222.0.42 () {54 vars in 927 bytes} [Sun Oct 30 00:35:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:35:33.340419 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a067d8ff-347e-469c-a91b-237a37baa648 None None] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:33.341087 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a067d8ff-347e-469c-a91b-237a37baa648 None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:33.341580 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a067d8ff-347e-469c-a91b-237a37baa648 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:33.376507 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.auth.core [None req-a067d8ff-347e-469c-a91b-237a37baa648 None None] MFA Rules not processed for user `eb55b6cbca4945abb21b0e49eb745e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=87956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:35:33.378133 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-a067d8ff-347e-469c-a91b-237a37baa648 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:35:33.450894 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 140/284] 10.222.0.42 () {58 vars in 1024 bytes} [Sun Oct 30 00:35:33 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Oct 30 00:35:33.851837 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b949c3-ead1-4376-b98a-0898922990d6 None None] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:33.852438 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b949c3-ead1-4376-b98a-0898922990d6 None None] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:33.852438 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b949c3-ead1-4376-b98a-0898922990d6 None None] PATH_INFO: `/` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:33.853709 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 145/285] 10.222.0.42 () {54 vars in 927 bytes} [Sun Oct 30 00:35:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:35:33.859362 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c4a6f4-3568-4505-90cf-f2945cc6794a None None] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:33.860116 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c4a6f4-3568-4505-90cf-f2945cc6794a None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:33.860567 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c4a6f4-3568-4505-90cf-f2945cc6794a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:33.885512 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.auth.core [None req-64c4a6f4-3568-4505-90cf-f2945cc6794a None None] MFA Rules not processed for user `eb55b6cbca4945abb21b0e49eb745e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=87956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:35:33.887045 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-64c4a6f4-3568-4505-90cf-f2945cc6794a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:35:33.898353 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 141/286] 10.222.0.42 () {58 vars in 1024 bytes} [Sun Oct 30 00:35:33 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Oct 30 00:35:33.983444 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b949c3-ead1-4376-b98a-0898922990d6 None None] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:35:34.000761 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b949c3-ead1-4376-b98a-0898922990d6 None None] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:35:34.005217 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4db65c-2038-40eb-ba16-057272277e79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:35:34.005845 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4db65c-2038-40eb-ba16-057272277e79 admin admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:34.006119 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4db65c-2038-40eb-ba16-057272277e79 admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:34.006392 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4db65c-2038-40eb-ba16-057272277e79 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:34.024214 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4db65c-2038-40eb-ba16-057272277e79 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 30 00:35:34.029186 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application [None req-ef4db65c-2038-40eb-ba16-057272277e79 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 30 00:35:34.029186 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:35:34.029186 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:35:34.029186 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:35:34.029186 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:35:34.029186 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:35:34.029186 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:35:34.029186 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:35:34.029186 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:35:34.029186 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:35:34.029186 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:35:34.029186 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:35:34.029186 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 30 00:35:34.029186 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 30 00:35:34.029186 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 30 00:35:34.029186 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 30 00:35:34.030108 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 30 00:35:34.030108 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 30 00:35:34.030108 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 30 00:35:34.030108 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 30 00:35:34.030108 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:35:34.030108 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:35:34.030108 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:35:34.030108 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:35:34.030108 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:35:34.030108 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:35:34.030108 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:35:34.030108 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application with Lock( Oct 30 00:35:34.030108 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:35:34.030108 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:35:34.030108 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:35:34.030108 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:35:34.031547 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:35:34.031547 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:35:34.031547 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:35:34.031547 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:35:34.031547 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 30 00:35:34.031547 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 30 00:35:34.031547 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 30 00:35:34.031547 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 30 00:35:34.031547 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 30 00:35:34.031547 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 30 00:35:34.031547 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 30 00:35:34.031547 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application Oct 30 00:35:34.031547 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 146/287] 10.222.0.42 () {56 vars in 1135 bytes} [Sun Oct 30 00:35:33 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:35:34.036457 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c4a6f4-3568-4505-90cf-f2945cc6794a None None] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:35:34.056174 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c4a6f4-3568-4505-90cf-f2945cc6794a None None] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:35:34.075929 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa090489-221c-485f-bb60-e80c7a8da4c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:35:34.076618 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa090489-221c-485f-bb60-e80c7a8da4c7 admin admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:34.076891 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa090489-221c-485f-bb60-e80c7a8da4c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:34.077159 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa090489-221c-485f-bb60-e80c7a8da4c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:34.077850 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa090489-221c-485f-bb60-e80c7a8da4c7 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87956) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:35:34.078149 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa090489-221c-485f-bb60-e80c7a8da4c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:35:34.079804 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa090489-221c-485f-bb60-e80c7a8da4c7 admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:35:34.090708 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 142/288] 10.222.0.42 () {56 vars in 1132 bytes} [Sun Oct 30 00:35:34 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:35:34.095855 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4db65c-2038-40eb-ba16-057272277e79 admin admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:35:34.110830 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4db65c-2038-40eb-ba16-057272277e79 admin admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:35:34.118422 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2897df-befb-4880-b3cb-e3dccd72e2a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:35:34.119013 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2897df-befb-4880-b3cb-e3dccd72e2a5 admin admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:34.119319 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2897df-befb-4880-b3cb-e3dccd72e2a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:34.119587 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2897df-befb-4880-b3cb-e3dccd72e2a5 admin admin] PATH_INFO: `/v3/groups/65f1096068354e63897b038ecbeeffc7` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:34.123856 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2897df-befb-4880-b3cb-e3dccd72e2a5 admin admin] RBAC: Authorizing `identity:get_group(group_id=65f1096068354e63897b038ecbeeffc7)` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:35:34.125830 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2897df-befb-4880-b3cb-e3dccd72e2a5 admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:35:34.127758 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 147/289] 10.222.0.42 () {56 vars in 1201 bytes} [Sun Oct 30 00:35:34 2022] GET /identity/v3/groups/65f1096068354e63897b038ecbeeffc7 => generated 226 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:35:34.132987 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa090489-221c-485f-bb60-e80c7a8da4c7 admin admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:35:34.143982 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa090489-221c-485f-bb60-e80c7a8da4c7 admin admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:35:34.155947 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b9a7ec-2ec2-4ba3-8bc9-06e3a3dc41fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:35:34.156596 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b9a7ec-2ec2-4ba3-8bc9-06e3a3dc41fe admin admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:34.156872 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b9a7ec-2ec2-4ba3-8bc9-06e3a3dc41fe admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:34.157148 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b9a7ec-2ec2-4ba3-8bc9-06e3a3dc41fe admin admin] PATH_INFO: `/v3/projects/0ca99d2d3e3d4195b47b4479559371ef` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:34.160472 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b9a7ec-2ec2-4ba3-8bc9-06e3a3dc41fe admin admin] RBAC: Authorizing `identity:get_project(project_id=0ca99d2d3e3d4195b47b4479559371ef)` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:35:34.162554 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b9a7ec-2ec2-4ba3-8bc9-06e3a3dc41fe admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:35:34.164447 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 143/290] 10.222.0.42 () {56 vars in 1207 bytes} [Sun Oct 30 00:35:34 2022] GET /identity/v3/projects/0ca99d2d3e3d4195b47b4479559371ef => generated 302 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:35:34.169906 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2897df-befb-4880-b3cb-e3dccd72e2a5 admin admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:35:34.184260 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2897df-befb-4880-b3cb-e3dccd72e2a5 admin admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:35:34.191160 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe5a318-c27d-40e8-b31d-5f384326e9a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:35:34.191846 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe5a318-c27d-40e8-b31d-5f384326e9a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:34.192118 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe5a318-c27d-40e8-b31d-5f384326e9a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:34.192383 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe5a318-c27d-40e8-b31d-5f384326e9a3 admin admin] PATH_INFO: `/v3/projects/0ca99d2d3e3d4195b47b4479559371ef/groups/65f1096068354e63897b038ecbeeffc7/roles/7f42beaeb9e84fd8961e2fa0ae82d034` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:34.196486 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe5a318-c27d-40e8-b31d-5f384326e9a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0ca99d2d3e3d4195b47b4479559371ef, group_id=65f1096068354e63897b038ecbeeffc7, role_id=7f42beaeb9e84fd8961e2fa0ae82d034)` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:35:34.199124 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe5a318-c27d-40e8-b31d-5f384326e9a3 admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:35:34.215932 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b9a7ec-2ec2-4ba3-8bc9-06e3a3dc41fe admin admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:35:34.221076 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 148/291] 10.222.0.42 () {58 vars in 1463 bytes} [Sun Oct 30 00:35:34 2022] PUT /identity/v3/projects/0ca99d2d3e3d4195b47b4479559371ef/groups/65f1096068354e63897b038ecbeeffc7/roles/7f42beaeb9e84fd8961e2fa0ae82d034 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 00:35:34.233275 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b9a7ec-2ec2-4ba3-8bc9-06e3a3dc41fe admin admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:35:34.324936 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37dc5df8-b85d-499e-a950-00cfbe2a8172 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:35:34.325602 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dc5df8-b85d-499e-a950-00cfbe2a8172 admin admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:34.325880 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dc5df8-b85d-499e-a950-00cfbe2a8172 admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:34.326199 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dc5df8-b85d-499e-a950-00cfbe2a8172 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:34.339092 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=100 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:35:34.343358 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37dc5df8-b85d-499e-a950-00cfbe2a8172 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 30 00:35:34.350325 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application [None req-37dc5df8-b85d-499e-a950-00cfbe2a8172 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 30 00:35:34.350325 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:35:34.350325 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:35:34.350325 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:35:34.350325 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:35:34.350325 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:35:34.350325 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:35:34.350325 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:35:34.350325 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:35:34.350325 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:35:34.350325 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:35:34.350325 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:35:34.350325 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 30 00:35:34.350325 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 30 00:35:34.350325 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 30 00:35:34.350325 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 30 00:35:34.351302 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 30 00:35:34.351302 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 30 00:35:34.351302 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 30 00:35:34.351302 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 30 00:35:34.351302 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:35:34.351302 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:35:34.351302 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:35:34.351302 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:35:34.351302 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:35:34.351302 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:35:34.351302 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:35:34.351302 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application with Lock( Oct 30 00:35:34.351302 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:35:34.351302 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:35:34.351302 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:35:34.351302 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:35:34.352077 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:35:34.352077 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:35:34.352077 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:35:34.352077 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:35:34.352077 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 30 00:35:34.352077 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 30 00:35:34.352077 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 30 00:35:34.352077 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 30 00:35:34.352077 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 30 00:35:34.352077 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 30 00:35:34.352077 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 30 00:35:34.352077 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application Oct 30 00:35:34.352077 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 144/292] 10.222.0.42 () {56 vars in 1117 bytes} [Sun Oct 30 00:35:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 136 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 30 00:35:34.358082 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe5a318-c27d-40e8-b31d-5f384326e9a3 admin admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:35:34.376940 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe5a318-c27d-40e8-b31d-5f384326e9a3 admin admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:35:34.383416 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdf380e-8a7f-468f-9e2a-10ff044c636f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:35:34.384049 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdf380e-8a7f-468f-9e2a-10ff044c636f admin admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:34.384327 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdf380e-8a7f-468f-9e2a-10ff044c636f admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:34.384601 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdf380e-8a7f-468f-9e2a-10ff044c636f admin admin] PATH_INFO: `/v3/roles` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:34.385295 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccdf380e-8a7f-468f-9e2a-10ff044c636f admin admin] RBAC: Adding query filter params (name=admin) {{(pid=87955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:35:34.385594 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccdf380e-8a7f-468f-9e2a-10ff044c636f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:35:34.387243 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccdf380e-8a7f-468f-9e2a-10ff044c636f admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:35:34.409623 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 149/293] 10.222.0.42 () {56 vars in 1120 bytes} [Sun Oct 30 00:35:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:35:34.415440 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37dc5df8-b85d-499e-a950-00cfbe2a8172 admin admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:35:34.429290 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37dc5df8-b85d-499e-a950-00cfbe2a8172 admin admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:35:34.440373 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7ad4d4-3f6c-4adb-8583-544f5e9c9762 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:35:34.441023 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7ad4d4-3f6c-4adb-8583-544f5e9c9762 admin admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:34.441304 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7ad4d4-3f6c-4adb-8583-544f5e9c9762 admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:34.441577 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7ad4d4-3f6c-4adb-8583-544f5e9c9762 admin admin] PATH_INFO: `/v3/groups/f4af0d3cb89c453f9b5f6fd99f39dab3` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:34.447979 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7ad4d4-3f6c-4adb-8583-544f5e9c9762 admin admin] RBAC: Authorizing `identity:get_group(group_id=f4af0d3cb89c453f9b5f6fd99f39dab3)` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:35:34.449906 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7ad4d4-3f6c-4adb-8583-544f5e9c9762 admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:35:34.453487 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 145/294] 10.222.0.42 () {56 vars in 1201 bytes} [Sun Oct 30 00:35:34 2022] GET /identity/v3/groups/f4af0d3cb89c453f9b5f6fd99f39dab3 => generated 229 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:35:34.459225 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdf380e-8a7f-468f-9e2a-10ff044c636f admin admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:35:34.472577 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdf380e-8a7f-468f-9e2a-10ff044c636f admin admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:35:34.476937 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ba5a3c-6d0d-4df8-8baf-50eb3c6dfe9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:35:34.477570 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ba5a3c-6d0d-4df8-8baf-50eb3c6dfe9a admin admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:34.477853 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ba5a3c-6d0d-4df8-8baf-50eb3c6dfe9a admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:34.478124 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ba5a3c-6d0d-4df8-8baf-50eb3c6dfe9a admin admin] PATH_INFO: `/v3/projects/a39b871ca4334427a0ee2ffbee79352f` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:34.479282 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ba5a3c-6d0d-4df8-8baf-50eb3c6dfe9a admin admin] RBAC: Authorizing `identity:get_project(project_id=a39b871ca4334427a0ee2ffbee79352f)` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:35:34.481068 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ba5a3c-6d0d-4df8-8baf-50eb3c6dfe9a admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:35:34.489340 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 150/295] 10.222.0.42 () {56 vars in 1207 bytes} [Sun Oct 30 00:35:34 2022] GET /identity/v3/projects/a39b871ca4334427a0ee2ffbee79352f => generated 344 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:35:34.490687 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7ad4d4-3f6c-4adb-8583-544f5e9c9762 admin admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:35:34.504935 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7ad4d4-3f6c-4adb-8583-544f5e9c9762 admin admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:35:34.512442 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd33614-4b99-4ab8-9741-7a0ee2026257 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:35:34.513333 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd33614-4b99-4ab8-9741-7a0ee2026257 admin admin] REQUEST_METHOD: `PUT` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:34.513783 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd33614-4b99-4ab8-9741-7a0ee2026257 admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:34.514099 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd33614-4b99-4ab8-9741-7a0ee2026257 admin admin] PATH_INFO: `/v3/projects/a39b871ca4334427a0ee2ffbee79352f/groups/f4af0d3cb89c453f9b5f6fd99f39dab3/roles/6ccaa8c11f29456fb4e4eeccb21616c7` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:34.516441 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd33614-4b99-4ab8-9741-7a0ee2026257 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a39b871ca4334427a0ee2ffbee79352f, group_id=f4af0d3cb89c453f9b5f6fd99f39dab3, role_id=6ccaa8c11f29456fb4e4eeccb21616c7)` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:35:34.519136 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd33614-4b99-4ab8-9741-7a0ee2026257 admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:35:34.537170 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 146/296] 10.222.0.42 () {58 vars in 1463 bytes} [Sun Oct 30 00:35:34 2022] PUT /identity/v3/projects/a39b871ca4334427a0ee2ffbee79352f/groups/f4af0d3cb89c453f9b5f6fd99f39dab3/roles/6ccaa8c11f29456fb4e4eeccb21616c7 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 00:35:34.733595 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5713a3a-3c83-4244-8cf8-26ea61823858 None None] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:34.733933 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5713a3a-3c83-4244-8cf8-26ea61823858 None None] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:34.734099 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5713a3a-3c83-4244-8cf8-26ea61823858 None None] PATH_INFO: `/` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:34.735659 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 151/297] 10.222.0.42 () {54 vars in 927 bytes} [Sun Oct 30 00:35:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:35:34.741148 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa9bc67-d342-435a-97d5-483cd1b89e2a None None] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:34.741432 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa9bc67-d342-435a-97d5-483cd1b89e2a None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:34.741712 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa9bc67-d342-435a-97d5-483cd1b89e2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:34.763670 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.auth.core [None req-8aa9bc67-d342-435a-97d5-483cd1b89e2a None None] MFA Rules not processed for user `eb55b6cbca4945abb21b0e49eb745e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=87956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:35:34.764889 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-8aa9bc67-d342-435a-97d5-483cd1b89e2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:35:34.845140 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 147/298] 10.222.0.42 () {58 vars in 1024 bytes} [Sun Oct 30 00:35:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 30 00:35:35.144344 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5713a3a-3c83-4244-8cf8-26ea61823858 None None] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:35:35.252960 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5713a3a-3c83-4244-8cf8-26ea61823858 None None] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:35:35.289208 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865950fa-26a5-4e2f-bcc8-bf523c4cdc4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:35:35.289840 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865950fa-26a5-4e2f-bcc8-bf523c4cdc4d None admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:35.290117 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865950fa-26a5-4e2f-bcc8-bf523c4cdc4d None admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:35.290385 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865950fa-26a5-4e2f-bcc8-bf523c4cdc4d None admin] PATH_INFO: `/v3/roles/member` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:35.292418 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:35:35.304059 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865950fa-26a5-4e2f-bcc8-bf523c4cdc4d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 30 00:35:35.309159 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application [None req-865950fa-26a5-4e2f-bcc8-bf523c4cdc4d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 30 00:35:35.309159 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:35:35.309159 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:35:35.309159 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:35:35.309159 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:35:35.309159 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:35:35.309159 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:35:35.309159 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:35:35.309159 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:35:35.309159 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:35:35.309159 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:35:35.309159 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:35:35.309159 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 30 00:35:35.309159 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 30 00:35:35.309159 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 30 00:35:35.309159 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 30 00:35:35.310024 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 30 00:35:35.310024 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 30 00:35:35.310024 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 30 00:35:35.310024 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 30 00:35:35.310024 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:35:35.310024 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:35:35.310024 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:35:35.310024 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:35:35.310024 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:35:35.310024 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:35:35.310024 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:35:35.310024 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application with Lock( Oct 30 00:35:35.310024 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:35:35.310024 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:35:35.310024 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:35:35.310024 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:35:35.310896 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:35:35.310896 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:35:35.310896 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:35:35.310896 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:35:35.310896 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 30 00:35:35.310896 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 30 00:35:35.310896 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 30 00:35:35.310896 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 30 00:35:35.310896 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 30 00:35:35.310896 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 30 00:35:35.310896 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 30 00:35:35.310896 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application Oct 30 00:35:35.310896 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 152/299] 10.222.0.42 () {56 vars in 1099 bytes} [Sun Oct 30 00:35:35 2022] GET /identity/v3/roles/member => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:35:35.316828 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa9bc67-d342-435a-97d5-483cd1b89e2a None None] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:35:35.431910 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa9bc67-d342-435a-97d5-483cd1b89e2a None None] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:35:35.445773 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:35:35.477254 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e09b36e-f044-4a83-a206-0763bf584df1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:35:35.477879 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e09b36e-f044-4a83-a206-0763bf584df1 None admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:35.478158 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e09b36e-f044-4a83-a206-0763bf584df1 None admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:35.478431 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e09b36e-f044-4a83-a206-0763bf584df1 None admin] PATH_INFO: `/v3/roles` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:35.479106 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e09b36e-f044-4a83-a206-0763bf584df1 None admin] RBAC: Adding query filter params (name=member) {{(pid=87956) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:35:35.479434 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e09b36e-f044-4a83-a206-0763bf584df1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:35:35.480812 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e09b36e-f044-4a83-a206-0763bf584df1 None admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:35:35.494133 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 148/300] 10.222.0.42 () {56 vars in 1101 bytes} [Sun Oct 30 00:35:35 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:35:35.496278 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865950fa-26a5-4e2f-bcc8-bf523c4cdc4d None admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:35:35.513668 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653d7192-07c3-4b20-b2d1-a30a4cd4b50a None None] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:35.513994 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653d7192-07c3-4b20-b2d1-a30a4cd4b50a None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:35.514227 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653d7192-07c3-4b20-b2d1-a30a4cd4b50a None None] PATH_INFO: `/` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:35.515612 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 149/301] 10.222.0.42 () {54 vars in 927 bytes} [Sun Oct 30 00:35:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 30 00:35:35.521041 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b760740-00c6-4b79-a808-d14af4631415 None None] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:35.521321 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b760740-00c6-4b79-a808-d14af4631415 None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:35.521596 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b760740-00c6-4b79-a808-d14af4631415 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:35.548850 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.auth.core [None req-5b760740-00c6-4b79-a808-d14af4631415 None None] MFA Rules not processed for user `eb55b6cbca4945abb21b0e49eb745e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=87956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:35:35.550049 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-5b760740-00c6-4b79-a808-d14af4631415 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:35:35.615233 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865950fa-26a5-4e2f-bcc8-bf523c4cdc4d None admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:35:35.657639 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a14d63-7dc0-4b41-94af-3b5dae5a461b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:35:35.658247 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a14d63-7dc0-4b41-94af-3b5dae5a461b None admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:35.658518 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a14d63-7dc0-4b41-94af-3b5dae5a461b None admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:35.658784 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a14d63-7dc0-4b41-94af-3b5dae5a461b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:35.679699 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 150/302] 10.222.0.42 () {58 vars in 1024 bytes} [Sun Oct 30 00:35:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 30 00:35:35.735386 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=100 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:35:35.737132 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a14d63-7dc0-4b41-94af-3b5dae5a461b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:35:35.738898 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a14d63-7dc0-4b41-94af-3b5dae5a461b None admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:35:35.847224 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 153/303] 10.222.0.42 () {58 vars in 1282 bytes} [Sun Oct 30 00:35:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 30 00:35:35.848532 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b760740-00c6-4b79-a808-d14af4631415 None None] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:35:35.970020 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9950c0-792b-4612-9aec-56dd8bc93d23 None None] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:35.970346 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9950c0-792b-4612-9aec-56dd8bc93d23 None None] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:35.970565 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9950c0-792b-4612-9aec-56dd8bc93d23 None None] PATH_INFO: `/` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:35.972172 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 154/304] 10.222.0.42 () {54 vars in 927 bytes} [Sun Oct 30 00:35:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:35:35.978232 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756766e0-cf40-417a-bbb2-92d065f8080b None None] REQUEST_METHOD: `POST` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:35.978566 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756766e0-cf40-417a-bbb2-92d065f8080b None None] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:35.978763 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756766e0-cf40-417a-bbb2-92d065f8080b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:35.985556 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b760740-00c6-4b79-a808-d14af4631415 None None] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:35:35.987626 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=100 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:35:36.000048 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.auth.core [None req-756766e0-cf40-417a-bbb2-92d065f8080b None None] MFA Rules not processed for user `eb55b6cbca4945abb21b0e49eb745e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=87955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:35:36.001539 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-756766e0-cf40-417a-bbb2-92d065f8080b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:35:36.048909 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fa6c88-6ca4-4a65-895d-5c5b0e29b82b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:35:36.049494 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fa6c88-6ca4-4a65-895d-5c5b0e29b82b None admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:36.049771 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fa6c88-6ca4-4a65-895d-5c5b0e29b82b None admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:36.050039 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fa6c88-6ca4-4a65-895d-5c5b0e29b82b None admin] PATH_INFO: `/v3/projects/cbc9734c46db44918000791ce8bbb4e8` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:36.051757 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fa6c88-6ca4-4a65-895d-5c5b0e29b82b None admin] RBAC: Authorizing `identity:get_project(project_id=cbc9734c46db44918000791ce8bbb4e8)` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:35:36.053276 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fa6c88-6ca4-4a65-895d-5c5b0e29b82b None admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:35:36.055017 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 151/305] 10.222.0.42 () {56 vars in 1186 bytes} [Sun Oct 30 00:35:35 2022] GET /identity/v3/projects/cbc9734c46db44918000791ce8bbb4e8 => generated 298 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:35:36.064222 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fa6c88-6ca4-4a65-895d-5c5b0e29b82b None admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:35:36.073444 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 155/306] 10.222.0.42 () {58 vars in 1024 bytes} [Sun Oct 30 00:35:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 30 00:35:36.199091 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fa6c88-6ca4-4a65-895d-5c5b0e29b82b None admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:35:36.240333 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14425035-2c25-40ab-8929-4ef80a1c0a26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:35:36.240888 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14425035-2c25-40ab-8929-4ef80a1c0a26 None admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:36.241166 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14425035-2c25-40ab-8929-4ef80a1c0a26 None admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:36.241434 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14425035-2c25-40ab-8929-4ef80a1c0a26 None admin] PATH_INFO: `/v3/groups/65f1096068354e63897b038ecbeeffc7` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:36.243258 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14425035-2c25-40ab-8929-4ef80a1c0a26 None admin] RBAC: Authorizing `identity:get_group(group_id=65f1096068354e63897b038ecbeeffc7)` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:35:36.244694 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14425035-2c25-40ab-8929-4ef80a1c0a26 None admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:35:36.246655 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 152/307] 10.222.0.42 () {56 vars in 1180 bytes} [Sun Oct 30 00:35:36 2022] GET /identity/v3/groups/65f1096068354e63897b038ecbeeffc7 => generated 226 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:35:36.252646 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756766e0-cf40-417a-bbb2-92d065f8080b None None] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:35:36.302810 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=100 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:35:36.306428 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14425035-2c25-40ab-8929-4ef80a1c0a26 None admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:35:36.369943 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=100 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:35:36.425123 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756766e0-cf40-417a-bbb2-92d065f8080b None None] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:35:36.464351 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14425035-2c25-40ab-8929-4ef80a1c0a26 None admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:35:36.471883 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987d6e86-cfe8-480e-9b62-8f8b49a9921f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:35:36.472775 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987d6e86-cfe8-480e-9b62-8f8b49a9921f None admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:36.473241 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987d6e86-cfe8-480e-9b62-8f8b49a9921f None admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:36.473729 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987d6e86-cfe8-480e-9b62-8f8b49a9921f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:36.474740 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987d6e86-cfe8-480e-9b62-8f8b49a9921f None admin] RBAC: Adding query filter params (group.id=65f1096068354e63897b038ecbeeffc7, role.id=1c93019874174c4b91118d9ce2347e47, scope.project.id=cbc9734c46db44918000791ce8bbb4e8) {{(pid=87955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:35:36.475270 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987d6e86-cfe8-480e-9b62-8f8b49a9921f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:35:36.476901 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987d6e86-cfe8-480e-9b62-8f8b49a9921f None admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:35:36.483889 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 156/308] 10.222.0.42 () {56 vars in 1376 bytes} [Sun Oct 30 00:35:36 2022] GET /identity/v3/role_assignments?group.id=65f1096068354e63897b038ecbeeffc7&scope.project.id=cbc9734c46db44918000791ce8bbb4e8&role.id=1c93019874174c4b91118d9ce2347e47 => generated 611 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:35:36.485076 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987d6e86-cfe8-480e-9b62-8f8b49a9921f None admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:35:36.509830 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d28f133-2831-466a-b6f7-a1fb366d7936 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:35:36.510408 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d28f133-2831-466a-b6f7-a1fb366d7936 None admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:36.510686 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d28f133-2831-466a-b6f7-a1fb366d7936 None admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:36.510954 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d28f133-2831-466a-b6f7-a1fb366d7936 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:36.525612 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d28f133-2831-466a-b6f7-a1fb366d7936 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 30 00:35:36.531657 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application [None req-1d28f133-2831-466a-b6f7-a1fb366d7936 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 30 00:35:36.531657 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:35:36.531657 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:35:36.531657 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:35:36.531657 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:35:36.531657 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:35:36.531657 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:35:36.531657 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:35:36.531657 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:35:36.531657 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:35:36.531657 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:35:36.531657 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:35:36.531657 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 30 00:35:36.531657 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 30 00:35:36.531657 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 30 00:35:36.531657 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 30 00:35:36.532599 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 30 00:35:36.532599 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 30 00:35:36.532599 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 30 00:35:36.532599 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 30 00:35:36.532599 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:35:36.532599 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:35:36.532599 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:35:36.532599 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:35:36.532599 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:35:36.532599 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:35:36.532599 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:35:36.532599 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application with Lock( Oct 30 00:35:36.532599 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:35:36.532599 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:35:36.532599 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:35:36.532599 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:35:36.533373 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:35:36.533373 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:35:36.533373 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:35:36.533373 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:35:36.533373 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 30 00:35:36.533373 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 30 00:35:36.533373 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 30 00:35:36.533373 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 30 00:35:36.533373 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 30 00:35:36.533373 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 30 00:35:36.533373 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 30 00:35:36.533373 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application Oct 30 00:35:36.536212 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 153/309] 10.222.0.42 () {56 vars in 1114 bytes} [Sun Oct 30 00:35:36 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:35:36.544741 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d28f133-2831-466a-b6f7-a1fb366d7936 None admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:35:36.631629 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=100 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:35:36.643007 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987d6e86-cfe8-480e-9b62-8f8b49a9921f None admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:35:36.683913 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af121e77-9afc-48ae-8f62-d9ed480b7815 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:35:36.684597 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af121e77-9afc-48ae-8f62-d9ed480b7815 None admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:36.684934 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af121e77-9afc-48ae-8f62-d9ed480b7815 None admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:36.685213 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af121e77-9afc-48ae-8f62-d9ed480b7815 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:36.699911 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af121e77-9afc-48ae-8f62-d9ed480b7815 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 30 00:35:36.706136 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application [None req-af121e77-9afc-48ae-8f62-d9ed480b7815 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 30 00:35:36.706136 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:35:36.706136 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:35:36.706136 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:35:36.706136 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:35:36.706136 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:35:36.706136 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:35:36.706136 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:35:36.706136 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:35:36.706136 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:35:36.706136 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:35:36.706136 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:35:36.706136 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 30 00:35:36.706136 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 30 00:35:36.706136 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 30 00:35:36.706136 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 30 00:35:36.707774 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 30 00:35:36.707774 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 30 00:35:36.707774 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 30 00:35:36.707774 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 30 00:35:36.707774 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:35:36.707774 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:35:36.707774 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:35:36.707774 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:35:36.707774 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:35:36.707774 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:35:36.707774 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:35:36.707774 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application with Lock( Oct 30 00:35:36.707774 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:35:36.707774 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:35:36.707774 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:35:36.707774 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:35:36.708639 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:35:36.708639 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:35:36.708639 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:35:36.708639 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:35:36.708639 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 30 00:35:36.708639 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 30 00:35:36.708639 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 30 00:35:36.708639 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 30 00:35:36.708639 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 30 00:35:36.708639 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 30 00:35:36.708639 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 30 00:35:36.708639 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application Oct 30 00:35:36.708639 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 157/310] 10.222.0.42 () {56 vars in 1099 bytes} [Sun Oct 30 00:35:36 2022] GET /identity/v3/roles/member => generated 84 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:35:36.717290 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af121e77-9afc-48ae-8f62-d9ed480b7815 None admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:35:36.785337 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d28f133-2831-466a-b6f7-a1fb366d7936 None admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:35:36.788665 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=100 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:35:36.832543 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2c84e6-c9e9-440a-a0ac-79dae44aa063 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:35:36.833176 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2c84e6-c9e9-440a-a0ac-79dae44aa063 None admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:36.833490 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2c84e6-c9e9-440a-a0ac-79dae44aa063 None admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:36.834681 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2c84e6-c9e9-440a-a0ac-79dae44aa063 None admin] PATH_INFO: `/v3/roles` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:36.834681 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2c84e6-c9e9-440a-a0ac-79dae44aa063 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87956) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:35:36.834863 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2c84e6-c9e9-440a-a0ac-79dae44aa063 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:35:36.836142 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2c84e6-c9e9-440a-a0ac-79dae44aa063 None admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:35:36.842206 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af121e77-9afc-48ae-8f62-d9ed480b7815 None admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:35:36.848079 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 154/311] 10.222.0.42 () {56 vars in 1111 bytes} [Sun Oct 30 00:35:36 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 30 00:35:36.857960 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2c84e6-c9e9-440a-a0ac-79dae44aa063 None admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:35:36.884030 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f5e6c0-bcad-4187-808a-88b6cb2ee088 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:35:36.884905 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f5e6c0-bcad-4187-808a-88b6cb2ee088 None admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:36.885311 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f5e6c0-bcad-4187-808a-88b6cb2ee088 None admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:36.885720 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f5e6c0-bcad-4187-808a-88b6cb2ee088 None admin] PATH_INFO: `/v3/roles` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:36.886525 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f5e6c0-bcad-4187-808a-88b6cb2ee088 None admin] RBAC: Adding query filter params (name=member) {{(pid=87955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:35:36.886960 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f5e6c0-bcad-4187-808a-88b6cb2ee088 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:35:36.888638 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f5e6c0-bcad-4187-808a-88b6cb2ee088 None admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:35:36.897687 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 158/312] 10.222.0.42 () {56 vars in 1101 bytes} [Sun Oct 30 00:35:36 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:35:36.904480 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f5e6c0-bcad-4187-808a-88b6cb2ee088 None admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:35:36.919088 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=100 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:35:37.007052 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2c84e6-c9e9-440a-a0ac-79dae44aa063 None admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:35:37.031711 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f5e6c0-bcad-4187-808a-88b6cb2ee088 None admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:35:37.050994 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82dea84d-da37-40fe-96ae-f5f24d5b322b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:35:37.051715 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dea84d-da37-40fe-96ae-f5f24d5b322b None admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:37.052315 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dea84d-da37-40fe-96ae-f5f24d5b322b None admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:37.052542 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dea84d-da37-40fe-96ae-f5f24d5b322b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:37.079931 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1460bec3-f061-4a66-8b48-c377adb1cc7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:35:37.081081 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1460bec3-f061-4a66-8b48-c377adb1cc7d None admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:37.081494 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1460bec3-f061-4a66-8b48-c377adb1cc7d None admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:37.081891 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1460bec3-f061-4a66-8b48-c377adb1cc7d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:37.086311 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=100 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:35:37.142725 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82dea84d-da37-40fe-96ae-f5f24d5b322b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:35:37.144525 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82dea84d-da37-40fe-96ae-f5f24d5b322b None admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:35:37.173390 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1460bec3-f061-4a66-8b48-c377adb1cc7d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:35:37.174936 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1460bec3-f061-4a66-8b48-c377adb1cc7d None admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:35:37.188888 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=100 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:35:37.261836 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 155/313] 10.222.0.42 () {58 vars in 1282 bytes} [Sun Oct 30 00:35:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 30 00:35:37.263943 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4beffcc4-a3d7-4047-a2d5-a70af81cbd6d None None] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:37.264227 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4beffcc4-a3d7-4047-a2d5-a70af81cbd6d None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:37.264493 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4beffcc4-a3d7-4047-a2d5-a70af81cbd6d None None] PATH_INFO: `/` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:37.265745 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 156/314] 10.222.0.42 () {54 vars in 927 bytes} [Sun Oct 30 00:35:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:35:37.268214 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4beffcc4-a3d7-4047-a2d5-a70af81cbd6d None None] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:35:37.311515 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 159/315] 10.222.0.42 () {58 vars in 1282 bytes} [Sun Oct 30 00:35:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 30 00:35:37.312540 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab249236-f62d-4543-8e8b-8834573b7d2c None None] REQUEST_METHOD: `POST` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:37.312818 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab249236-f62d-4543-8e8b-8834573b7d2c None None] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:37.313090 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab249236-f62d-4543-8e8b-8834573b7d2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:37.335761 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.auth.core [None req-ab249236-f62d-4543-8e8b-8834573b7d2c None None] MFA Rules not processed for user `eb55b6cbca4945abb21b0e49eb745e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=87955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:35:37.336964 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-ab249236-f62d-4543-8e8b-8834573b7d2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:35:37.340170 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=100 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:35:37.404897 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4beffcc4-a3d7-4047-a2d5-a70af81cbd6d None None] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:35:37.429808 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 160/316] 10.222.0.42 () {58 vars in 1024 bytes} [Sun Oct 30 00:35:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 30 00:35:37.430666 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab249236-f62d-4543-8e8b-8834573b7d2c None None] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:35:37.451598 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0f8ab3-5df6-4e11-bcd1-0a2fb6c7b6a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:35:37.452398 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0f8ab3-5df6-4e11-bcd1-0a2fb6c7b6a8 None admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:37.452776 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0f8ab3-5df6-4e11-bcd1-0a2fb6c7b6a8 None admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:37.453051 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0f8ab3-5df6-4e11-bcd1-0a2fb6c7b6a8 None admin] PATH_INFO: `/v3/projects/cbc9734c46db44918000791ce8bbb4e8` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:37.454781 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0f8ab3-5df6-4e11-bcd1-0a2fb6c7b6a8 None admin] RBAC: Authorizing `identity:get_project(project_id=cbc9734c46db44918000791ce8bbb4e8)` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:35:37.456594 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0f8ab3-5df6-4e11-bcd1-0a2fb6c7b6a8 None admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:35:37.459271 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 157/317] 10.222.0.42 () {56 vars in 1186 bytes} [Sun Oct 30 00:35:37 2022] GET /identity/v3/projects/cbc9734c46db44918000791ce8bbb4e8 => generated 298 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 30 00:35:37.465314 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0f8ab3-5df6-4e11-bcd1-0a2fb6c7b6a8 None admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:35:37.489859 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=100 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:35:37.580255 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab249236-f62d-4543-8e8b-8834573b7d2c None None] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:35:37.592164 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0f8ab3-5df6-4e11-bcd1-0a2fb6c7b6a8 None admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:35:37.622297 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952a78ff-f0d8-49ed-b32b-4d1b2367646a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:35:37.622297 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952a78ff-f0d8-49ed-b32b-4d1b2367646a None admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:37.622297 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952a78ff-f0d8-49ed-b32b-4d1b2367646a None admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:37.622297 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952a78ff-f0d8-49ed-b32b-4d1b2367646a None admin] PATH_INFO: `/v3/projects/0ca99d2d3e3d4195b47b4479559371ef` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:37.622650 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952a78ff-f0d8-49ed-b32b-4d1b2367646a None admin] RBAC: Authorizing `identity:get_project(project_id=0ca99d2d3e3d4195b47b4479559371ef)` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:35:37.624114 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952a78ff-f0d8-49ed-b32b-4d1b2367646a None admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:35:37.624494 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=100 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:35:37.626697 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 161/318] 10.222.0.42 () {56 vars in 1186 bytes} [Sun Oct 30 00:35:37 2022] GET /identity/v3/projects/0ca99d2d3e3d4195b47b4479559371ef => generated 302 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:35:37.627910 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854d7f3b-c624-4226-9bcb-7d8a3a53f7bb None None] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:37.628265 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854d7f3b-c624-4226-9bcb-7d8a3a53f7bb None None] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:37.628708 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854d7f3b-c624-4226-9bcb-7d8a3a53f7bb None None] PATH_INFO: `/` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:37.634722 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 162/319] 10.222.0.42 () {54 vars in 927 bytes} [Sun Oct 30 00:35:37 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:35:37.636266 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854d7f3b-c624-4226-9bcb-7d8a3a53f7bb None None] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:35:37.643910 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93881e8d-6bcc-42b0-b892-b019038b702a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:35:37.644788 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93881e8d-6bcc-42b0-b892-b019038b702a None admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:37.645064 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93881e8d-6bcc-42b0-b892-b019038b702a None admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:37.645331 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93881e8d-6bcc-42b0-b892-b019038b702a None admin] PATH_INFO: `/v3/groups/65f1096068354e63897b038ecbeeffc7` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:37.646457 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93881e8d-6bcc-42b0-b892-b019038b702a None admin] RBAC: Authorizing `identity:get_group(group_id=65f1096068354e63897b038ecbeeffc7)` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:35:37.647937 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93881e8d-6bcc-42b0-b892-b019038b702a None admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:35:37.649626 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 158/320] 10.222.0.42 () {56 vars in 1180 bytes} [Sun Oct 30 00:35:37 2022] GET /identity/v3/groups/65f1096068354e63897b038ecbeeffc7 => generated 226 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:35:37.650577 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5519a5-c68f-44f9-8333-517025198057 None None] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:37.650850 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5519a5-c68f-44f9-8333-517025198057 None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:37.651116 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5519a5-c68f-44f9-8333-517025198057 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:37.672224 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.auth.core [None req-dc5519a5-c68f-44f9-8333-517025198057 None None] MFA Rules not processed for user `eb55b6cbca4945abb21b0e49eb745e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=87956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:35:37.673399 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-dc5519a5-c68f-44f9-8333-517025198057 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:35:37.751286 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 159/321] 10.222.0.42 () {58 vars in 1024 bytes} [Sun Oct 30 00:35:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 30 00:35:37.751607 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5519a5-c68f-44f9-8333-517025198057 None None] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:35:37.765310 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854d7f3b-c624-4226-9bcb-7d8a3a53f7bb None None] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:35:37.775509 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=100 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:35:37.806130 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6cdb57-f3e8-4049-a8bd-b63d68b273f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:35:37.806770 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6cdb57-f3e8-4049-a8bd-b63d68b273f5 None admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:37.807044 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6cdb57-f3e8-4049-a8bd-b63d68b273f5 None admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:37.807365 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6cdb57-f3e8-4049-a8bd-b63d68b273f5 None admin] PATH_INFO: `/v3/groups/65f1096068354e63897b038ecbeeffc7` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:37.808456 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6cdb57-f3e8-4049-a8bd-b63d68b273f5 None admin] RBAC: Authorizing `identity:get_group(group_id=65f1096068354e63897b038ecbeeffc7)` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:35:37.809910 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6cdb57-f3e8-4049-a8bd-b63d68b273f5 None admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:35:37.811707 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 163/322] 10.222.0.42 () {56 vars in 1180 bytes} [Sun Oct 30 00:35:37 2022] GET /identity/v3/groups/65f1096068354e63897b038ecbeeffc7 => generated 226 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:35:37.812448 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6cdb57-f3e8-4049-a8bd-b63d68b273f5 None admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:35:37.881235 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5519a5-c68f-44f9-8333-517025198057 None None] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:35:37.912729 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=100 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:35:37.923566 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e712ee-0342-4618-8bbb-5f86ac6fb72a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:35:37.924197 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e712ee-0342-4618-8bbb-5f86ac6fb72a None admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:37.924950 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e712ee-0342-4618-8bbb-5f86ac6fb72a None admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:37.925286 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e712ee-0342-4618-8bbb-5f86ac6fb72a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:37.926094 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e712ee-0342-4618-8bbb-5f86ac6fb72a None admin] RBAC: Adding query filter params (group.id=65f1096068354e63897b038ecbeeffc7, role.id=7f42beaeb9e84fd8961e2fa0ae82d034, scope.project.id=cbc9734c46db44918000791ce8bbb4e8) {{(pid=87956) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:35:37.926468 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e712ee-0342-4618-8bbb-5f86ac6fb72a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:35:37.926865 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6cdb57-f3e8-4049-a8bd-b63d68b273f5 None admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:35:37.928125 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e712ee-0342-4618-8bbb-5f86ac6fb72a None admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:35:37.935232 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 160/323] 10.222.0.42 () {56 vars in 1376 bytes} [Sun Oct 30 00:35:37 2022] GET /identity/v3/role_assignments?group.id=65f1096068354e63897b038ecbeeffc7&scope.project.id=cbc9734c46db44918000791ce8bbb4e8&role.id=7f42beaeb9e84fd8961e2fa0ae82d034 => generated 611 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:35:37.937077 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e712ee-0342-4618-8bbb-5f86ac6fb72a None admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:35:37.973434 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a50cb5-2eb3-4b9d-8b60-5a17fe2a9082 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:35:37.974240 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a50cb5-2eb3-4b9d-8b60-5a17fe2a9082 None admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:37.974608 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a50cb5-2eb3-4b9d-8b60-5a17fe2a9082 None admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:37.974972 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a50cb5-2eb3-4b9d-8b60-5a17fe2a9082 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:37.987466 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a50cb5-2eb3-4b9d-8b60-5a17fe2a9082 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 30 00:35:37.992626 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application [None req-83a50cb5-2eb3-4b9d-8b60-5a17fe2a9082 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 30 00:35:37.992626 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:35:37.992626 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:35:37.992626 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:35:37.992626 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:35:37.992626 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:35:37.992626 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:35:37.992626 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:35:37.992626 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:35:37.992626 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:35:37.992626 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:35:37.992626 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:35:37.992626 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 30 00:35:37.992626 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 30 00:35:37.992626 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 30 00:35:37.992626 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 30 00:35:37.993756 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 30 00:35:37.993756 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 30 00:35:37.993756 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 30 00:35:37.993756 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 30 00:35:37.993756 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:35:37.993756 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:35:37.993756 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:35:37.993756 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:35:37.993756 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:35:37.993756 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:35:37.993756 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:35:37.993756 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application with Lock( Oct 30 00:35:37.993756 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:35:37.993756 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:35:37.993756 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:35:37.993756 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:35:37.994723 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:35:37.994723 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:35:37.994723 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:35:37.994723 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:35:37.994723 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 30 00:35:37.994723 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 30 00:35:37.994723 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 30 00:35:37.994723 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 30 00:35:37.994723 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 30 00:35:37.994723 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 30 00:35:37.994723 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 30 00:35:37.994723 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application Oct 30 00:35:37.996666 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 164/324] 10.222.0.42 () {56 vars in 1114 bytes} [Sun Oct 30 00:35:37 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:35:38.004375 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a50cb5-2eb3-4b9d-8b60-5a17fe2a9082 None admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:35:38.052268 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=100 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:35:38.069814 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e712ee-0342-4618-8bbb-5f86ac6fb72a None admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:35:38.131417 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07635c88-3a41-4f2f-88ed-1774ad56e3b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:35:38.131417 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07635c88-3a41-4f2f-88ed-1774ad56e3b8 None admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:38.131690 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07635c88-3a41-4f2f-88ed-1774ad56e3b8 None admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:38.131914 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07635c88-3a41-4f2f-88ed-1774ad56e3b8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:38.132698 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07635c88-3a41-4f2f-88ed-1774ad56e3b8 None admin] RBAC: Adding query filter params (group.id=65f1096068354e63897b038ecbeeffc7, role.id=1c93019874174c4b91118d9ce2347e47, scope.project.id=0ca99d2d3e3d4195b47b4479559371ef) {{(pid=87956) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:35:38.133246 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07635c88-3a41-4f2f-88ed-1774ad56e3b8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:35:38.134710 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07635c88-3a41-4f2f-88ed-1774ad56e3b8 None admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:35:38.146574 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 161/325] 10.222.0.42 () {56 vars in 1376 bytes} [Sun Oct 30 00:35:37 2022] GET /identity/v3/role_assignments?group.id=65f1096068354e63897b038ecbeeffc7&scope.project.id=0ca99d2d3e3d4195b47b4479559371ef&role.id=1c93019874174c4b91118d9ce2347e47 => generated 611 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:35:38.148007 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07635c88-3a41-4f2f-88ed-1774ad56e3b8 None admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:35:38.155229 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a50cb5-2eb3-4b9d-8b60-5a17fe2a9082 None admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:35:38.200985 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9560ca-a40c-4db1-b66e-54f1a02116cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:35:38.201828 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9560ca-a40c-4db1-b66e-54f1a02116cd None admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:38.202234 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9560ca-a40c-4db1-b66e-54f1a02116cd None admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:38.202607 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9560ca-a40c-4db1-b66e-54f1a02116cd None admin] PATH_INFO: `/v3/roles` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:38.203466 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9560ca-a40c-4db1-b66e-54f1a02116cd None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:35:38.203886 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9560ca-a40c-4db1-b66e-54f1a02116cd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:35:38.205492 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9560ca-a40c-4db1-b66e-54f1a02116cd None admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:35:38.221849 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=100 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:35:38.224876 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 165/326] 10.222.0.42 () {56 vars in 1111 bytes} [Sun Oct 30 00:35:38 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:35:38.229595 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9560ca-a40c-4db1-b66e-54f1a02116cd None admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:35:38.282853 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07635c88-3a41-4f2f-88ed-1774ad56e3b8 None admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:35:38.330840 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1215af-72a9-4ac8-a9bf-8114ed82bcc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:35:38.331558 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1215af-72a9-4ac8-a9bf-8114ed82bcc8 None admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:38.332183 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1215af-72a9-4ac8-a9bf-8114ed82bcc8 None admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:38.332532 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1215af-72a9-4ac8-a9bf-8114ed82bcc8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:38.347075 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1215af-72a9-4ac8-a9bf-8114ed82bcc8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 30 00:35:38.352863 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application [None req-ee1215af-72a9-4ac8-a9bf-8114ed82bcc8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 30 00:35:38.352863 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:35:38.352863 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:35:38.352863 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:35:38.352863 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:35:38.352863 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:35:38.352863 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:35:38.352863 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:35:38.352863 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:35:38.352863 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:35:38.352863 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:35:38.352863 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:35:38.352863 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 30 00:35:38.352863 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 30 00:35:38.352863 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 30 00:35:38.352863 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 30 00:35:38.353775 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 30 00:35:38.353775 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 30 00:35:38.353775 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 30 00:35:38.353775 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 30 00:35:38.353775 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:35:38.353775 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:35:38.353775 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:35:38.353775 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:35:38.353775 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:35:38.353775 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:35:38.353775 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:35:38.353775 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application with Lock( Oct 30 00:35:38.353775 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:35:38.353775 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:35:38.353775 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:35:38.353775 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:35:38.354552 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:35:38.354552 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:35:38.354552 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:35:38.354552 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:35:38.354552 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 30 00:35:38.354552 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 30 00:35:38.354552 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 30 00:35:38.354552 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 30 00:35:38.354552 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 30 00:35:38.354552 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 30 00:35:38.354552 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 30 00:35:38.354552 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application Oct 30 00:35:38.354552 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 162/327] 10.222.0.42 () {56 vars in 1096 bytes} [Sun Oct 30 00:35:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:35:38.360426 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1215af-72a9-4ac8-a9bf-8114ed82bcc8 None admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:35:38.360795 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=100 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:35:38.365817 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9560ca-a40c-4db1-b66e-54f1a02116cd None admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:35:38.410434 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f74ee68-49a8-4ff8-bc2b-149efb635d19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:35:38.411037 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f74ee68-49a8-4ff8-bc2b-149efb635d19 None admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:38.411355 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f74ee68-49a8-4ff8-bc2b-149efb635d19 None admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:38.411632 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f74ee68-49a8-4ff8-bc2b-149efb635d19 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:38.479780 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1215af-72a9-4ac8-a9bf-8114ed82bcc8 None admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:35:38.492830 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f74ee68-49a8-4ff8-bc2b-149efb635d19 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:35:38.494422 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f74ee68-49a8-4ff8-bc2b-149efb635d19 None admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:35:38.495362 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=100 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:35:38.518224 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a5d071-0060-43e1-9bce-31f8f43a50f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:35:38.518846 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a5d071-0060-43e1-9bce-31f8f43a50f1 None admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:38.519126 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a5d071-0060-43e1-9bce-31f8f43a50f1 None admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:38.519429 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a5d071-0060-43e1-9bce-31f8f43a50f1 None admin] PATH_INFO: `/v3/roles` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:38.520105 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a5d071-0060-43e1-9bce-31f8f43a50f1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87956) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:35:38.520410 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a5d071-0060-43e1-9bce-31f8f43a50f1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:35:38.521797 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a5d071-0060-43e1-9bce-31f8f43a50f1 None admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:35:38.531797 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 163/328] 10.222.0.42 () {56 vars in 1099 bytes} [Sun Oct 30 00:35:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 30 00:35:38.537748 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a5d071-0060-43e1-9bce-31f8f43a50f1 None admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:35:38.606072 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=100 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:35:38.612136 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 166/329] 10.222.0.42 () {58 vars in 1282 bytes} [Sun Oct 30 00:35:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Oct 30 00:35:38.617701 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f74ee68-49a8-4ff8-bc2b-149efb635d19 None admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:35:38.651779 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a5d071-0060-43e1-9bce-31f8f43a50f1 None admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:35:38.691791 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d2bc1a-01ba-45d8-a6a0-ff8bff794a73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:35:38.692364 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d2bc1a-01ba-45d8-a6a0-ff8bff794a73 None admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:38.692640 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d2bc1a-01ba-45d8-a6a0-ff8bff794a73 None admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:38.692913 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d2bc1a-01ba-45d8-a6a0-ff8bff794a73 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:38.733513 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f74ee68-49a8-4ff8-bc2b-149efb635d19 None admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:35:38.744182 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=100 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:35:38.770436 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d2bc1a-01ba-45d8-a6a0-ff8bff794a73 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:35:38.771946 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d2bc1a-01ba-45d8-a6a0-ff8bff794a73 None admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:35:38.773476 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acfae64-9f33-46eb-98c5-841f18cc3246 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:35:38.774135 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acfae64-9f33-46eb-98c5-841f18cc3246 None admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:38.774408 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acfae64-9f33-46eb-98c5-841f18cc3246 None admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:38.774674 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acfae64-9f33-46eb-98c5-841f18cc3246 None admin] PATH_INFO: `/v3/projects/0ca99d2d3e3d4195b47b4479559371ef` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:38.775807 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6acfae64-9f33-46eb-98c5-841f18cc3246 None admin] RBAC: Authorizing `identity:get_project(project_id=0ca99d2d3e3d4195b47b4479559371ef)` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:35:38.777212 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6acfae64-9f33-46eb-98c5-841f18cc3246 None admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:35:38.779164 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 167/330] 10.222.0.42 () {56 vars in 1186 bytes} [Sun Oct 30 00:35:38 2022] GET /identity/v3/projects/0ca99d2d3e3d4195b47b4479559371ef => generated 302 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 30 00:35:38.784657 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acfae64-9f33-46eb-98c5-841f18cc3246 None admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:35:38.855051 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=100 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:35:38.882640 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 164/331] 10.222.0.42 () {58 vars in 1282 bytes} [Sun Oct 30 00:35:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Oct 30 00:35:38.888275 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d2bc1a-01ba-45d8-a6a0-ff8bff794a73 None admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:35:38.888699 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acfae64-9f33-46eb-98c5-841f18cc3246 None admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:35:38.921354 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e195c7-1036-4ca6-b7b4-9eb4ab712354 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:35:38.921979 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e195c7-1036-4ca6-b7b4-9eb4ab712354 None admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:38.922252 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e195c7-1036-4ca6-b7b4-9eb4ab712354 None admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:38.922524 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e195c7-1036-4ca6-b7b4-9eb4ab712354 None admin] PATH_INFO: `/v3/groups/65f1096068354e63897b038ecbeeffc7` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:38.923690 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e195c7-1036-4ca6-b7b4-9eb4ab712354 None admin] RBAC: Authorizing `identity:get_group(group_id=65f1096068354e63897b038ecbeeffc7)` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:35:38.925126 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e195c7-1036-4ca6-b7b4-9eb4ab712354 None admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:35:38.926715 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 168/332] 10.222.0.42 () {56 vars in 1180 bytes} [Sun Oct 30 00:35:38 2022] GET /identity/v3/groups/65f1096068354e63897b038ecbeeffc7 => generated 226 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 30 00:35:38.932459 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e195c7-1036-4ca6-b7b4-9eb4ab712354 None admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:35:38.962765 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=100 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:35:38.985285 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d2bc1a-01ba-45d8-a6a0-ff8bff794a73 None admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:35:39.017567 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40aca52-aa8e-4ae5-a629-3c800bcb26c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:35:39.018190 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40aca52-aa8e-4ae5-a629-3c800bcb26c0 None admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:39.018454 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40aca52-aa8e-4ae5-a629-3c800bcb26c0 None admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:39.018720 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40aca52-aa8e-4ae5-a629-3c800bcb26c0 None admin] PATH_INFO: `/v3/projects/a39b871ca4334427a0ee2ffbee79352f` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:39.019844 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40aca52-aa8e-4ae5-a629-3c800bcb26c0 None admin] RBAC: Authorizing `identity:get_project(project_id=a39b871ca4334427a0ee2ffbee79352f)` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:35:39.021269 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40aca52-aa8e-4ae5-a629-3c800bcb26c0 None admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:35:39.022866 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 165/333] 10.222.0.42 () {56 vars in 1186 bytes} [Sun Oct 30 00:35:38 2022] GET /identity/v3/projects/a39b871ca4334427a0ee2ffbee79352f => generated 344 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 30 00:35:39.028658 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40aca52-aa8e-4ae5-a629-3c800bcb26c0 None admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:35:39.030375 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e195c7-1036-4ca6-b7b4-9eb4ab712354 None admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:35:39.066998 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c53dbae-e786-49c8-b20e-8acff96fa2bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:35:39.067668 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c53dbae-e786-49c8-b20e-8acff96fa2bc None admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:39.067945 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c53dbae-e786-49c8-b20e-8acff96fa2bc None admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:39.068216 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c53dbae-e786-49c8-b20e-8acff96fa2bc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:39.068939 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c53dbae-e786-49c8-b20e-8acff96fa2bc None admin] RBAC: Adding query filter params (group.id=65f1096068354e63897b038ecbeeffc7, role.id=7f42beaeb9e84fd8961e2fa0ae82d034, scope.project.id=0ca99d2d3e3d4195b47b4479559371ef) {{(pid=87955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:35:39.069244 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c53dbae-e786-49c8-b20e-8acff96fa2bc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:35:39.070705 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c53dbae-e786-49c8-b20e-8acff96fa2bc None admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:35:39.072515 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=100 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:35:39.077472 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 169/334] 10.222.0.42 () {56 vars in 1376 bytes} [Sun Oct 30 00:35:38 2022] GET /identity/v3/role_assignments?group.id=65f1096068354e63897b038ecbeeffc7&scope.project.id=0ca99d2d3e3d4195b47b4479559371ef&role.id=7f42beaeb9e84fd8961e2fa0ae82d034 => generated 611 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 30 00:35:39.133609 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40aca52-aa8e-4ae5-a629-3c800bcb26c0 None admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:35:39.176167 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807bd278-8c96-4ca0-8c5d-b7b82504deb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:35:39.176845 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807bd278-8c96-4ca0-8c5d-b7b82504deb1 None admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:39.177113 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807bd278-8c96-4ca0-8c5d-b7b82504deb1 None admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:39.177383 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807bd278-8c96-4ca0-8c5d-b7b82504deb1 None admin] PATH_INFO: `/v3/groups/f4af0d3cb89c453f9b5f6fd99f39dab3` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:39.178612 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807bd278-8c96-4ca0-8c5d-b7b82504deb1 None admin] RBAC: Authorizing `identity:get_group(group_id=f4af0d3cb89c453f9b5f6fd99f39dab3)` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:35:39.180100 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807bd278-8c96-4ca0-8c5d-b7b82504deb1 None admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:35:39.181919 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 166/335] 10.222.0.42 () {56 vars in 1180 bytes} [Sun Oct 30 00:35:39 2022] GET /identity/v3/groups/f4af0d3cb89c453f9b5f6fd99f39dab3 => generated 229 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 30 00:35:39.188218 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c53dbae-e786-49c8-b20e-8acff96fa2bc None admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:35:39.290408 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c53dbae-e786-49c8-b20e-8acff96fa2bc None admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:35:39.326799 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4b7f71-d6f6-4cb2-b222-6e798f52bc3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:35:39.327486 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4b7f71-d6f6-4cb2-b222-6e798f52bc3d None admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:39.327763 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4b7f71-d6f6-4cb2-b222-6e798f52bc3d None admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:39.328040 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4b7f71-d6f6-4cb2-b222-6e798f52bc3d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:39.328760 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4b7f71-d6f6-4cb2-b222-6e798f52bc3d None admin] RBAC: Adding query filter params (group.id=f4af0d3cb89c453f9b5f6fd99f39dab3, role.id=6ccaa8c11f29456fb4e4eeccb21616c7, scope.project.id=a39b871ca4334427a0ee2ffbee79352f) {{(pid=87955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:35:39.329062 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4b7f71-d6f6-4cb2-b222-6e798f52bc3d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:35:39.330545 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4b7f71-d6f6-4cb2-b222-6e798f52bc3d None admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:35:39.336739 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 170/336] 10.222.0.42 () {56 vars in 1376 bytes} [Sun Oct 30 00:35:39 2022] GET /identity/v3/role_assignments?group.id=f4af0d3cb89c453f9b5f6fd99f39dab3&scope.project.id=a39b871ca4334427a0ee2ffbee79352f&role.id=6ccaa8c11f29456fb4e4eeccb21616c7 => generated 611 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:35:41.870764 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72550b63-0038-4e82-949b-d35d3f0cdc86 None None] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:41.871448 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72550b63-0038-4e82-949b-d35d3f0cdc86 None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:41.871448 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72550b63-0038-4e82-949b-d35d3f0cdc86 None None] PATH_INFO: `/` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:41.872990 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 167/337] 10.222.0.42 () {54 vars in 927 bytes} [Sun Oct 30 00:35:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:35:41.878496 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7ff52b-ae4e-47ce-89a2-476038199595 None None] REQUEST_METHOD: `POST` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:41.878931 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7ff52b-ae4e-47ce-89a2-476038199595 None None] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:41.879013 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7ff52b-ae4e-47ce-89a2-476038199595 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:41.904300 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.auth.core [None req-0b7ff52b-ae4e-47ce-89a2-476038199595 None None] MFA Rules not processed for user `eb55b6cbca4945abb21b0e49eb745e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=87955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:35:41.905524 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-0b7ff52b-ae4e-47ce-89a2-476038199595 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:35:41.980204 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=100 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:35:41.992050 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 171/338] 10.222.0.42 () {58 vars in 1024 bytes} [Sun Oct 30 00:35:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 30 00:35:42.333372 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e393c4-06bc-4d2e-a952-9a60980dcc00 None None] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:42.333646 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e393c4-06bc-4d2e-a952-9a60980dcc00 None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:42.334081 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e393c4-06bc-4d2e-a952-9a60980dcc00 None None] PATH_INFO: `/` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:42.336059 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 168/339] 10.222.0.42 () {54 vars in 927 bytes} [Sun Oct 30 00:35:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:35:42.340985 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e393c4-06bc-4d2e-a952-9a60980dcc00 None None] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:35:42.352669 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae9424a-29e4-4dec-8f21-3b5d6f81b02f None None] REQUEST_METHOD: `POST` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:42.353315 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae9424a-29e4-4dec-8f21-3b5d6f81b02f None None] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:42.353794 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae9424a-29e4-4dec-8f21-3b5d6f81b02f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:42.368223 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=100 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:35:42.389409 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.auth.core [None req-0ae9424a-29e4-4dec-8f21-3b5d6f81b02f None None] MFA Rules not processed for user `eb55b6cbca4945abb21b0e49eb745e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=87955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:35:42.391170 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-0ae9424a-29e4-4dec-8f21-3b5d6f81b02f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:35:42.483982 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e393c4-06bc-4d2e-a952-9a60980dcc00 None None] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:35:42.514161 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 172/340] 10.222.0.42 () {58 vars in 1024 bytes} [Sun Oct 30 00:35:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 30 00:35:42.516296 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dbee83-f609-44c8-aa91-de24a53e4bc9 None None] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:42.516861 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dbee83-f609-44c8-aa91-de24a53e4bc9 None None] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:42.517328 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dbee83-f609-44c8-aa91-de24a53e4bc9 None None] PATH_INFO: `/` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:42.519004 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 173/341] 10.222.0.42 () {54 vars in 927 bytes} [Sun Oct 30 00:35:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:35:42.524621 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd38d9fd-cf6e-4122-9d5d-da3561800e98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:35:42.524970 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c199c268-c9b5-4271-8d96-ef758439edec None None] REQUEST_METHOD: `POST` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:42.525408 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c199c268-c9b5-4271-8d96-ef758439edec None None] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:42.525534 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd38d9fd-cf6e-4122-9d5d-da3561800e98 None admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:42.525919 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd38d9fd-cf6e-4122-9d5d-da3561800e98 None admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:42.526209 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c199c268-c9b5-4271-8d96-ef758439edec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:42.526323 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd38d9fd-cf6e-4122-9d5d-da3561800e98 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:42.537816 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd38d9fd-cf6e-4122-9d5d-da3561800e98 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:35:42.539428 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd38d9fd-cf6e-4122-9d5d-da3561800e98 None admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:35:42.547656 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.auth.core [None req-c199c268-c9b5-4271-8d96-ef758439edec None None] MFA Rules not processed for user `eb55b6cbca4945abb21b0e49eb745e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=87955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:35:42.549142 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-c199c268-c9b5-4271-8d96-ef758439edec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:35:42.554571 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application [None req-cd38d9fd-cf6e-4122-9d5d-da3561800e98 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 30 00:35:42.554571 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:35:42.554571 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:35:42.554571 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:35:42.554571 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:35:42.554571 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:35:42.554571 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:35:42.554571 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:35:42.554571 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:35:42.554571 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:35:42.554571 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:35:42.554571 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:35:42.554571 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 30 00:35:42.554571 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 30 00:35:42.554571 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 30 00:35:42.554571 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 30 00:35:42.555766 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:35:42.555766 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:35:42.555766 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:35:42.555766 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:35:42.555766 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:35:42.555766 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:35:42.555766 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:35:42.555766 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application with Lock( Oct 30 00:35:42.555766 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:35:42.555766 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:35:42.555766 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:35:42.555766 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:35:42.555766 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:35:42.555766 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:35:42.555766 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:35:42.555766 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:35:42.555766 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 30 00:35:42.556705 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 30 00:35:42.556705 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 30 00:35:42.556705 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application Oct 30 00:35:42.557259 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 169/342] 10.222.0.42 () {56 vars in 1108 bytes} [Sun Oct 30 00:35:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 30 00:35:42.564786 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd38d9fd-cf6e-4122-9d5d-da3561800e98 None admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:35:42.627435 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 174/343] 10.222.0.42 () {58 vars in 1024 bytes} [Sun Oct 30 00:35:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 30 00:35:42.648390 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=100 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:35:42.688519 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd38d9fd-cf6e-4122-9d5d-da3561800e98 None admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:35:42.737550 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2435aa11-1518-4497-a230-b4a5a4af31f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:35:42.738419 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2435aa11-1518-4497-a230-b4a5a4af31f0 None admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:42.738840 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2435aa11-1518-4497-a230-b4a5a4af31f0 None admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:42.739283 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2435aa11-1518-4497-a230-b4a5a4af31f0 None admin] PATH_INFO: `/v3/domains` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:42.740080 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2435aa11-1518-4497-a230-b4a5a4af31f0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87956) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:35:42.740534 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2435aa11-1518-4497-a230-b4a5a4af31f0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:35:42.742038 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2435aa11-1518-4497-a230-b4a5a4af31f0 None admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:35:42.757832 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 170/344] 10.222.0.42 () {56 vars in 1109 bytes} [Sun Oct 30 00:35:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:35:42.763917 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c199c268-c9b5-4271-8d96-ef758439edec None None] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:35:42.818919 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f95bf44-cf3c-4450-8cbe-a1fa57783256 None None] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:42.819562 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f95bf44-cf3c-4450-8cbe-a1fa57783256 None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:42.820546 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f95bf44-cf3c-4450-8cbe-a1fa57783256 None None] PATH_INFO: `/` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:42.822602 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 171/345] 10.222.0.42 () {54 vars in 927 bytes} [Sun Oct 30 00:35:42 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 30 00:35:42.830016 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20980be3-cd1f-44c1-87bc-9725ad2eab19 None None] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:42.831121 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20980be3-cd1f-44c1-87bc-9725ad2eab19 None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:42.831627 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20980be3-cd1f-44c1-87bc-9725ad2eab19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:42.835744 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=100 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:35:42.857179 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.auth.core [None req-20980be3-cd1f-44c1-87bc-9725ad2eab19 None None] MFA Rules not processed for user `eb55b6cbca4945abb21b0e49eb745e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=87956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:35:42.858930 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-20980be3-cd1f-44c1-87bc-9725ad2eab19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:35:42.930882 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c199c268-c9b5-4271-8d96-ef758439edec None None] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:35:42.941741 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 172/346] 10.222.0.42 () {58 vars in 1024 bytes} [Sun Oct 30 00:35:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 30 00:35:42.941741 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20980be3-cd1f-44c1-87bc-9725ad2eab19 None None] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:35:42.976210 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77235d6d-4593-4be5-b1f6-71a06d9b24fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:35:42.977033 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77235d6d-4593-4be5-b1f6-71a06d9b24fe None admin] REQUEST_METHOD: `POST` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:42.977484 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77235d6d-4593-4be5-b1f6-71a06d9b24fe None admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:42.977856 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77235d6d-4593-4be5-b1f6-71a06d9b24fe None admin] PATH_INFO: `/v3/users` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:42.978642 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77235d6d-4593-4be5-b1f6-71a06d9b24fe None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:35:42.980477 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77235d6d-4593-4be5-b1f6-71a06d9b24fe None admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:35:43.004537 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=100 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:35:43.008865 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 175/347] 10.222.0.42 () {60 vars in 1132 bytes} [Sun Oct 30 00:35:42 2022] POST /identity/v3/users => generated 246 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 00:35:43.010224 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77235d6d-4593-4be5-b1f6-71a06d9b24fe None admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:35:43.060935 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20980be3-cd1f-44c1-87bc-9725ad2eab19 None None] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:35:43.101668 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e47d2c4-ab95-491d-b049-a69e9cba23c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:35:43.102633 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e47d2c4-ab95-491d-b049-a69e9cba23c6 None admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:43.103065 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e47d2c4-ab95-491d-b049-a69e9cba23c6 None admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:43.103511 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e47d2c4-ab95-491d-b049-a69e9cba23c6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:43.115794 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e47d2c4-ab95-491d-b049-a69e9cba23c6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:35:43.117678 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e47d2c4-ab95-491d-b049-a69e9cba23c6 None admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:35:43.134234 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application [None req-9e47d2c4-ab95-491d-b049-a69e9cba23c6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 30 00:35:43.134234 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:35:43.134234 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:35:43.134234 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:35:43.134234 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:35:43.134234 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:35:43.134234 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:35:43.134234 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:35:43.134234 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:35:43.134234 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:35:43.134234 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:35:43.134234 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:35:43.134234 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 30 00:35:43.134234 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 30 00:35:43.134234 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 30 00:35:43.134234 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 30 00:35:43.135435 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:35:43.135435 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:35:43.135435 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:35:43.135435 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:35:43.135435 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:35:43.135435 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:35:43.135435 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:35:43.135435 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application with Lock( Oct 30 00:35:43.135435 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:35:43.135435 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:35:43.135435 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:35:43.135435 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:35:43.135435 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:35:43.135435 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:35:43.135435 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:35:43.135435 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:35:43.135435 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 30 00:35:43.136308 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 30 00:35:43.136308 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 30 00:35:43.136308 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application Oct 30 00:35:43.138198 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 173/348] 10.222.0.42 () {56 vars in 1108 bytes} [Sun Oct 30 00:35:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:35:43.145853 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e47d2c4-ab95-491d-b049-a69e9cba23c6 None admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:35:43.153354 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77235d6d-4593-4be5-b1f6-71a06d9b24fe None admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:35:43.168119 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:35:43.193315 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6663fd-f870-41be-8b8b-40b4ae2ca210 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:35:43.193946 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6663fd-f870-41be-8b8b-40b4ae2ca210 None admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:43.194220 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6663fd-f870-41be-8b8b-40b4ae2ca210 None admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:43.194598 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6663fd-f870-41be-8b8b-40b4ae2ca210 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:43.213267 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6663fd-f870-41be-8b8b-40b4ae2ca210 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:35:43.215390 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6663fd-f870-41be-8b8b-40b4ae2ca210 None admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:35:43.235039 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application [None req-8e6663fd-f870-41be-8b8b-40b4ae2ca210 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 30 00:35:43.235039 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:35:43.235039 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:35:43.235039 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:35:43.235039 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:35:43.235039 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:35:43.235039 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:35:43.235039 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:35:43.235039 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:35:43.235039 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:35:43.235039 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:35:43.235039 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:35:43.235039 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 30 00:35:43.235039 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 30 00:35:43.235039 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 30 00:35:43.235039 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 30 00:35:43.236029 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:35:43.236029 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:35:43.236029 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:35:43.236029 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:35:43.236029 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:35:43.236029 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:35:43.236029 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:35:43.236029 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application with Lock( Oct 30 00:35:43.236029 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:35:43.236029 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:35:43.236029 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:35:43.236029 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:35:43.236029 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:35:43.236029 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:35:43.236029 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:35:43.236029 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:35:43.236029 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 30 00:35:43.236863 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 30 00:35:43.236863 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 30 00:35:43.236863 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application Oct 30 00:35:43.236863 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 176/349] 10.222.0.42 () {56 vars in 1108 bytes} [Sun Oct 30 00:35:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:35:43.248065 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6663fd-f870-41be-8b8b-40b4ae2ca210 None admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:35:43.373935 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6663fd-f870-41be-8b8b-40b4ae2ca210 None admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:35:43.379944 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e47d2c4-ab95-491d-b049-a69e9cba23c6 None admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:35:43.387515 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=100 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:35:43.422654 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e955ab-2f13-4e62-a008-5cf578394985 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:35:43.423874 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e955ab-2f13-4e62-a008-5cf578394985 None admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:43.424452 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e955ab-2f13-4e62-a008-5cf578394985 None admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:43.424921 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e955ab-2f13-4e62-a008-5cf578394985 None admin] PATH_INFO: `/v3/domains` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:43.425925 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e955ab-2f13-4e62-a008-5cf578394985 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87956) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:35:43.426472 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e955ab-2f13-4e62-a008-5cf578394985 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:35:43.426576 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a585463-f0cc-409f-a1c6-4bce419cc1ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:35:43.427283 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a585463-f0cc-409f-a1c6-4bce419cc1ce None admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:43.427636 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a585463-f0cc-409f-a1c6-4bce419cc1ce None admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:43.427980 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a585463-f0cc-409f-a1c6-4bce419cc1ce None admin] PATH_INFO: `/v3/domains` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:43.428698 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a585463-f0cc-409f-a1c6-4bce419cc1ce None admin] RBAC: Adding query filter params (name=Default) {{(pid=87955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:35:43.429071 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a585463-f0cc-409f-a1c6-4bce419cc1ce None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:35:43.429647 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e955ab-2f13-4e62-a008-5cf578394985 None admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:35:43.430568 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a585463-f0cc-409f-a1c6-4bce419cc1ce None admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:35:43.443460 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 174/350] 10.222.0.42 () {56 vars in 1109 bytes} [Sun Oct 30 00:35:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:35:43.448208 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 177/351] 10.222.0.42 () {56 vars in 1109 bytes} [Sun Oct 30 00:35:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:35:43.448208 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a029530d-1022-4826-8707-edd2c3c48a7c None None] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:43.448208 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a029530d-1022-4826-8707-edd2c3c48a7c None None] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:43.448208 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a029530d-1022-4826-8707-edd2c3c48a7c None None] PATH_INFO: `/` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:43.449303 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e955ab-2f13-4e62-a008-5cf578394985 None admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:35:43.451376 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 178/352] 10.222.0.42 () {54 vars in 927 bytes} [Sun Oct 30 00:35:43 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:35:43.452254 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a029530d-1022-4826-8707-edd2c3c48a7c None None] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:35:43.475270 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=100 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:35:43.552466 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e955ab-2f13-4e62-a008-5cf578394985 None admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:35:43.561705 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a029530d-1022-4826-8707-edd2c3c48a7c None None] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:35:43.587095 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefe16bd-23bc-45f3-bdf8-cf3c5d50768d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:35:43.587754 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefe16bd-23bc-45f3-bdf8-cf3c5d50768d None admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:43.588029 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefe16bd-23bc-45f3-bdf8-cf3c5d50768d None admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:43.588302 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefe16bd-23bc-45f3-bdf8-cf3c5d50768d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:43.598226 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefe16bd-23bc-45f3-bdf8-cf3c5d50768d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:35:43.599705 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefe16bd-23bc-45f3-bdf8-cf3c5d50768d None admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:35:43.601615 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cc0482-6ec2-47d1-874e-d8db673eb16b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:35:43.602417 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cc0482-6ec2-47d1-874e-d8db673eb16b None admin] REQUEST_METHOD: `POST` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:43.602862 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cc0482-6ec2-47d1-874e-d8db673eb16b None admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:43.603316 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cc0482-6ec2-47d1-874e-d8db673eb16b None admin] PATH_INFO: `/v3/users` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:43.604129 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1cc0482-6ec2-47d1-874e-d8db673eb16b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:35:43.605724 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1cc0482-6ec2-47d1-874e-d8db673eb16b None admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:35:43.614508 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application [None req-eefe16bd-23bc-45f3-bdf8-cf3c5d50768d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 30 00:35:43.614508 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:35:43.614508 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:35:43.614508 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:35:43.614508 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:35:43.614508 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:35:43.614508 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:35:43.614508 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:35:43.614508 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:35:43.614508 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:35:43.614508 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:35:43.614508 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:35:43.614508 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 30 00:35:43.614508 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 30 00:35:43.614508 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 30 00:35:43.614508 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 30 00:35:43.615519 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:35:43.615519 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:35:43.615519 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:35:43.615519 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:35:43.615519 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:35:43.615519 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:35:43.615519 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:35:43.615519 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application with Lock( Oct 30 00:35:43.615519 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:35:43.615519 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:35:43.615519 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:35:43.615519 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:35:43.615519 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:35:43.615519 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:35:43.615519 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:35:43.615519 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:35:43.615519 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 30 00:35:43.616549 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 30 00:35:43.616549 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 30 00:35:43.616549 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application Oct 30 00:35:43.616549 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 175/353] 10.222.0.42 () {56 vars in 1108 bytes} [Sun Oct 30 00:35:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:35:43.616549 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefe16bd-23bc-45f3-bdf8-cf3c5d50768d None admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:35:43.631715 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 179/354] 10.222.0.42 () {60 vars in 1132 bytes} [Sun Oct 30 00:35:43 2022] POST /identity/v3/users => generated 248 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 00:35:43.632966 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0964a1-0953-4e81-b270-6a84897d2c3d None None] REQUEST_METHOD: `POST` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:43.633244 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0964a1-0953-4e81-b270-6a84897d2c3d None None] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:43.633509 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0964a1-0953-4e81-b270-6a84897d2c3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:43.644857 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=100 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:35:43.657180 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.auth.core [None req-1d0964a1-0953-4e81-b270-6a84897d2c3d None None] MFA Rules not processed for user `eb55b6cbca4945abb21b0e49eb745e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=87955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:35:43.658468 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-1d0964a1-0953-4e81-b270-6a84897d2c3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:35:43.738686 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefe16bd-23bc-45f3-bdf8-cf3c5d50768d None admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:35:43.741122 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 180/355] 10.222.0.42 () {58 vars in 1024 bytes} [Sun Oct 30 00:35:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 30 00:35:43.742254 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0964a1-0953-4e81-b270-6a84897d2c3d None None] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:35:43.751386 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:35:43.829443 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c637c824-ce6e-4b5e-83b7-8939afada432 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:35:43.830083 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c637c824-ce6e-4b5e-83b7-8939afada432 None admin] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:43.830361 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c637c824-ce6e-4b5e-83b7-8939afada432 None admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:43.830952 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c637c824-ce6e-4b5e-83b7-8939afada432 None admin] PATH_INFO: `/v3/users` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:43.831642 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c637c824-ce6e-4b5e-83b7-8939afada432 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:35:43.833100 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c637c824-ce6e-4b5e-83b7-8939afada432 None admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:35:43.864872 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 176/356] 10.222.0.42 () {60 vars in 1132 bytes} [Sun Oct 30 00:35:43 2022] POST /identity/v3/users => generated 248 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 00:35:43.908927 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0964a1-0953-4e81-b270-6a84897d2c3d None None] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:35:43.955215 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad65e6b-e128-410b-b12b-df7b1bff3bfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:35:43.956184 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad65e6b-e128-410b-b12b-df7b1bff3bfd None admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:43.956573 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad65e6b-e128-410b-b12b-df7b1bff3bfd None admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:43.956855 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad65e6b-e128-410b-b12b-df7b1bff3bfd None admin] PATH_INFO: `/v3/domains` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:43.957568 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad65e6b-e128-410b-b12b-df7b1bff3bfd None admin] RBAC: Adding query filter params (name=Default) {{(pid=87955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:35:43.957874 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad65e6b-e128-410b-b12b-df7b1bff3bfd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:35:43.959356 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad65e6b-e128-410b-b12b-df7b1bff3bfd None admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:35:43.973681 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 181/357] 10.222.0.42 () {56 vars in 1109 bytes} [Sun Oct 30 00:35:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:35:43.979177 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c637c824-ce6e-4b5e-83b7-8939afada432 None admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:35:44.096899 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:35:44.118351 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad65e6b-e128-410b-b12b-df7b1bff3bfd None admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:35:44.124712 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c637c824-ce6e-4b5e-83b7-8939afada432 None admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:35:44.166533 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b698bd7-ef45-458d-b365-2adac1074a44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:35:44.167160 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b698bd7-ef45-458d-b365-2adac1074a44 None admin] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:44.167498 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b698bd7-ef45-458d-b365-2adac1074a44 None admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:44.167778 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b698bd7-ef45-458d-b365-2adac1074a44 None admin] PATH_INFO: `/v3/users` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:44.168967 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b698bd7-ef45-458d-b365-2adac1074a44 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:35:44.170415 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b698bd7-ef45-458d-b365-2adac1074a44 None admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:35:44.207667 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 177/358] 10.222.0.42 () {60 vars in 1132 bytes} [Sun Oct 30 00:35:43 2022] POST /identity/v3/users => generated 249 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 00:35:44.210878 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=100 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:35:44.263434 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad65e6b-e128-410b-b12b-df7b1bff3bfd None admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:35:44.312095 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19afe9e2-de54-49a0-a9fd-8f4ac21b6b4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:35:44.312724 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19afe9e2-de54-49a0-a9fd-8f4ac21b6b4e None admin] REQUEST_METHOD: `POST` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:44.313044 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19afe9e2-de54-49a0-a9fd-8f4ac21b6b4e None admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:44.313312 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19afe9e2-de54-49a0-a9fd-8f4ac21b6b4e None admin] PATH_INFO: `/v3/roles` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:44.314001 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19afe9e2-de54-49a0-a9fd-8f4ac21b6b4e None admin] RBAC: Authorizing `identity:create_role()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:35:44.315453 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19afe9e2-de54-49a0-a9fd-8f4ac21b6b4e None admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:35:44.327096 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.sql.core [None req-19afe9e2-de54-49a0-a9fd-8f4ac21b6b4e None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Oct 30 00:35:44.327096 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Oct 30 00:35:44.327096 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [parameters: {'id': '9e54e82862ff4e3495027860baabf119', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Oct 30 00:35:44.327096 dv-cinder-861491-6-smb devstack@keystone.service[87955]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=87955) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 30 00:35:44.344879 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application [None req-19afe9e2-de54-49a0-a9fd-8f4ac21b6b4e None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Oct 30 00:35:44.344879 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:35:44.344879 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 30 00:35:44.344879 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 30 00:35:44.344879 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 30 00:35:44.344879 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 30 00:35:44.344879 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 30 00:35:44.344879 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application result = self._query(query) Oct 30 00:35:44.344879 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 30 00:35:44.344879 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application conn.query(q) Oct 30 00:35:44.344879 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 30 00:35:44.344879 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 30 00:35:44.344879 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 30 00:35:44.344879 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application result.read() Oct 30 00:35:44.344879 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 30 00:35:44.345824 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 30 00:35:44.345824 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 30 00:35:44.345824 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 30 00:35:44.345824 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 30 00:35:44.345824 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 30 00:35:44.345824 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 30 00:35:44.345824 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 30 00:35:44.345824 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Oct 30 00:35:44.345824 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application Oct 30 00:35:44.345824 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 30 00:35:44.345824 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application Oct 30 00:35:44.345824 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:35:44.345824 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 30 00:35:44.345824 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 30 00:35:44.345824 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Oct 30 00:35:44.345824 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return ref.to_dict() Oct 30 00:35:44.345824 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 30 00:35:44.345824 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application next(self.gen) Oct 30 00:35:44.346780 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1068, in _transaction_scope Oct 30 00:35:44.346780 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application yield resource Oct 30 00:35:44.346780 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 30 00:35:44.346780 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application next(self.gen) Oct 30 00:35:44.346780 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 670, in _session Oct 30 00:35:44.346780 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application self.session.rollback() Oct 30 00:35:44.346780 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 30 00:35:44.346780 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application self.force_reraise() Oct 30 00:35:44.346780 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 30 00:35:44.346780 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application raise self.value Oct 30 00:35:44.346780 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 667, in _session Oct 30 00:35:44.346780 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 30 00:35:44.346780 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 695, in _end_session_transaction Oct 30 00:35:44.346780 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application session.commit() Oct 30 00:35:44.346780 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 30 00:35:44.346780 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 30 00:35:44.346780 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 30 00:35:44.348206 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application self._prepare_impl() Oct 30 00:35:44.348206 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 30 00:35:44.348206 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application self.session.flush() Oct 30 00:35:44.348206 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 30 00:35:44.348206 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application self._flush(objects) Oct 30 00:35:44.348206 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 30 00:35:44.348206 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 30 00:35:44.348206 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 30 00:35:44.348206 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application compat.raise_( Oct 30 00:35:44.348206 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 30 00:35:44.348206 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application raise exception Oct 30 00:35:44.348206 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 30 00:35:44.348206 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application flush_context.execute() Oct 30 00:35:44.348206 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 30 00:35:44.348206 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application rec.execute(self) Oct 30 00:35:44.348206 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 30 00:35:44.348206 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 30 00:35:44.349424 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 30 00:35:44.349424 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 30 00:35:44.349424 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Oct 30 00:35:44.349424 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application c = connection._execute_20( Oct 30 00:35:44.349424 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 30 00:35:44.349424 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 30 00:35:44.349424 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 30 00:35:44.349424 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 30 00:35:44.349424 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 30 00:35:44.349424 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 30 00:35:44.349424 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 30 00:35:44.349424 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 30 00:35:44.349424 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 30 00:35:44.349424 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 30 00:35:44.349424 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 30 00:35:44.349424 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application raise exception Oct 30 00:35:44.350210 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 30 00:35:44.350210 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 30 00:35:44.350210 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 30 00:35:44.350210 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 30 00:35:44.350210 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 30 00:35:44.350210 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application result = self._query(query) Oct 30 00:35:44.350210 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 30 00:35:44.350210 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application conn.query(q) Oct 30 00:35:44.350210 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 30 00:35:44.350210 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 30 00:35:44.350210 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 30 00:35:44.350210 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application result.read() Oct 30 00:35:44.350210 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 30 00:35:44.350210 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 30 00:35:44.350210 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 30 00:35:44.350210 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 30 00:35:44.355222 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 30 00:35:44.355222 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 30 00:35:44.355222 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 30 00:35:44.355222 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 30 00:35:44.355222 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Oct 30 00:35:44.355222 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Oct 30 00:35:44.355222 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application [parameters: {'id': '9e54e82862ff4e3495027860baabf119', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Oct 30 00:35:44.355222 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 30 00:35:44.355222 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application Oct 30 00:35:44.355222 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 30 00:35:44.355222 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application Oct 30 00:35:44.355222 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:35:44.355222 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:35:44.355222 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:35:44.355222 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:35:44.355222 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:35:44.357337 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:35:44.357337 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:35:44.357337 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:35:44.357337 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:35:44.357337 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:35:44.357337 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:35:44.357337 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Oct 30 00:35:44.357337 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Oct 30 00:35:44.357337 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:35:44.357337 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:35:44.357337 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Oct 30 00:35:44.357337 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Oct 30 00:35:44.357337 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 30 00:35:44.357337 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 30 00:35:44.357337 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Oct 30 00:35:44.357337 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application Oct 30 00:35:44.359301 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 182/359] 10.222.0.42 () {60 vars in 1131 bytes} [Sun Oct 30 00:35:44 2022] POST /identity/v3/roles => generated 144 bytes in 229 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Oct 30 00:35:44.359436 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b698bd7-ef45-458d-b365-2adac1074a44 None admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:35:44.493140 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b698bd7-ef45-458d-b365-2adac1074a44 None admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:35:44.540649 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c211d7-5967-4a4a-8fe8-185031a12f56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:35:44.541294 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c211d7-5967-4a4a-8fe8-185031a12f56 None admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:44.541572 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c211d7-5967-4a4a-8fe8-185031a12f56 None admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:44.541841 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c211d7-5967-4a4a-8fe8-185031a12f56 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:44.547601 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:35:44.553504 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c211d7-5967-4a4a-8fe8-185031a12f56 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 30 00:35:44.560628 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application [None req-99c211d7-5967-4a4a-8fe8-185031a12f56 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 30 00:35:44.560628 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:35:44.560628 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:35:44.560628 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:35:44.560628 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:35:44.560628 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:35:44.560628 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:35:44.560628 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:35:44.560628 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:35:44.560628 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:35:44.560628 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:35:44.560628 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:35:44.560628 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 30 00:35:44.560628 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 30 00:35:44.560628 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 30 00:35:44.560628 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 30 00:35:44.562742 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 30 00:35:44.562742 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 30 00:35:44.562742 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 30 00:35:44.562742 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 30 00:35:44.562742 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:35:44.562742 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:35:44.562742 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:35:44.562742 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:35:44.562742 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:35:44.562742 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:35:44.562742 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:35:44.562742 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application with Lock( Oct 30 00:35:44.562742 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:35:44.562742 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:35:44.562742 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:35:44.562742 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:35:44.564721 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:35:44.564721 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:35:44.564721 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:35:44.564721 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:35:44.564721 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 30 00:35:44.564721 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 30 00:35:44.564721 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 30 00:35:44.564721 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 30 00:35:44.564721 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 30 00:35:44.564721 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 30 00:35:44.564721 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 30 00:35:44.564721 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application Oct 30 00:35:44.564721 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 178/360] 10.222.0.42 () {56 vars in 1114 bytes} [Sun Oct 30 00:35:44 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:35:44.568574 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19afe9e2-de54-49a0-a9fd-8f4ac21b6b4e None admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:35:44.678752 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19afe9e2-de54-49a0-a9fd-8f4ac21b6b4e None admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:35:44.707152 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:35:44.715141 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e2a862-b579-4b09-b09f-ff3df2280a47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:35:44.715877 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e2a862-b579-4b09-b09f-ff3df2280a47 None admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:44.716176 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e2a862-b579-4b09-b09f-ff3df2280a47 None admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:44.716521 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e2a862-b579-4b09-b09f-ff3df2280a47 None admin] PATH_INFO: `/v3/roles` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:44.717429 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e2a862-b579-4b09-b09f-ff3df2280a47 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:35:44.717890 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e2a862-b579-4b09-b09f-ff3df2280a47 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:35:44.719438 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e2a862-b579-4b09-b09f-ff3df2280a47 None admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:35:44.728906 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 183/361] 10.222.0.42 () {56 vars in 1111 bytes} [Sun Oct 30 00:35:44 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:35:45.624960 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30640700-dfcd-461a-b860-2bbe871c97c1 None None] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:45.625505 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30640700-dfcd-461a-b860-2bbe871c97c1 None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:45.625505 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30640700-dfcd-461a-b860-2bbe871c97c1 None None] PATH_INFO: `/` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:45.627144 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 179/362] 10.222.0.42 () {54 vars in 927 bytes} [Sun Oct 30 00:35:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:35:45.632665 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d5f390-209a-4bbd-9093-b3d72f6846b0 None None] REQUEST_METHOD: `POST` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:45.633084 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d5f390-209a-4bbd-9093-b3d72f6846b0 None None] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:45.633193 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d5f390-209a-4bbd-9093-b3d72f6846b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:45.651871 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.auth.core [None req-83d5f390-209a-4bbd-9093-b3d72f6846b0 None None] MFA Rules not processed for user `eb55b6cbca4945abb21b0e49eb745e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=87955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:35:45.653055 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-83d5f390-209a-4bbd-9093-b3d72f6846b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:35:45.737912 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 184/363] 10.222.0.42 () {58 vars in 1024 bytes} [Sun Oct 30 00:35:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 30 00:35:46.082179 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30640700-dfcd-461a-b860-2bbe871c97c1 None None] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:35:46.194027 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30640700-dfcd-461a-b860-2bbe871c97c1 None None] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:35:46.227925 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a5e82a-95d7-4d1f-8fe1-68e926451c38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:35:46.228617 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a5e82a-95d7-4d1f-8fe1-68e926451c38 None admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:46.228888 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a5e82a-95d7-4d1f-8fe1-68e926451c38 None admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:46.229151 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a5e82a-95d7-4d1f-8fe1-68e926451c38 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:46.241548 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a5e82a-95d7-4d1f-8fe1-68e926451c38 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 30 00:35:46.246725 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application [None req-98a5e82a-95d7-4d1f-8fe1-68e926451c38 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 30 00:35:46.246725 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:35:46.246725 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:35:46.246725 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:35:46.246725 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:35:46.246725 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:35:46.246725 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:35:46.246725 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:35:46.246725 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:35:46.246725 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:35:46.246725 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:35:46.246725 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:35:46.246725 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 30 00:35:46.246725 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 30 00:35:46.246725 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 30 00:35:46.246725 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 30 00:35:46.247832 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 30 00:35:46.247832 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 30 00:35:46.247832 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 30 00:35:46.247832 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 30 00:35:46.247832 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:35:46.247832 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:35:46.247832 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:35:46.247832 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:35:46.247832 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:35:46.247832 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:35:46.247832 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:35:46.247832 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application with Lock( Oct 30 00:35:46.247832 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:35:46.247832 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:35:46.247832 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:35:46.247832 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:35:46.248606 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:35:46.248606 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:35:46.248606 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:35:46.248606 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:35:46.248606 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 30 00:35:46.248606 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 30 00:35:46.248606 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 30 00:35:46.248606 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 30 00:35:46.248606 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 30 00:35:46.248606 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 30 00:35:46.248606 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 30 00:35:46.248606 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application Oct 30 00:35:46.248606 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 180/364] 10.222.0.42 () {56 vars in 1102 bytes} [Sun Oct 30 00:35:46 2022] GET /identity/v3/roles/service => generated 85 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:35:46.256404 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d5f390-209a-4bbd-9093-b3d72f6846b0 None None] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:35:46.405367 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714475b5-e4b0-40e1-b014-7a9d84210897 None None] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:46.405550 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714475b5-e4b0-40e1-b014-7a9d84210897 None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:46.405823 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714475b5-e4b0-40e1-b014-7a9d84210897 None None] PATH_INFO: `/` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:46.408059 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 181/365] 10.222.0.42 () {54 vars in 927 bytes} [Sun Oct 30 00:35:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:35:46.413633 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db5be1e-89bf-4d80-855c-25da86e75df0 None None] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:46.413907 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db5be1e-89bf-4d80-855c-25da86e75df0 None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:46.414171 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db5be1e-89bf-4d80-855c-25da86e75df0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:46.415613 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d5f390-209a-4bbd-9093-b3d72f6846b0 None None] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:35:46.435941 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.auth.core [None req-1db5be1e-89bf-4d80-855c-25da86e75df0 None None] MFA Rules not processed for user `eb55b6cbca4945abb21b0e49eb745e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=87956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:35:46.438006 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-1db5be1e-89bf-4d80-855c-25da86e75df0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:35:46.454969 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=100 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:35:46.473625 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d288a0b4-fa8f-4693-90d9-cbe6f6759f28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:35:46.474248 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d288a0b4-fa8f-4693-90d9-cbe6f6759f28 None admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:46.474527 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d288a0b4-fa8f-4693-90d9-cbe6f6759f28 None admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:46.474795 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d288a0b4-fa8f-4693-90d9-cbe6f6759f28 None admin] PATH_INFO: `/v3/roles` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:46.475506 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d288a0b4-fa8f-4693-90d9-cbe6f6759f28 None admin] RBAC: Adding query filter params (name=service) {{(pid=87955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:35:46.475899 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d288a0b4-fa8f-4693-90d9-cbe6f6759f28 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:35:46.477290 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d288a0b4-fa8f-4693-90d9-cbe6f6759f28 None admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:35:46.491662 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=100 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:35:46.495633 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 185/366] 10.222.0.42 () {56 vars in 1103 bytes} [Sun Oct 30 00:35:46 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:35:46.501926 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d288a0b4-fa8f-4693-90d9-cbe6f6759f28 None admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:35:46.535723 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 182/367] 10.222.0.42 () {58 vars in 1024 bytes} [Sun Oct 30 00:35:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 30 00:35:46.628419 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d79f054-44c8-44f2-9f1c-c729257b4c0d None None] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:46.629492 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d79f054-44c8-44f2-9f1c-c729257b4c0d None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:46.629975 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d79f054-44c8-44f2-9f1c-c729257b4c0d None None] PATH_INFO: `/` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:46.631569 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 183/368] 10.222.0.42 () {54 vars in 927 bytes} [Sun Oct 30 00:35:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 30 00:35:46.635293 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d288a0b4-fa8f-4693-90d9-cbe6f6759f28 None admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:35:46.637538 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa5c421-2b84-4a6e-b5a4-90e7628d03ed None None] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:46.638027 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa5c421-2b84-4a6e-b5a4-90e7628d03ed None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:46.638514 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa5c421-2b84-4a6e-b5a4-90e7628d03ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:46.657063 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.auth.core [None req-0aa5c421-2b84-4a6e-b5a4-90e7628d03ed None None] MFA Rules not processed for user `eb55b6cbca4945abb21b0e49eb745e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=87956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:35:46.658559 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-0aa5c421-2b84-4a6e-b5a4-90e7628d03ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:35:46.671142 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162a3b4e-6895-4ae4-a7be-e1bbcbff1437 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:35:46.671800 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162a3b4e-6895-4ae4-a7be-e1bbcbff1437 None admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:46.672072 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162a3b4e-6895-4ae4-a7be-e1bbcbff1437 None admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:46.672337 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162a3b4e-6895-4ae4-a7be-e1bbcbff1437 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:46.686405 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162a3b4e-6895-4ae4-a7be-e1bbcbff1437 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:35:46.688675 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162a3b4e-6895-4ae4-a7be-e1bbcbff1437 None admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:35:46.707479 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application [None req-162a3b4e-6895-4ae4-a7be-e1bbcbff1437 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 30 00:35:46.707479 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:35:46.707479 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:35:46.707479 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:35:46.707479 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:35:46.707479 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:35:46.707479 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:35:46.707479 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:35:46.707479 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:35:46.707479 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:35:46.707479 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:35:46.707479 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:35:46.707479 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 30 00:35:46.707479 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 30 00:35:46.707479 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 30 00:35:46.707479 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 30 00:35:46.708441 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:35:46.708441 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:35:46.708441 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:35:46.708441 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:35:46.708441 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:35:46.708441 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:35:46.708441 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:35:46.708441 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application with Lock( Oct 30 00:35:46.708441 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:35:46.708441 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:35:46.708441 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:35:46.708441 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:35:46.708441 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:35:46.708441 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:35:46.708441 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:35:46.708441 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:35:46.708441 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 30 00:35:46.709292 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 30 00:35:46.709292 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 30 00:35:46.709292 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application Oct 30 00:35:46.709292 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 186/369] 10.222.0.42 () {56 vars in 1108 bytes} [Sun Oct 30 00:35:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 30 00:35:46.714135 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162a3b4e-6895-4ae4-a7be-e1bbcbff1437 None admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:35:46.751152 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 184/370] 10.222.0.42 () {58 vars in 1024 bytes} [Sun Oct 30 00:35:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 30 00:35:46.791622 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=100 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:35:46.863805 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162a3b4e-6895-4ae4-a7be-e1bbcbff1437 None admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:35:46.898333 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa5c421-2b84-4a6e-b5a4-90e7628d03ed None None] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:35:46.915718 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbfe90a-5f9a-4c26-bc73-2b9639711ab0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:35:46.916261 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbfe90a-5f9a-4c26-bc73-2b9639711ab0 None admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:46.916545 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbfe90a-5f9a-4c26-bc73-2b9639711ab0 None admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:46.916822 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbfe90a-5f9a-4c26-bc73-2b9639711ab0 None admin] PATH_INFO: `/v3/domains` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:46.917556 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbfe90a-5f9a-4c26-bc73-2b9639711ab0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:35:46.917862 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbfe90a-5f9a-4c26-bc73-2b9639711ab0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:35:46.919310 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbfe90a-5f9a-4c26-bc73-2b9639711ab0 None admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:35:46.941449 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 187/371] 10.222.0.42 () {56 vars in 1109 bytes} [Sun Oct 30 00:35:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 30 00:35:46.946866 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbfe90a-5f9a-4c26-bc73-2b9639711ab0 None admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:35:47.037660 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa5c421-2b84-4a6e-b5a4-90e7628d03ed None None] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:35:47.056584 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=100 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:35:47.061709 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=100 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:35:47.069011 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbfe90a-5f9a-4c26-bc73-2b9639711ab0 None admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:35:47.090981 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f91193-63e0-42e4-86e1-93f854048fac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:35:47.092017 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f91193-63e0-42e4-86e1-93f854048fac None admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:47.092464 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f91193-63e0-42e4-86e1-93f854048fac None admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:47.092918 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f91193-63e0-42e4-86e1-93f854048fac None admin] PATH_INFO: `/v3/roles/service` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:47.105028 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f91193-63e0-42e4-86e1-93f854048fac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 30 00:35:47.105930 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2e8625-e0d8-4179-8647-6caba7ddee61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:35:47.106632 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2e8625-e0d8-4179-8647-6caba7ddee61 None admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:47.106979 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2e8625-e0d8-4179-8647-6caba7ddee61 None admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:47.107346 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2e8625-e0d8-4179-8647-6caba7ddee61 None admin] PATH_INFO: `/v3/users/nova` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:47.111525 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application [None req-63f91193-63e0-42e4-86e1-93f854048fac None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 30 00:35:47.111525 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:35:47.111525 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:35:47.111525 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:35:47.111525 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:35:47.111525 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:35:47.111525 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:35:47.111525 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:35:47.111525 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:35:47.111525 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:35:47.111525 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:35:47.111525 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:35:47.111525 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 30 00:35:47.111525 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 30 00:35:47.111525 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 30 00:35:47.111525 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 30 00:35:47.112381 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 30 00:35:47.112381 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 30 00:35:47.112381 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 30 00:35:47.112381 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 30 00:35:47.112381 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:35:47.112381 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:35:47.112381 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:35:47.112381 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:35:47.112381 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:35:47.112381 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:35:47.112381 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:35:47.112381 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application with Lock( Oct 30 00:35:47.112381 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:35:47.112381 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:35:47.112381 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:35:47.112381 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:35:47.113167 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:35:47.113167 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:35:47.113167 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:35:47.113167 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:35:47.113167 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 30 00:35:47.113167 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 30 00:35:47.113167 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 30 00:35:47.113167 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 30 00:35:47.113167 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 30 00:35:47.113167 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 30 00:35:47.113167 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 30 00:35:47.113167 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application Oct 30 00:35:47.115359 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2e8625-e0d8-4179-8647-6caba7ddee61 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:35:47.116080 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 185/372] 10.222.0.42 () {56 vars in 1102 bytes} [Sun Oct 30 00:35:46 2022] GET /identity/v3/roles/service => generated 85 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:35:47.116957 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2e8625-e0d8-4179-8647-6caba7ddee61 None admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:35:47.117840 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91ce19d-9124-4bbc-a8e2-56679b1bb379 None None] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:47.118306 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91ce19d-9124-4bbc-a8e2-56679b1bb379 None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:47.119379 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91ce19d-9124-4bbc-a8e2-56679b1bb379 None None] PATH_INFO: `/` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:47.121090 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 186/373] 10.222.0.42 () {54 vars in 927 bytes} [Sun Oct 30 00:35:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:35:47.121945 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91ce19d-9124-4bbc-a8e2-56679b1bb379 None None] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:35:47.139938 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application [None req-af2e8625-e0d8-4179-8647-6caba7ddee61 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 30 00:35:47.139938 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:35:47.139938 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:35:47.139938 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:35:47.139938 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:35:47.139938 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:35:47.139938 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:35:47.139938 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:35:47.139938 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:35:47.139938 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:35:47.139938 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:35:47.139938 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:35:47.139938 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 30 00:35:47.139938 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 30 00:35:47.139938 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 30 00:35:47.139938 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 30 00:35:47.140885 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:35:47.140885 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:35:47.140885 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 30 00:35:47.140885 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 30 00:35:47.140885 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 30 00:35:47.140885 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 30 00:35:47.140885 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:35:47.140885 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:35:47.140885 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:35:47.140885 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:35:47.140885 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:35:47.140885 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application with Lock( Oct 30 00:35:47.140885 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:35:47.140885 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:35:47.140885 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:35:47.140885 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:35:47.140885 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:35:47.140885 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:35:47.141768 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:35:47.141768 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:35:47.141768 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 30 00:35:47.141768 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 30 00:35:47.141768 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 30 00:35:47.141768 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 30 00:35:47.141768 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 30 00:35:47.141768 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 30 00:35:47.141768 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 30 00:35:47.141768 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application Oct 30 00:35:47.141768 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 188/374] 10.222.0.42 () {56 vars in 1093 bytes} [Sun Oct 30 00:35:46 2022] GET /identity/v3/users/nova => generated 82 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:35:47.142320 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37096d4-b4c7-4de2-bf94-076dfe2bc4a1 None None] REQUEST_METHOD: `POST` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:47.142875 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37096d4-b4c7-4de2-bf94-076dfe2bc4a1 None None] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:47.142875 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37096d4-b4c7-4de2-bf94-076dfe2bc4a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:47.162339 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.auth.core [None req-b37096d4-b4c7-4de2-bf94-076dfe2bc4a1 None None] MFA Rules not processed for user `eb55b6cbca4945abb21b0e49eb745e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=87955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:35:47.163594 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-b37096d4-b4c7-4de2-bf94-076dfe2bc4a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:35:47.236077 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 189/375] 10.222.0.42 () {58 vars in 1024 bytes} [Sun Oct 30 00:35:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 30 00:35:47.237236 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37096d4-b4c7-4de2-bf94-076dfe2bc4a1 None None] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:35:47.245037 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91ce19d-9124-4bbc-a8e2-56679b1bb379 None None] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:35:47.305745 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55dedef-ec4f-46c7-807f-1100c78e7e16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:35:47.306353 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55dedef-ec4f-46c7-807f-1100c78e7e16 None admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:47.306627 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55dedef-ec4f-46c7-807f-1100c78e7e16 None admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:47.306895 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55dedef-ec4f-46c7-807f-1100c78e7e16 None admin] PATH_INFO: `/v3/roles` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:47.307648 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55dedef-ec4f-46c7-807f-1100c78e7e16 None admin] RBAC: Adding query filter params (name=service) {{(pid=87956) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:35:47.307945 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55dedef-ec4f-46c7-807f-1100c78e7e16 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:35:47.310127 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55dedef-ec4f-46c7-807f-1100c78e7e16 None admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:35:47.320802 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 187/376] 10.222.0.42 () {56 vars in 1103 bytes} [Sun Oct 30 00:35:47 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:35:47.324113 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55dedef-ec4f-46c7-807f-1100c78e7e16 None admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:35:47.348939 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=100 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:35:47.365701 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=100 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:35:47.367676 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37096d4-b4c7-4de2-bf94-076dfe2bc4a1 None None] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:35:47.406758 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3198d0-b3ff-44d2-857b-1facd6a32df0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:35:47.407974 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3198d0-b3ff-44d2-857b-1facd6a32df0 None admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:47.408455 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3198d0-b3ff-44d2-857b-1facd6a32df0 None admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:47.408959 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3198d0-b3ff-44d2-857b-1facd6a32df0 None admin] PATH_INFO: `/v3/users` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:47.409879 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3198d0-b3ff-44d2-857b-1facd6a32df0 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=87955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:35:47.410370 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3198d0-b3ff-44d2-857b-1facd6a32df0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:35:47.412314 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3198d0-b3ff-44d2-857b-1facd6a32df0 None admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:35:47.447039 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55dedef-ec4f-46c7-807f-1100c78e7e16 None admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:35:47.452482 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 190/377] 10.222.0.42 () {56 vars in 1133 bytes} [Sun Oct 30 00:35:47 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:35:47.453594 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3198d0-b3ff-44d2-857b-1facd6a32df0 None admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:35:47.496036 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d730ac16-da9d-4d3b-b4e9-59a58b2b3371 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:35:47.496594 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d730ac16-da9d-4d3b-b4e9-59a58b2b3371 None admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:47.496876 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d730ac16-da9d-4d3b-b4e9-59a58b2b3371 None admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:47.497152 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d730ac16-da9d-4d3b-b4e9-59a58b2b3371 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:47.514112 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d730ac16-da9d-4d3b-b4e9-59a58b2b3371 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 30 00:35:47.520270 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application [None req-d730ac16-da9d-4d3b-b4e9-59a58b2b3371 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 30 00:35:47.520270 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:35:47.520270 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:35:47.520270 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:35:47.520270 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:35:47.520270 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:35:47.520270 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:35:47.520270 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:35:47.520270 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:35:47.520270 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:35:47.520270 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:35:47.520270 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:35:47.520270 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 30 00:35:47.520270 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 30 00:35:47.520270 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 30 00:35:47.520270 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 30 00:35:47.521303 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 30 00:35:47.521303 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 30 00:35:47.521303 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 30 00:35:47.521303 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 30 00:35:47.521303 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:35:47.521303 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:35:47.521303 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:35:47.521303 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:35:47.521303 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:35:47.521303 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:35:47.521303 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:35:47.521303 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application with Lock( Oct 30 00:35:47.521303 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:35:47.521303 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:35:47.521303 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:35:47.521303 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:35:47.522098 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:35:47.522098 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:35:47.522098 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:35:47.522098 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:35:47.522098 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 30 00:35:47.522098 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 30 00:35:47.522098 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 30 00:35:47.522098 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 30 00:35:47.522098 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 30 00:35:47.522098 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 30 00:35:47.522098 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 30 00:35:47.522098 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application Oct 30 00:35:47.524991 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 188/378] 10.222.0.42 () {56 vars in 1102 bytes} [Sun Oct 30 00:35:47 2022] GET /identity/v3/roles/service => generated 85 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:35:47.526135 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d730ac16-da9d-4d3b-b4e9-59a58b2b3371 None admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:35:47.579794 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3198d0-b3ff-44d2-857b-1facd6a32df0 None admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:35:47.617104 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efbbf36-8e5c-4788-94e2-9c1082638f47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:35:47.617742 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efbbf36-8e5c-4788-94e2-9c1082638f47 None admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:47.618018 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efbbf36-8e5c-4788-94e2-9c1082638f47 None admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:47.618283 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efbbf36-8e5c-4788-94e2-9c1082638f47 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:47.622357 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=100 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:35:47.628678 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efbbf36-8e5c-4788-94e2-9c1082638f47 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:35:47.630346 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efbbf36-8e5c-4788-94e2-9c1082638f47 None admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:35:47.632958 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=100 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:35:47.634380 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d730ac16-da9d-4d3b-b4e9-59a58b2b3371 None admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:35:47.645981 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application [None req-8efbbf36-8e5c-4788-94e2-9c1082638f47 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 30 00:35:47.645981 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:35:47.645981 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:35:47.645981 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:35:47.645981 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:35:47.645981 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:35:47.645981 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:35:47.645981 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:35:47.645981 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:35:47.645981 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:35:47.645981 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:35:47.645981 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:35:47.645981 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 30 00:35:47.645981 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 30 00:35:47.645981 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 30 00:35:47.645981 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 30 00:35:47.647174 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:35:47.647174 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:35:47.647174 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:35:47.647174 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:35:47.647174 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:35:47.647174 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:35:47.647174 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:35:47.647174 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application with Lock( Oct 30 00:35:47.647174 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:35:47.647174 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:35:47.647174 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:35:47.647174 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:35:47.647174 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:35:47.647174 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:35:47.647174 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:35:47.647174 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:35:47.647174 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 30 00:35:47.648047 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 30 00:35:47.648047 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 30 00:35:47.648047 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application Oct 30 00:35:47.648047 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 191/379] 10.222.0.42 () {56 vars in 1108 bytes} [Sun Oct 30 00:35:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:35:47.648047 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efbbf36-8e5c-4788-94e2-9c1082638f47 None admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:35:47.670275 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e09588-c049-4765-86c8-89be1dcac749 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:35:47.670905 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e09588-c049-4765-86c8-89be1dcac749 None admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:47.671183 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e09588-c049-4765-86c8-89be1dcac749 None admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:47.671484 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e09588-c049-4765-86c8-89be1dcac749 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:47.682167 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e09588-c049-4765-86c8-89be1dcac749 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:35:47.683943 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e09588-c049-4765-86c8-89be1dcac749 None admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:35:47.698382 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application [None req-24e09588-c049-4765-86c8-89be1dcac749 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 30 00:35:47.698382 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:35:47.698382 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:35:47.698382 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:35:47.698382 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:35:47.698382 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:35:47.698382 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:35:47.698382 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:35:47.698382 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:35:47.698382 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:35:47.698382 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:35:47.698382 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:35:47.698382 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 30 00:35:47.698382 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 30 00:35:47.698382 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 30 00:35:47.698382 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 30 00:35:47.699488 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:35:47.699488 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:35:47.699488 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:35:47.699488 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:35:47.699488 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:35:47.699488 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:35:47.699488 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:35:47.699488 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application with Lock( Oct 30 00:35:47.699488 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:35:47.699488 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:35:47.699488 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:35:47.699488 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:35:47.699488 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:35:47.699488 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:35:47.699488 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:35:47.699488 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:35:47.699488 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 30 00:35:47.700339 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 30 00:35:47.700339 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 30 00:35:47.700339 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application Oct 30 00:35:47.700339 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 189/380] 10.222.0.42 () {56 vars in 1108 bytes} [Sun Oct 30 00:35:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:35:47.700339 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e09588-c049-4765-86c8-89be1dcac749 None admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:35:47.751626 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efbbf36-8e5c-4788-94e2-9c1082638f47 None admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:35:47.784185 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e757c7-6869-4409-b120-c2978c574d98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:35:47.784787 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e757c7-6869-4409-b120-c2978c574d98 None admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:47.785056 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e757c7-6869-4409-b120-c2978c574d98 None admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:47.785320 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e757c7-6869-4409-b120-c2978c574d98 None admin] PATH_INFO: `/v3/roles` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:47.785977 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e757c7-6869-4409-b120-c2978c574d98 None admin] RBAC: Adding query filter params (name=service) {{(pid=87955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:35:47.786270 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e757c7-6869-4409-b120-c2978c574d98 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:35:47.787667 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e757c7-6869-4409-b120-c2978c574d98 None admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:35:47.795210 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 192/381] 10.222.0.42 () {56 vars in 1103 bytes} [Sun Oct 30 00:35:47 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:35:47.796511 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2825af0d-c43e-479c-af71-7d44b81236fe None None] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:47.796793 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2825af0d-c43e-479c-af71-7d44b81236fe None None] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:47.797367 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2825af0d-c43e-479c-af71-7d44b81236fe None None] PATH_INFO: `/` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:47.799895 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e09588-c049-4765-86c8-89be1dcac749 None admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:35:47.802902 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 193/382] 10.222.0.42 () {54 vars in 927 bytes} [Sun Oct 30 00:35:47 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:35:47.803728 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2825af0d-c43e-479c-af71-7d44b81236fe None None] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:35:47.834826 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e65eb6-37ae-426b-a8ae-7b04cbcb9007 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:35:47.835490 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e65eb6-37ae-426b-a8ae-7b04cbcb9007 None admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:47.835774 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e65eb6-37ae-426b-a8ae-7b04cbcb9007 None admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:47.836074 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e65eb6-37ae-426b-a8ae-7b04cbcb9007 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:47.846341 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e65eb6-37ae-426b-a8ae-7b04cbcb9007 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 30 00:35:47.851628 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application [None req-64e65eb6-37ae-426b-a8ae-7b04cbcb9007 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 30 00:35:47.851628 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:35:47.851628 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:35:47.851628 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:35:47.851628 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:35:47.851628 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:35:47.851628 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:35:47.851628 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:35:47.851628 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:35:47.851628 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:35:47.851628 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:35:47.851628 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:35:47.851628 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 30 00:35:47.851628 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 30 00:35:47.851628 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 30 00:35:47.851628 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 30 00:35:47.852540 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 30 00:35:47.852540 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 30 00:35:47.852540 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 30 00:35:47.852540 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 30 00:35:47.852540 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:35:47.852540 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:35:47.852540 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:35:47.852540 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:35:47.852540 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:35:47.852540 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:35:47.852540 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:35:47.852540 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application with Lock( Oct 30 00:35:47.852540 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:35:47.852540 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:35:47.852540 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:35:47.852540 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:35:47.853338 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:35:47.853338 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:35:47.853338 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:35:47.853338 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:35:47.853338 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 30 00:35:47.853338 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 30 00:35:47.853338 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 30 00:35:47.853338 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 30 00:35:47.853338 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 30 00:35:47.853338 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 30 00:35:47.853338 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 30 00:35:47.853338 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application Oct 30 00:35:47.853338 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 190/383] 10.222.0.42 () {56 vars in 1102 bytes} [Sun Oct 30 00:35:47 2022] GET /identity/v3/roles/service => generated 85 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:35:47.853986 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e65eb6-37ae-426b-a8ae-7b04cbcb9007 None admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:35:47.858622 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=100 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:35:47.861521 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=100 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:35:47.903426 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2825af0d-c43e-479c-af71-7d44b81236fe None None] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:35:47.934887 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cab03e0-bdac-43c8-ac00-b19709342051 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:35:47.935525 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cab03e0-bdac-43c8-ac00-b19709342051 None admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:47.935802 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cab03e0-bdac-43c8-ac00-b19709342051 None admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:47.936088 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cab03e0-bdac-43c8-ac00-b19709342051 None admin] PATH_INFO: `/v3/domains` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:47.936727 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cab03e0-bdac-43c8-ac00-b19709342051 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:35:47.937020 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cab03e0-bdac-43c8-ac00-b19709342051 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:35:47.938367 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cab03e0-bdac-43c8-ac00-b19709342051 None admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:35:47.950559 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 194/384] 10.222.0.42 () {56 vars in 1109 bytes} [Sun Oct 30 00:35:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:35:47.951442 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cab03e0-bdac-43c8-ac00-b19709342051 None admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:35:47.952360 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e65eb6-37ae-426b-a8ae-7b04cbcb9007 None admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:35:47.986602 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35d3924-692d-436f-98af-4bf1364eabd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:35:47.987223 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35d3924-692d-436f-98af-4bf1364eabd8 None admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:47.987510 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35d3924-692d-436f-98af-4bf1364eabd8 None admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:47.987780 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35d3924-692d-436f-98af-4bf1364eabd8 None admin] PATH_INFO: `/v3/domains` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:47.988422 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35d3924-692d-436f-98af-4bf1364eabd8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87956) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:35:47.988724 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35d3924-692d-436f-98af-4bf1364eabd8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:35:47.990111 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35d3924-692d-436f-98af-4bf1364eabd8 None admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:35:48.002867 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 191/385] 10.222.0.42 () {56 vars in 1109 bytes} [Sun Oct 30 00:35:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:35:48.004035 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd07617-ecd4-43b5-b220-fc1f099fd759 None None] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:48.004317 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd07617-ecd4-43b5-b220-fc1f099fd759 None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:48.004595 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd07617-ecd4-43b5-b220-fc1f099fd759 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:48.022672 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.auth.core [None req-ddd07617-ecd4-43b5-b220-fc1f099fd759 None None] MFA Rules not processed for user `eb55b6cbca4945abb21b0e49eb745e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=87956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:35:48.023904 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-ddd07617-ecd4-43b5-b220-fc1f099fd759 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:35:48.047663 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cab03e0-bdac-43c8-ac00-b19709342051 None admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:35:48.065040 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=100 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:35:48.082705 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc79524e-d344-4161-9a0c-728e48e3882a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:35:48.083386 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc79524e-d344-4161-9a0c-728e48e3882a None admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:48.083660 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc79524e-d344-4161-9a0c-728e48e3882a None admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:48.083925 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc79524e-d344-4161-9a0c-728e48e3882a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:48.084364 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=100 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:35:48.093672 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 192/386] 10.222.0.42 () {58 vars in 1024 bytes} [Sun Oct 30 00:35:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 30 00:35:48.094494 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd07617-ecd4-43b5-b220-fc1f099fd759 None None] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:35:48.095322 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc79524e-d344-4161-9a0c-728e48e3882a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:35:48.096898 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc79524e-d344-4161-9a0c-728e48e3882a None admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:35:48.111599 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application [None req-bc79524e-d344-4161-9a0c-728e48e3882a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 30 00:35:48.111599 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:35:48.111599 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:35:48.111599 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:35:48.111599 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:35:48.111599 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:35:48.111599 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:35:48.111599 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:35:48.111599 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:35:48.111599 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:35:48.111599 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:35:48.111599 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:35:48.111599 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 30 00:35:48.111599 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 30 00:35:48.111599 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 30 00:35:48.111599 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 30 00:35:48.112519 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:35:48.112519 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:35:48.112519 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:35:48.112519 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:35:48.112519 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:35:48.112519 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:35:48.112519 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:35:48.112519 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application with Lock( Oct 30 00:35:48.112519 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:35:48.112519 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:35:48.112519 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:35:48.112519 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:35:48.112519 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:35:48.112519 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:35:48.112519 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:35:48.112519 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:35:48.112519 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 30 00:35:48.116152 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 30 00:35:48.116152 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 30 00:35:48.116152 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application Oct 30 00:35:48.116152 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 195/387] 10.222.0.42 () {56 vars in 1108 bytes} [Sun Oct 30 00:35:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:35:48.116152 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc79524e-d344-4161-9a0c-728e48e3882a None admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:35:48.201219 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd07617-ecd4-43b5-b220-fc1f099fd759 None None] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:35:48.219286 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc79524e-d344-4161-9a0c-728e48e3882a None admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:35:48.237278 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182b5530-6586-4c07-828d-39d5a8019dd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:35:48.237847 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182b5530-6586-4c07-828d-39d5a8019dd0 None admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:48.238124 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182b5530-6586-4c07-828d-39d5a8019dd0 None admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:48.238392 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182b5530-6586-4c07-828d-39d5a8019dd0 None admin] PATH_INFO: `/v3/roles` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:48.239056 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182b5530-6586-4c07-828d-39d5a8019dd0 None admin] RBAC: Adding query filter params (name=service) {{(pid=87956) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:35:48.239382 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182b5530-6586-4c07-828d-39d5a8019dd0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:35:48.240815 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182b5530-6586-4c07-828d-39d5a8019dd0 None admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:35:48.248992 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 193/388] 10.222.0.42 () {56 vars in 1103 bytes} [Sun Oct 30 00:35:48 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:35:48.249851 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182b5530-6586-4c07-828d-39d5a8019dd0 None admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:35:48.259768 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e07fa3-ab9a-4664-9574-f15fd501c225 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:35:48.260746 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e07fa3-ab9a-4664-9574-f15fd501c225 None admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:48.261022 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e07fa3-ab9a-4664-9574-f15fd501c225 None admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:48.261296 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e07fa3-ab9a-4664-9574-f15fd501c225 None admin] PATH_INFO: `/v3/users/glance` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:48.269547 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e07fa3-ab9a-4664-9574-f15fd501c225 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:35:48.270987 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e07fa3-ab9a-4664-9574-f15fd501c225 None admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:35:48.283124 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application [None req-13e07fa3-ab9a-4664-9574-f15fd501c225 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Oct 30 00:35:48.283124 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:35:48.283124 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:35:48.283124 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:35:48.283124 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:35:48.283124 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:35:48.283124 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:35:48.283124 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:35:48.283124 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:35:48.283124 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:35:48.283124 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:35:48.283124 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:35:48.283124 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 30 00:35:48.283124 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 30 00:35:48.283124 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 30 00:35:48.283124 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 30 00:35:48.284198 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:35:48.284198 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:35:48.284198 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 30 00:35:48.284198 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 30 00:35:48.284198 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 30 00:35:48.284198 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 30 00:35:48.284198 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:35:48.284198 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:35:48.284198 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:35:48.284198 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:35:48.284198 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:35:48.284198 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application with Lock( Oct 30 00:35:48.284198 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:35:48.284198 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:35:48.284198 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:35:48.284198 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:35:48.284198 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:35:48.284198 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:35:48.285117 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:35:48.285117 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:35:48.285117 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 30 00:35:48.285117 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 30 00:35:48.285117 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 30 00:35:48.285117 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 30 00:35:48.285117 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 30 00:35:48.285117 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 30 00:35:48.285117 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Oct 30 00:35:48.285117 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application Oct 30 00:35:48.285117 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 196/389] 10.222.0.42 () {56 vars in 1099 bytes} [Sun Oct 30 00:35:48 2022] GET /identity/v3/users/glance => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:35:48.285117 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e07fa3-ab9a-4664-9574-f15fd501c225 None admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:35:48.315065 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=100 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:35:48.322186 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=100 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:35:48.372223 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182b5530-6586-4c07-828d-39d5a8019dd0 None admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:35:48.384754 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e07fa3-ab9a-4664-9574-f15fd501c225 None admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:35:48.405185 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681d48ea-3a76-4ff2-a247-c0687af059a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:35:48.405810 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681d48ea-3a76-4ff2-a247-c0687af059a9 None admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:48.406081 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681d48ea-3a76-4ff2-a247-c0687af059a9 None admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:48.406350 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681d48ea-3a76-4ff2-a247-c0687af059a9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:48.412752 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681d48ea-3a76-4ff2-a247-c0687af059a9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:35:48.414176 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681d48ea-3a76-4ff2-a247-c0687af059a9 None admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:35:48.416262 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c059b7da-b349-4223-838c-7252c29a417e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:35:48.416915 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c059b7da-b349-4223-838c-7252c29a417e None admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:48.417189 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c059b7da-b349-4223-838c-7252c29a417e None admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:48.417491 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c059b7da-b349-4223-838c-7252c29a417e None admin] PATH_INFO: `/v3/domains` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:48.418185 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c059b7da-b349-4223-838c-7252c29a417e None admin] RBAC: Adding query filter params (name=Default) {{(pid=87955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:35:48.418481 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c059b7da-b349-4223-838c-7252c29a417e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:35:48.419879 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c059b7da-b349-4223-838c-7252c29a417e None admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:35:48.426001 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application [None req-681d48ea-3a76-4ff2-a247-c0687af059a9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 30 00:35:48.426001 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:35:48.426001 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:35:48.426001 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:35:48.426001 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:35:48.426001 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:35:48.426001 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:35:48.426001 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:35:48.426001 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:35:48.426001 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:35:48.426001 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:35:48.426001 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:35:48.426001 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 30 00:35:48.426001 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 30 00:35:48.426001 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 30 00:35:48.426978 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 30 00:35:48.426978 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:35:48.426978 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:35:48.426978 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:35:48.426978 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:35:48.426978 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:35:48.426978 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:35:48.426978 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:35:48.426978 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application with Lock( Oct 30 00:35:48.426978 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:35:48.426978 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:35:48.426978 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:35:48.426978 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:35:48.426978 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:35:48.426978 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:35:48.426978 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:35:48.426978 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:35:48.428706 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 30 00:35:48.428706 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 30 00:35:48.428706 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 30 00:35:48.428706 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 30 00:35:48.428706 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 30 00:35:48.428706 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 30 00:35:48.428706 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 30 00:35:48.428706 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application Oct 30 00:35:48.428706 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 194/390] 10.222.0.42 () {56 vars in 1111 bytes} [Sun Oct 30 00:35:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:35:48.428706 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681d48ea-3a76-4ff2-a247-c0687af059a9 None admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:35:48.434080 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 197/391] 10.222.0.42 () {56 vars in 1109 bytes} [Sun Oct 30 00:35:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:35:48.434882 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c059b7da-b349-4223-838c-7252c29a417e None admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:35:48.521246 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=100 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:35:48.524310 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681d48ea-3a76-4ff2-a247-c0687af059a9 None admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:35:48.530618 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c059b7da-b349-4223-838c-7252c29a417e None admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:35:48.541238 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=100 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:35:48.559447 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bcb3b8-a858-4324-91a1-4874a4a691ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:35:48.560278 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bcb3b8-a858-4324-91a1-4874a4a691ae None admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:48.560603 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bcb3b8-a858-4324-91a1-4874a4a691ae None admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:48.560878 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bcb3b8-a858-4324-91a1-4874a4a691ae None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:48.564029 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56431e52-38bc-4edc-9879-97487bbc33f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:35:48.564634 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56431e52-38bc-4edc-9879-97487bbc33f9 None admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:48.564907 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56431e52-38bc-4edc-9879-97487bbc33f9 None admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:48.565176 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56431e52-38bc-4edc-9879-97487bbc33f9 None admin] PATH_INFO: `/v3/users` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:48.565921 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56431e52-38bc-4edc-9879-97487bbc33f9 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=87955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:35:48.566220 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56431e52-38bc-4edc-9879-97487bbc33f9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:35:48.567674 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56431e52-38bc-4edc-9879-97487bbc33f9 None admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:35:48.571164 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9bcb3b8-a858-4324-91a1-4874a4a691ae None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:35:48.572629 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9bcb3b8-a858-4324-91a1-4874a4a691ae None admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:35:48.584369 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 198/392] 10.222.0.42 () {56 vars in 1137 bytes} [Sun Oct 30 00:35:48 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:35:48.585159 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56431e52-38bc-4edc-9879-97487bbc33f9 None admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:35:48.586781 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application [None req-f9bcb3b8-a858-4324-91a1-4874a4a691ae None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 30 00:35:48.586781 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:35:48.586781 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:35:48.586781 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:35:48.586781 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:35:48.586781 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:35:48.586781 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:35:48.586781 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:35:48.586781 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:35:48.586781 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:35:48.586781 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:35:48.586781 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:35:48.586781 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 30 00:35:48.586781 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 30 00:35:48.586781 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 30 00:35:48.586781 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 30 00:35:48.587802 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:35:48.587802 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:35:48.587802 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:35:48.587802 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:35:48.587802 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:35:48.587802 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:35:48.587802 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:35:48.587802 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application with Lock( Oct 30 00:35:48.587802 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:35:48.587802 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:35:48.587802 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:35:48.587802 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:35:48.587802 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:35:48.587802 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:35:48.587802 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:35:48.587802 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:35:48.587802 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 30 00:35:48.589394 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 30 00:35:48.589394 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 30 00:35:48.589394 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application Oct 30 00:35:48.589394 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 195/393] 10.222.0.42 () {56 vars in 1108 bytes} [Sun Oct 30 00:35:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:35:48.589394 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bcb3b8-a858-4324-91a1-4874a4a691ae None admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:35:48.681258 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56431e52-38bc-4edc-9879-97487bbc33f9 None admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:35:48.686688 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bcb3b8-a858-4324-91a1-4874a4a691ae None admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:35:48.713561 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e718caff-c641-4dc9-b602-3f19d08a46b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:35:48.714176 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e718caff-c641-4dc9-b602-3f19d08a46b1 None admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:48.714451 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e718caff-c641-4dc9-b602-3f19d08a46b1 None admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:48.714713 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e718caff-c641-4dc9-b602-3f19d08a46b1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:48.718670 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db1a97a-4722-4a87-ad88-71d2e6db1bd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:35:48.719295 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db1a97a-4722-4a87-ad88-71d2e6db1bd7 None admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:48.719574 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db1a97a-4722-4a87-ad88-71d2e6db1bd7 None admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:48.719839 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db1a97a-4722-4a87-ad88-71d2e6db1bd7 None admin] PATH_INFO: `/v3/projects` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:48.720522 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db1a97a-4722-4a87-ad88-71d2e6db1bd7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87956) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:35:48.720822 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db1a97a-4722-4a87-ad88-71d2e6db1bd7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:35:48.722251 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db1a97a-4722-4a87-ad88-71d2e6db1bd7 None admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:35:48.724313 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e718caff-c641-4dc9-b602-3f19d08a46b1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:35:48.725714 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e718caff-c641-4dc9-b602-3f19d08a46b1 None admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:35:48.733974 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=100 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:35:48.739827 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 196/394] 10.222.0.42 () {56 vars in 1148 bytes} [Sun Oct 30 00:35:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:35:48.740822 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application [None req-e718caff-c641-4dc9-b602-3f19d08a46b1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 30 00:35:48.740822 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:35:48.740822 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:35:48.740822 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:35:48.740822 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:35:48.740822 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:35:48.740822 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:35:48.740822 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:35:48.740822 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:35:48.740822 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:35:48.740822 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:35:48.740822 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:35:48.740822 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 30 00:35:48.740822 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 30 00:35:48.740822 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 30 00:35:48.740822 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 30 00:35:48.741872 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:35:48.741872 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:35:48.741872 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:35:48.741872 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:35:48.741872 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:35:48.741872 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:35:48.741872 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:35:48.741872 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application with Lock( Oct 30 00:35:48.741872 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:35:48.741872 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:35:48.741872 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:35:48.741872 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:35:48.741872 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:35:48.741872 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:35:48.741872 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:35:48.741872 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:35:48.741872 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 30 00:35:48.742889 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 30 00:35:48.742889 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 30 00:35:48.742889 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application Oct 30 00:35:48.743096 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db1a97a-4722-4a87-ad88-71d2e6db1bd7 None admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:35:48.744937 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 199/395] 10.222.0.42 () {56 vars in 1108 bytes} [Sun Oct 30 00:35:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:35:48.745676 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e718caff-c641-4dc9-b602-3f19d08a46b1 None admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:35:48.772151 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=100 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:35:48.842429 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db1a97a-4722-4a87-ad88-71d2e6db1bd7 None admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:35:48.845247 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e718caff-c641-4dc9-b602-3f19d08a46b1 None admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:35:48.876259 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac07eb7-c61d-4853-b69a-80ea1537426f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:35:48.876885 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac07eb7-c61d-4853-b69a-80ea1537426f None admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:48.877160 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac07eb7-c61d-4853-b69a-80ea1537426f None admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:48.877423 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac07eb7-c61d-4853-b69a-80ea1537426f None admin] PATH_INFO: `/v3/users/cinder` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:48.878988 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c6685d-2bc5-4049-83a3-77af55a7e024 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:35:48.879643 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c6685d-2bc5-4049-83a3-77af55a7e024 None admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:48.879909 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c6685d-2bc5-4049-83a3-77af55a7e024 None admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:48.880168 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c6685d-2bc5-4049-83a3-77af55a7e024 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:48.884447 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac07eb7-c61d-4853-b69a-80ea1537426f None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:35:48.885893 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac07eb7-c61d-4853-b69a-80ea1537426f None admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:35:48.890465 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c6685d-2bc5-4049-83a3-77af55a7e024 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:35:48.891914 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c6685d-2bc5-4049-83a3-77af55a7e024 None admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:35:48.898735 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application [None req-eac07eb7-c61d-4853-b69a-80ea1537426f None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Oct 30 00:35:48.898735 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:35:48.898735 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:35:48.898735 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:35:48.898735 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:35:48.898735 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:35:48.898735 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:35:48.898735 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:35:48.898735 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:35:48.898735 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:35:48.898735 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:35:48.898735 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:35:48.898735 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 30 00:35:48.898735 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 30 00:35:48.898735 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 30 00:35:48.898735 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 30 00:35:48.899712 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:35:48.899712 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:35:48.899712 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 30 00:35:48.899712 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 30 00:35:48.899712 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 30 00:35:48.899712 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 30 00:35:48.899712 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:35:48.899712 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:35:48.899712 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:35:48.899712 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:35:48.899712 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:35:48.899712 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application with Lock( Oct 30 00:35:48.899712 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:35:48.899712 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:35:48.899712 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:35:48.899712 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:35:48.899712 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:35:48.899712 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:35:48.900756 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:35:48.900756 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:35:48.900756 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 30 00:35:48.900756 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 30 00:35:48.900756 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 30 00:35:48.900756 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 30 00:35:48.900756 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 30 00:35:48.900756 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 30 00:35:48.900756 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Oct 30 00:35:48.900756 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application Oct 30 00:35:48.900756 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 197/396] 10.222.0.42 () {56 vars in 1099 bytes} [Sun Oct 30 00:35:48 2022] GET /identity/v3/users/cinder => generated 84 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:35:48.901349 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac07eb7-c61d-4853-b69a-80ea1537426f None admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:35:48.910480 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application [None req-e6c6685d-2bc5-4049-83a3-77af55a7e024 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 30 00:35:48.910480 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:35:48.910480 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:35:48.910480 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:35:48.910480 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:35:48.910480 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:35:48.910480 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:35:48.910480 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:35:48.910480 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:35:48.910480 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:35:48.910480 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:35:48.910480 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:35:48.910480 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 30 00:35:48.910480 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 30 00:35:48.910480 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 30 00:35:48.910480 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 30 00:35:48.911559 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:35:48.911559 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:35:48.911559 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:35:48.911559 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:35:48.911559 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:35:48.911559 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:35:48.911559 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:35:48.911559 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application with Lock( Oct 30 00:35:48.911559 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:35:48.911559 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:35:48.911559 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:35:48.911559 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:35:48.911559 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:35:48.911559 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:35:48.911559 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:35:48.911559 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:35:48.911559 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 30 00:35:48.917105 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 30 00:35:48.917105 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 30 00:35:48.917105 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application Oct 30 00:35:48.917105 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 200/397] 10.222.0.42 () {56 vars in 1108 bytes} [Sun Oct 30 00:35:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:35:48.917105 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c6685d-2bc5-4049-83a3-77af55a7e024 None admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:35:48.965520 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=100 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:35:48.995792 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=100 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:35:49.008721 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac07eb7-c61d-4853-b69a-80ea1537426f None admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:35:49.013049 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c6685d-2bc5-4049-83a3-77af55a7e024 None admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:35:49.041334 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d073026b-170c-45e1-9f0d-29e06acef710 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:35:49.041979 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d073026b-170c-45e1-9f0d-29e06acef710 None admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:49.042254 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d073026b-170c-45e1-9f0d-29e06acef710 None admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:49.042522 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d073026b-170c-45e1-9f0d-29e06acef710 None admin] PATH_INFO: `/v3/domains` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:49.043166 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d073026b-170c-45e1-9f0d-29e06acef710 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87956) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:35:49.043497 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d073026b-170c-45e1-9f0d-29e06acef710 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:35:49.044278 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcaef5ac-d359-478c-8c59-703ac8c27ef4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:35:49.044904 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d073026b-170c-45e1-9f0d-29e06acef710 None admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:35:49.045000 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcaef5ac-d359-478c-8c59-703ac8c27ef4 None admin] REQUEST_METHOD: `PUT` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:49.045189 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcaef5ac-d359-478c-8c59-703ac8c27ef4 None admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:49.045456 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcaef5ac-d359-478c-8c59-703ac8c27ef4 None admin] PATH_INFO: `/v3/projects/17d2387fdf794d4eaef07bbcd7b39f2a/users/fde877b6ddc74f4a87baf21471eb31d2/roles/904973500441476eadb9406925a575df` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:49.060884 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 198/398] 10.222.0.42 () {56 vars in 1109 bytes} [Sun Oct 30 00:35:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:35:49.060884 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d073026b-170c-45e1-9f0d-29e06acef710 None admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:35:49.064085 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcaef5ac-d359-478c-8c59-703ac8c27ef4 None admin] RBAC: Authorizing `identity:create_grant(project_id=17d2387fdf794d4eaef07bbcd7b39f2a, user_id=fde877b6ddc74f4a87baf21471eb31d2, role_id=904973500441476eadb9406925a575df)` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:35:49.065541 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcaef5ac-d359-478c-8c59-703ac8c27ef4 None admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:35:49.080218 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 201/399] 10.222.0.42 () {58 vars in 1439 bytes} [Sun Oct 30 00:35:48 2022] PUT /identity/v3/projects/17d2387fdf794d4eaef07bbcd7b39f2a/users/fde877b6ddc74f4a87baf21471eb31d2/roles/904973500441476eadb9406925a575df => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 00:35:49.081026 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcaef5ac-d359-478c-8c59-703ac8c27ef4 None admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:35:49.175340 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d073026b-170c-45e1-9f0d-29e06acef710 None admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:35:49.207719 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcaef5ac-d359-478c-8c59-703ac8c27ef4 None admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:35:49.210671 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:35:49.211508 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d324177-6c78-441b-8487-804959d00550 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:35:49.212130 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d324177-6c78-441b-8487-804959d00550 None admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:49.212407 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d324177-6c78-441b-8487-804959d00550 None admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:49.212676 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d324177-6c78-441b-8487-804959d00550 None admin] PATH_INFO: `/v3/domains` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:49.213339 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d324177-6c78-441b-8487-804959d00550 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87956) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:35:49.213665 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d324177-6c78-441b-8487-804959d00550 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:35:49.215384 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d324177-6c78-441b-8487-804959d00550 None admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:35:49.229385 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 199/400] 10.222.0.42 () {56 vars in 1109 bytes} [Sun Oct 30 00:35:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:35:49.230253 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d324177-6c78-441b-8487-804959d00550 None admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:35:49.243507 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=100 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:35:49.260890 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c472ade7-3f30-4a82-8795-b6b76b305346 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:35:49.261508 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c472ade7-3f30-4a82-8795-b6b76b305346 None admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:49.261781 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c472ade7-3f30-4a82-8795-b6b76b305346 None admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:49.262118 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c472ade7-3f30-4a82-8795-b6b76b305346 None admin] PATH_INFO: `/v3/users` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:49.262777 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c472ade7-3f30-4a82-8795-b6b76b305346 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=87955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:35:49.263074 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c472ade7-3f30-4a82-8795-b6b76b305346 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:35:49.265019 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c472ade7-3f30-4a82-8795-b6b76b305346 None admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:35:49.290550 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 202/401] 10.222.0.42 () {56 vars in 1137 bytes} [Sun Oct 30 00:35:49 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:35:49.291749 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c472ade7-3f30-4a82-8795-b6b76b305346 None admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:35:49.343631 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d324177-6c78-441b-8487-804959d00550 None admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:35:49.376469 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a60fe9-466e-4f01-be6a-384216d76816 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:35:49.377070 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a60fe9-466e-4f01-be6a-384216d76816 None admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:49.377341 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a60fe9-466e-4f01-be6a-384216d76816 None admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:49.377610 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a60fe9-466e-4f01-be6a-384216d76816 None admin] PATH_INFO: `/v3/domains` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:49.378241 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a60fe9-466e-4f01-be6a-384216d76816 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87956) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:35:49.378537 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a60fe9-466e-4f01-be6a-384216d76816 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:35:49.379932 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a60fe9-466e-4f01-be6a-384216d76816 None admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:35:49.396928 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 200/402] 10.222.0.42 () {56 vars in 1109 bytes} [Sun Oct 30 00:35:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:35:49.396928 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a60fe9-466e-4f01-be6a-384216d76816 None admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:35:49.401828 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c472ade7-3f30-4a82-8795-b6b76b305346 None admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:35:49.440066 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdb32c5-776d-40f2-90b9-c7ba48f5ffd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:35:49.440709 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdb32c5-776d-40f2-90b9-c7ba48f5ffd1 None admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:49.440937 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdb32c5-776d-40f2-90b9-c7ba48f5ffd1 None admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:49.441215 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdb32c5-776d-40f2-90b9-c7ba48f5ffd1 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:49.448910 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cdb32c5-776d-40f2-90b9-c7ba48f5ffd1 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:35:49.450315 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cdb32c5-776d-40f2-90b9-c7ba48f5ffd1 None admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:35:49.461290 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=100 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:35:49.462673 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application [None req-5cdb32c5-776d-40f2-90b9-c7ba48f5ffd1 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Oct 30 00:35:49.462673 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:35:49.462673 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:35:49.462673 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:35:49.462673 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:35:49.462673 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:35:49.462673 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:35:49.462673 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:35:49.462673 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:35:49.462673 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:35:49.462673 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:35:49.462673 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:35:49.462673 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 30 00:35:49.462673 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 30 00:35:49.462673 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 30 00:35:49.462673 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 30 00:35:49.464131 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:35:49.464131 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:35:49.464131 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 30 00:35:49.464131 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 30 00:35:49.464131 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 30 00:35:49.464131 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 30 00:35:49.464131 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:35:49.464131 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:35:49.464131 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:35:49.464131 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:35:49.464131 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:35:49.464131 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application with Lock( Oct 30 00:35:49.464131 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:35:49.464131 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:35:49.464131 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:35:49.464131 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:35:49.464131 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:35:49.464131 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:35:49.466145 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:35:49.466145 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:35:49.466145 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 30 00:35:49.466145 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 30 00:35:49.466145 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 30 00:35:49.466145 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 30 00:35:49.466145 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 30 00:35:49.466145 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 30 00:35:49.466145 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Oct 30 00:35:49.466145 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application Oct 30 00:35:49.466145 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 203/403] 10.222.0.42 () {56 vars in 1102 bytes} [Sun Oct 30 00:35:49 2022] GET /identity/v3/users/neutron => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:35:49.466145 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdb32c5-776d-40f2-90b9-c7ba48f5ffd1 None admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:35:49.489561 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=100 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:35:49.508815 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a60fe9-466e-4f01-be6a-384216d76816 None admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:35:49.542188 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01f6525-63ee-4d01-9672-6cc3bfa3ffb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:35:49.542874 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01f6525-63ee-4d01-9672-6cc3bfa3ffb8 None admin] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:49.543258 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01f6525-63ee-4d01-9672-6cc3bfa3ffb8 None admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:49.543611 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01f6525-63ee-4d01-9672-6cc3bfa3ffb8 None admin] PATH_INFO: `/v3/users` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:49.544346 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01f6525-63ee-4d01-9672-6cc3bfa3ffb8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:35:49.545850 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01f6525-63ee-4d01-9672-6cc3bfa3ffb8 None admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:35:49.567771 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 201/404] 10.222.0.42 () {60 vars in 1132 bytes} [Sun Oct 30 00:35:49 2022] POST /identity/v3/users => generated 247 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 00:35:49.568710 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01f6525-63ee-4d01-9672-6cc3bfa3ffb8 None admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:35:49.577643 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdb32c5-776d-40f2-90b9-c7ba48f5ffd1 None admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:35:49.621928 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b46e31-c6b8-47f7-a390-d54b826d9b89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:35:49.622753 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b46e31-c6b8-47f7-a390-d54b826d9b89 None admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:49.623157 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b46e31-c6b8-47f7-a390-d54b826d9b89 None admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:49.623549 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b46e31-c6b8-47f7-a390-d54b826d9b89 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:49.635405 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b46e31-c6b8-47f7-a390-d54b826d9b89 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:35:49.637078 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b46e31-c6b8-47f7-a390-d54b826d9b89 None admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:35:49.653228 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application [None req-33b46e31-c6b8-47f7-a390-d54b826d9b89 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 30 00:35:49.653228 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:35:49.653228 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:35:49.653228 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:35:49.653228 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:35:49.653228 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:35:49.653228 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:35:49.653228 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:35:49.653228 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:35:49.653228 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:35:49.653228 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:35:49.653228 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:35:49.653228 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 30 00:35:49.653228 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 30 00:35:49.653228 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 30 00:35:49.653228 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 30 00:35:49.654434 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:35:49.654434 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:35:49.654434 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:35:49.654434 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:35:49.654434 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:35:49.654434 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:35:49.654434 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:35:49.654434 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application with Lock( Oct 30 00:35:49.654434 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:35:49.654434 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:35:49.654434 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:35:49.654434 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:35:49.654434 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:35:49.654434 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:35:49.654434 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:35:49.654434 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:35:49.654434 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 30 00:35:49.655607 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 30 00:35:49.655607 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 30 00:35:49.655607 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application Oct 30 00:35:49.656758 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 204/405] 10.222.0.42 () {56 vars in 1108 bytes} [Sun Oct 30 00:35:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:35:49.657739 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b46e31-c6b8-47f7-a390-d54b826d9b89 None admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:35:49.720105 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01f6525-63ee-4d01-9672-6cc3bfa3ffb8 None admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:35:49.745332 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=100 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:35:49.748899 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:35:49.762585 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb0ada0-9022-42b9-9954-1785a9a2e4c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:35:49.763436 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb0ada0-9022-42b9-9954-1785a9a2e4c2 None admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:49.763801 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb0ada0-9022-42b9-9954-1785a9a2e4c2 None admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:49.764163 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb0ada0-9022-42b9-9954-1785a9a2e4c2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:49.773103 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb0ada0-9022-42b9-9954-1785a9a2e4c2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:35:49.774668 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb0ada0-9022-42b9-9954-1785a9a2e4c2 None admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:35:49.788783 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b46e31-c6b8-47f7-a390-d54b826d9b89 None admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:35:49.789759 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application [None req-cbb0ada0-9022-42b9-9954-1785a9a2e4c2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 30 00:35:49.789759 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:35:49.789759 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:35:49.789759 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:35:49.789759 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:35:49.789759 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:35:49.789759 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:35:49.789759 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:35:49.789759 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:35:49.789759 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:35:49.789759 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:35:49.789759 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:35:49.789759 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 30 00:35:49.789759 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 30 00:35:49.789759 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 30 00:35:49.790678 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 30 00:35:49.790678 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:35:49.790678 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:35:49.790678 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:35:49.790678 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:35:49.790678 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:35:49.790678 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:35:49.790678 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:35:49.790678 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application with Lock( Oct 30 00:35:49.790678 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:35:49.790678 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:35:49.790678 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:35:49.790678 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:35:49.790678 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:35:49.790678 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:35:49.790678 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:35:49.790678 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:35:49.791624 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 30 00:35:49.791624 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 30 00:35:49.791624 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 30 00:35:49.791624 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 30 00:35:49.791624 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 30 00:35:49.791624 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 30 00:35:49.791624 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 30 00:35:49.791624 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application Oct 30 00:35:49.792022 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 202/406] 10.222.0.42 () {56 vars in 1111 bytes} [Sun Oct 30 00:35:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:35:49.797216 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb0ada0-9022-42b9-9954-1785a9a2e4c2 None admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:35:49.830531 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6debdb6-06dd-4c88-a1f2-ed50aaab5120 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:35:49.831144 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6debdb6-06dd-4c88-a1f2-ed50aaab5120 None admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:49.831445 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6debdb6-06dd-4c88-a1f2-ed50aaab5120 None admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:49.831757 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6debdb6-06dd-4c88-a1f2-ed50aaab5120 None admin] PATH_INFO: `/v3/users` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:49.832599 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6debdb6-06dd-4c88-a1f2-ed50aaab5120 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=87955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:35:49.833007 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6debdb6-06dd-4c88-a1f2-ed50aaab5120 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:35:49.834437 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6debdb6-06dd-4c88-a1f2-ed50aaab5120 None admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:35:49.853240 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 205/407] 10.222.0.42 () {56 vars in 1139 bytes} [Sun Oct 30 00:35:49 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:35:49.858779 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6debdb6-06dd-4c88-a1f2-ed50aaab5120 None admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:35:49.914721 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb0ada0-9022-42b9-9954-1785a9a2e4c2 None admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:35:49.957802 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7366f7-7248-469a-adfd-2d8140a931ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:35:49.958434 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7366f7-7248-469a-adfd-2d8140a931ae None admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:49.958708 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7366f7-7248-469a-adfd-2d8140a931ae None admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:49.958976 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7366f7-7248-469a-adfd-2d8140a931ae None admin] PATH_INFO: `/v3/domains` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:49.959337 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6debdb6-06dd-4c88-a1f2-ed50aaab5120 None admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:35:49.959669 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7366f7-7248-469a-adfd-2d8140a931ae None admin] RBAC: Adding query filter params (name=Default) {{(pid=87956) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:35:49.959967 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7366f7-7248-469a-adfd-2d8140a931ae None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:35:49.961653 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7366f7-7248-469a-adfd-2d8140a931ae None admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:35:49.983323 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 203/408] 10.222.0.42 () {56 vars in 1109 bytes} [Sun Oct 30 00:35:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:35:49.984239 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7366f7-7248-469a-adfd-2d8140a931ae None admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:35:49.997060 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=100 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:35:50.000036 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ba7629-baba-4564-a93f-baf2582d38ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:35:50.000644 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ba7629-baba-4564-a93f-baf2582d38ec None admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:50.000969 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ba7629-baba-4564-a93f-baf2582d38ec None admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:50.001247 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ba7629-baba-4564-a93f-baf2582d38ec None admin] PATH_INFO: `/v3/projects` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:50.001947 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ba7629-baba-4564-a93f-baf2582d38ec None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:35:50.002250 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ba7629-baba-4564-a93f-baf2582d38ec None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:35:50.004030 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ba7629-baba-4564-a93f-baf2582d38ec None admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:35:50.022982 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 206/409] 10.222.0.42 () {56 vars in 1148 bytes} [Sun Oct 30 00:35:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:35:50.024071 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ba7629-baba-4564-a93f-baf2582d38ec None admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:35:50.041428 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=100 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:35:50.100940 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7366f7-7248-469a-adfd-2d8140a931ae None admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:35:50.136090 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ba7629-baba-4564-a93f-baf2582d38ec None admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:35:50.137553 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021957b7-01f6-4bcc-9158-6c7f16bca6b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:35:50.138503 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021957b7-01f6-4bcc-9158-6c7f16bca6b2 None admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:50.138984 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021957b7-01f6-4bcc-9158-6c7f16bca6b2 None admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:50.139483 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021957b7-01f6-4bcc-9158-6c7f16bca6b2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:50.150664 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021957b7-01f6-4bcc-9158-6c7f16bca6b2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:35:50.152531 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021957b7-01f6-4bcc-9158-6c7f16bca6b2 None admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:35:50.169596 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application [None req-021957b7-01f6-4bcc-9158-6c7f16bca6b2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 30 00:35:50.169596 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:35:50.169596 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:35:50.169596 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:35:50.169596 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:35:50.169596 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:35:50.169596 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:35:50.169596 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:35:50.169596 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:35:50.169596 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:35:50.169596 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:35:50.169596 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:35:50.169596 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 30 00:35:50.169596 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 30 00:35:50.169596 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 30 00:35:50.169596 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 30 00:35:50.170551 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:35:50.170551 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:35:50.170551 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:35:50.170551 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:35:50.170551 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:35:50.170551 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:35:50.170551 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:35:50.170551 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application with Lock( Oct 30 00:35:50.170551 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:35:50.170551 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:35:50.170551 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:35:50.170551 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:35:50.170551 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:35:50.170551 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:35:50.170551 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:35:50.170551 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:35:50.170551 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 30 00:35:50.171399 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 30 00:35:50.171399 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 30 00:35:50.171399 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application Oct 30 00:35:50.171568 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f735511e-e888-4eda-8166-69b8b3c636ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:35:50.171568 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f735511e-e888-4eda-8166-69b8b3c636ae None admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:50.171732 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f735511e-e888-4eda-8166-69b8b3c636ae None admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:50.171970 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f735511e-e888-4eda-8166-69b8b3c636ae None admin] PATH_INFO: `/v3/projects/service` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:50.173430 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 204/410] 10.222.0.42 () {56 vars in 1108 bytes} [Sun Oct 30 00:35:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:35:50.174329 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021957b7-01f6-4bcc-9158-6c7f16bca6b2 None admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:35:50.183585 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f735511e-e888-4eda-8166-69b8b3c636ae None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:35:50.185178 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f735511e-e888-4eda-8166-69b8b3c636ae None admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:35:50.198126 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application [None req-f735511e-e888-4eda-8166-69b8b3c636ae None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 30 00:35:50.198126 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:35:50.198126 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:35:50.198126 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:35:50.198126 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:35:50.198126 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:35:50.198126 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:35:50.198126 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:35:50.198126 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:35:50.198126 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:35:50.198126 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:35:50.198126 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:35:50.198126 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 30 00:35:50.198126 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 30 00:35:50.198126 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 30 00:35:50.199160 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 30 00:35:50.199160 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:35:50.199160 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:35:50.199160 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:35:50.199160 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:35:50.199160 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:35:50.199160 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:35:50.199160 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:35:50.199160 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application with Lock( Oct 30 00:35:50.199160 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:35:50.199160 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:35:50.199160 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:35:50.199160 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:35:50.199160 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:35:50.199160 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:35:50.199160 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:35:50.199160 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:35:50.200220 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 30 00:35:50.200220 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 30 00:35:50.200220 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 30 00:35:50.200220 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 30 00:35:50.200220 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 30 00:35:50.200220 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 30 00:35:50.200220 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 30 00:35:50.200220 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application Oct 30 00:35:50.200220 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 207/411] 10.222.0.42 () {56 vars in 1111 bytes} [Sun Oct 30 00:35:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:35:50.200707 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f735511e-e888-4eda-8166-69b8b3c636ae None admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:35:50.251607 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=100 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:35:50.273736 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=100 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:35:50.279126 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021957b7-01f6-4bcc-9158-6c7f16bca6b2 None admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:35:50.304504 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f735511e-e888-4eda-8166-69b8b3c636ae None admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:35:50.313823 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f647a12-7a15-44ce-b8a6-ffd2e7e3147e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:35:50.314785 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f647a12-7a15-44ce-b8a6-ffd2e7e3147e None admin] REQUEST_METHOD: `PUT` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:50.315286 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f647a12-7a15-44ce-b8a6-ffd2e7e3147e None admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:50.315789 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f647a12-7a15-44ce-b8a6-ffd2e7e3147e None admin] PATH_INFO: `/v3/projects/17d2387fdf794d4eaef07bbcd7b39f2a/users/36a86cf3eaf24b369737b65046142593/roles/904973500441476eadb9406925a575df` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:50.336671 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f647a12-7a15-44ce-b8a6-ffd2e7e3147e None admin] RBAC: Authorizing `identity:create_grant(project_id=17d2387fdf794d4eaef07bbcd7b39f2a, user_id=36a86cf3eaf24b369737b65046142593, role_id=904973500441476eadb9406925a575df)` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:35:50.339000 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f647a12-7a15-44ce-b8a6-ffd2e7e3147e None admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:35:50.342810 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08202555-6ae1-4211-bd4d-f4910c2345d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:35:50.343540 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08202555-6ae1-4211-bd4d-f4910c2345d1 None admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:50.344208 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08202555-6ae1-4211-bd4d-f4910c2345d1 None admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:50.344552 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08202555-6ae1-4211-bd4d-f4910c2345d1 None admin] PATH_INFO: `/v3/domains` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:50.345274 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08202555-6ae1-4211-bd4d-f4910c2345d1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:35:50.345795 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08202555-6ae1-4211-bd4d-f4910c2345d1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:35:50.347310 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08202555-6ae1-4211-bd4d-f4910c2345d1 None admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:35:50.354754 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 205/412] 10.222.0.42 () {58 vars in 1439 bytes} [Sun Oct 30 00:35:50 2022] PUT /identity/v3/projects/17d2387fdf794d4eaef07bbcd7b39f2a/users/36a86cf3eaf24b369737b65046142593/roles/904973500441476eadb9406925a575df => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 00:35:50.356518 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f647a12-7a15-44ce-b8a6-ffd2e7e3147e None admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:35:50.362042 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 208/413] 10.222.0.42 () {56 vars in 1109 bytes} [Sun Oct 30 00:35:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:35:50.367237 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08202555-6ae1-4211-bd4d-f4910c2345d1 None admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:35:50.518171 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08202555-6ae1-4211-bd4d-f4910c2345d1 None admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:35:50.532574 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=100 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:35:50.547580 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f647a12-7a15-44ce-b8a6-ffd2e7e3147e None admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:35:50.567636 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4564387-e788-42a4-92e5-e5c6889b65db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:35:50.568421 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4564387-e788-42a4-92e5-e5c6889b65db None admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:50.568770 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4564387-e788-42a4-92e5-e5c6889b65db None admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:50.569104 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4564387-e788-42a4-92e5-e5c6889b65db None admin] PATH_INFO: `/v3/projects/service` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:50.577622 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4564387-e788-42a4-92e5-e5c6889b65db None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:35:50.579163 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4564387-e788-42a4-92e5-e5c6889b65db None admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:35:50.594616 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application [None req-a4564387-e788-42a4-92e5-e5c6889b65db None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 30 00:35:50.594616 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:35:50.594616 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:35:50.594616 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:35:50.594616 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:35:50.594616 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:35:50.594616 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:35:50.594616 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:35:50.594616 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:35:50.594616 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:35:50.594616 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:35:50.594616 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:35:50.594616 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 30 00:35:50.594616 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 30 00:35:50.594616 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 30 00:35:50.595536 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 30 00:35:50.595536 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:35:50.595536 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:35:50.595536 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:35:50.595536 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:35:50.595536 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:35:50.595536 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:35:50.595536 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:35:50.595536 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application with Lock( Oct 30 00:35:50.595536 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:35:50.595536 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:35:50.595536 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:35:50.595536 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:35:50.595536 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:35:50.595536 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:35:50.595536 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:35:50.595536 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:35:50.596359 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 30 00:35:50.596359 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 30 00:35:50.596359 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 30 00:35:50.596359 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 30 00:35:50.596359 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 30 00:35:50.596359 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 30 00:35:50.596359 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 30 00:35:50.596359 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application Oct 30 00:35:50.596359 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 209/414] 10.222.0.42 () {56 vars in 1111 bytes} [Sun Oct 30 00:35:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 30 00:35:50.602781 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4564387-e788-42a4-92e5-e5c6889b65db None admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:35:50.602952 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c37f09e-56ba-4b95-b273-52a8ebbf1d25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:35:50.603532 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c37f09e-56ba-4b95-b273-52a8ebbf1d25 None admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:50.603872 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c37f09e-56ba-4b95-b273-52a8ebbf1d25 None admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:50.604148 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c37f09e-56ba-4b95-b273-52a8ebbf1d25 None admin] PATH_INFO: `/v3/projects` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:50.604855 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c37f09e-56ba-4b95-b273-52a8ebbf1d25 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87956) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:35:50.605155 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c37f09e-56ba-4b95-b273-52a8ebbf1d25 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:35:50.607549 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c37f09e-56ba-4b95-b273-52a8ebbf1d25 None admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:35:50.623687 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 206/415] 10.222.0.42 () {56 vars in 1148 bytes} [Sun Oct 30 00:35:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:35:50.629496 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c37f09e-56ba-4b95-b273-52a8ebbf1d25 None admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:35:50.639315 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:35:50.747597 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c37f09e-56ba-4b95-b273-52a8ebbf1d25 None admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:35:50.785794 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856aeb3e-9358-44db-a774-cb2cfb786f18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:35:50.786507 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856aeb3e-9358-44db-a774-cb2cfb786f18 None admin] REQUEST_METHOD: `PUT` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:50.786783 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856aeb3e-9358-44db-a774-cb2cfb786f18 None admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:50.787102 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856aeb3e-9358-44db-a774-cb2cfb786f18 None admin] PATH_INFO: `/v3/projects/17d2387fdf794d4eaef07bbcd7b39f2a/users/48d928ff7fe24348ac900f09c56acc20/roles/904973500441476eadb9406925a575df` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:50.804140 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856aeb3e-9358-44db-a774-cb2cfb786f18 None admin] RBAC: Authorizing `identity:create_grant(project_id=17d2387fdf794d4eaef07bbcd7b39f2a, user_id=48d928ff7fe24348ac900f09c56acc20, role_id=904973500441476eadb9406925a575df)` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:35:50.805585 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856aeb3e-9358-44db-a774-cb2cfb786f18 None admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:35:50.811748 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4564387-e788-42a4-92e5-e5c6889b65db None admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:35:50.823630 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 207/416] 10.222.0.42 () {58 vars in 1439 bytes} [Sun Oct 30 00:35:50 2022] PUT /identity/v3/projects/17d2387fdf794d4eaef07bbcd7b39f2a/users/48d928ff7fe24348ac900f09c56acc20/roles/904973500441476eadb9406925a575df => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 00:35:50.892911 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908a341f-8915-41b1-b4ae-62a3332f2a33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:35:50.893458 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908a341f-8915-41b1-b4ae-62a3332f2a33 None admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:50.893735 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908a341f-8915-41b1-b4ae-62a3332f2a33 None admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:50.894005 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908a341f-8915-41b1-b4ae-62a3332f2a33 None admin] PATH_INFO: `/v3/projects` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:50.894730 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908a341f-8915-41b1-b4ae-62a3332f2a33 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:35:50.895034 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908a341f-8915-41b1-b4ae-62a3332f2a33 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:35:50.896582 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908a341f-8915-41b1-b4ae-62a3332f2a33 None admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:35:50.918804 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 210/417] 10.222.0.42 () {56 vars in 1148 bytes} [Sun Oct 30 00:35:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 30 00:35:50.925076 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856aeb3e-9358-44db-a774-cb2cfb786f18 None admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:35:51.031652 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:35:51.083678 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856aeb3e-9358-44db-a774-cb2cfb786f18 None admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:35:51.123632 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b6ed1b-3dbc-4648-97cb-45f1da82737a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:35:51.124305 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b6ed1b-3dbc-4648-97cb-45f1da82737a None admin] REQUEST_METHOD: `PUT` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:51.124577 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b6ed1b-3dbc-4648-97cb-45f1da82737a None admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:51.124841 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b6ed1b-3dbc-4648-97cb-45f1da82737a None admin] PATH_INFO: `/v3/projects/17d2387fdf794d4eaef07bbcd7b39f2a/users/5693f186c6ad4d9394f02ee3477cdcd3/roles/904973500441476eadb9406925a575df` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:51.148159 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b6ed1b-3dbc-4648-97cb-45f1da82737a None admin] RBAC: Authorizing `identity:create_grant(project_id=17d2387fdf794d4eaef07bbcd7b39f2a, user_id=5693f186c6ad4d9394f02ee3477cdcd3, role_id=904973500441476eadb9406925a575df)` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:35:51.149552 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b6ed1b-3dbc-4648-97cb-45f1da82737a None admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:35:51.177641 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 208/418] 10.222.0.42 () {58 vars in 1439 bytes} [Sun Oct 30 00:35:50 2022] PUT /identity/v3/projects/17d2387fdf794d4eaef07bbcd7b39f2a/users/5693f186c6ad4d9394f02ee3477cdcd3/roles/904973500441476eadb9406925a575df => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 00:35:51.394833 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6e7bde-1200-4e4d-9240-a7ca12ac40fb None None] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:51.395112 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6e7bde-1200-4e4d-9240-a7ca12ac40fb None None] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:51.395422 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6e7bde-1200-4e4d-9240-a7ca12ac40fb None None] PATH_INFO: `/` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:51.396942 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 211/419] 10.222.0.42 () {54 vars in 927 bytes} [Sun Oct 30 00:35:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:35:51.402731 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f679d2e-a66b-4127-b7c2-9f735c4e38b8 None None] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:51.402954 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f679d2e-a66b-4127-b7c2-9f735c4e38b8 None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:51.403244 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f679d2e-a66b-4127-b7c2-9f735c4e38b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:51.428242 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.auth.core [None req-7f679d2e-a66b-4127-b7c2-9f735c4e38b8 None None] MFA Rules not processed for user `eb55b6cbca4945abb21b0e49eb745e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=87956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:35:51.429465 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-7f679d2e-a66b-4127-b7c2-9f735c4e38b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:35:51.525098 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 209/420] 10.222.0.42 () {58 vars in 1024 bytes} [Sun Oct 30 00:35:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 30 00:35:51.795740 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6e7bde-1200-4e4d-9240-a7ca12ac40fb None None] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:35:51.832042 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=100 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:35:51.927891 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6e7bde-1200-4e4d-9240-a7ca12ac40fb None None] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:35:51.973618 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb31b147-ec12-40ec-9243-7b543ec63b81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:35:51.974266 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb31b147-ec12-40ec-9243-7b543ec63b81 None admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:51.974540 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb31b147-ec12-40ec-9243-7b543ec63b81 None admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:51.974812 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb31b147-ec12-40ec-9243-7b543ec63b81 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:51.995326 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb31b147-ec12-40ec-9243-7b543ec63b81 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 30 00:35:52.000620 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application [None req-cb31b147-ec12-40ec-9243-7b543ec63b81 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 30 00:35:52.000620 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:35:52.000620 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:35:52.000620 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:35:52.000620 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:35:52.000620 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:35:52.000620 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:35:52.000620 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:35:52.000620 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:35:52.000620 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:35:52.000620 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:35:52.000620 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:35:52.000620 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 30 00:35:52.000620 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 30 00:35:52.000620 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 30 00:35:52.000620 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 30 00:35:52.001463 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 30 00:35:52.001463 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 30 00:35:52.001463 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 30 00:35:52.001463 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 30 00:35:52.001463 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:35:52.001463 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:35:52.001463 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:35:52.001463 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:35:52.001463 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:35:52.001463 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:35:52.001463 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:35:52.001463 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application with Lock( Oct 30 00:35:52.001463 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:35:52.001463 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:35:52.001463 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:35:52.001463 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:35:52.002713 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:35:52.002713 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:35:52.002713 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:35:52.002713 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:35:52.002713 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 30 00:35:52.002713 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 30 00:35:52.002713 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 30 00:35:52.002713 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 30 00:35:52.002713 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 30 00:35:52.002713 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 30 00:35:52.002713 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 30 00:35:52.002713 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application Oct 30 00:35:52.002713 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 212/421] 10.222.0.42 () {56 vars in 1102 bytes} [Sun Oct 30 00:35:51 2022] GET /identity/v3/roles/service => generated 85 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:35:52.009403 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f679d2e-a66b-4127-b7c2-9f735c4e38b8 None None] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:35:52.061733 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:35:52.149927 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f679d2e-a66b-4127-b7c2-9f735c4e38b8 None None] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:35:52.159522 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72429f4f-8a71-48c7-ad38-ba8b3e080ad3 None None] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:52.159806 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72429f4f-8a71-48c7-ad38-ba8b3e080ad3 None None] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:52.160075 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72429f4f-8a71-48c7-ad38-ba8b3e080ad3 None None] PATH_INFO: `/` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:52.161416 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 213/422] 10.222.0.42 () {54 vars in 927 bytes} [Sun Oct 30 00:35:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 30 00:35:52.176388 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecbd6ee-5fc9-41a1-abef-8fafaf46ee1e None None] REQUEST_METHOD: `POST` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:52.176667 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecbd6ee-5fc9-41a1-abef-8fafaf46ee1e None None] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:52.176941 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecbd6ee-5fc9-41a1-abef-8fafaf46ee1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:52.191940 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabb86ab-e383-4200-a110-817c31e75a2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:35:52.192568 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabb86ab-e383-4200-a110-817c31e75a2b None admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:52.192846 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabb86ab-e383-4200-a110-817c31e75a2b None admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:52.193118 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabb86ab-e383-4200-a110-817c31e75a2b None admin] PATH_INFO: `/v3/roles` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:52.194215 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabb86ab-e383-4200-a110-817c31e75a2b None admin] RBAC: Adding query filter params (name=service) {{(pid=87956) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:35:52.194530 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabb86ab-e383-4200-a110-817c31e75a2b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:35:52.195943 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabb86ab-e383-4200-a110-817c31e75a2b None admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:35:52.205499 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 210/423] 10.222.0.42 () {56 vars in 1103 bytes} [Sun Oct 30 00:35:52 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:35:52.208245 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.auth.core [None req-fecbd6ee-5fc9-41a1-abef-8fafaf46ee1e None None] MFA Rules not processed for user `eb55b6cbca4945abb21b0e49eb745e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=87955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:35:52.209430 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-fecbd6ee-5fc9-41a1-abef-8fafaf46ee1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:35:52.211515 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabb86ab-e383-4200-a110-817c31e75a2b None admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:35:52.313957 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 214/424] 10.222.0.42 () {58 vars in 1024 bytes} [Sun Oct 30 00:35:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 30 00:35:52.373634 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=100 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:35:52.378115 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabb86ab-e383-4200-a110-817c31e75a2b None admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:35:52.430600 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1800bc44-0ab7-4dd6-b35d-241320467b6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:35:52.431246 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1800bc44-0ab7-4dd6-b35d-241320467b6f None admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:52.431522 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1800bc44-0ab7-4dd6-b35d-241320467b6f None admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:52.431840 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1800bc44-0ab7-4dd6-b35d-241320467b6f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:52.442660 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1800bc44-0ab7-4dd6-b35d-241320467b6f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:35:52.444147 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1800bc44-0ab7-4dd6-b35d-241320467b6f None admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:35:52.465721 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application [None req-1800bc44-0ab7-4dd6-b35d-241320467b6f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 30 00:35:52.465721 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:35:52.465721 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:35:52.465721 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:35:52.465721 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:35:52.465721 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:35:52.465721 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:35:52.465721 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:35:52.465721 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:35:52.465721 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:35:52.465721 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:35:52.465721 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:35:52.465721 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 30 00:35:52.465721 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 30 00:35:52.465721 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 30 00:35:52.465721 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 30 00:35:52.466623 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:35:52.466623 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:35:52.466623 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:35:52.466623 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:35:52.466623 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:35:52.466623 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:35:52.466623 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:35:52.466623 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application with Lock( Oct 30 00:35:52.466623 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:35:52.466623 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:35:52.466623 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:35:52.466623 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:35:52.466623 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:35:52.466623 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:35:52.466623 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:35:52.466623 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:35:52.466623 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 30 00:35:52.468425 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 30 00:35:52.468425 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 30 00:35:52.468425 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application Oct 30 00:35:52.468425 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 211/425] 10.222.0.42 () {56 vars in 1108 bytes} [Sun Oct 30 00:35:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 30 00:35:52.474643 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecbd6ee-5fc9-41a1-abef-8fafaf46ee1e None None] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:35:52.514670 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=100 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:35:52.611119 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecbd6ee-5fc9-41a1-abef-8fafaf46ee1e None None] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:35:52.611639 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1800bc44-0ab7-4dd6-b35d-241320467b6f None admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:35:52.655349 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec7fedf-fcc3-4a57-94e9-8d673be110ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:35:52.656059 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec7fedf-fcc3-4a57-94e9-8d673be110ad None admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:52.656425 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec7fedf-fcc3-4a57-94e9-8d673be110ad None admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:52.656699 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec7fedf-fcc3-4a57-94e9-8d673be110ad None admin] PATH_INFO: `/v3/domains` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:52.657347 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec7fedf-fcc3-4a57-94e9-8d673be110ad None admin] RBAC: Adding query filter params (name=Default) {{(pid=87955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:35:52.657648 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec7fedf-fcc3-4a57-94e9-8d673be110ad None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:35:52.659105 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec7fedf-fcc3-4a57-94e9-8d673be110ad None admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:35:52.682789 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 215/426] 10.222.0.42 () {56 vars in 1109 bytes} [Sun Oct 30 00:35:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:35:52.694949 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec7fedf-fcc3-4a57-94e9-8d673be110ad None admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:35:52.748869 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1800bc44-0ab7-4dd6-b35d-241320467b6f None admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:35:52.788918 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74f47ab-93cf-4bfb-89f9-465cb6931bf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:35:52.789889 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74f47ab-93cf-4bfb-89f9-465cb6931bf8 None admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:52.790353 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74f47ab-93cf-4bfb-89f9-465cb6931bf8 None admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:52.790832 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74f47ab-93cf-4bfb-89f9-465cb6931bf8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:52.802017 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74f47ab-93cf-4bfb-89f9-465cb6931bf8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 30 00:35:52.807796 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application [None req-b74f47ab-93cf-4bfb-89f9-465cb6931bf8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 30 00:35:52.807796 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:35:52.807796 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:35:52.807796 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:35:52.807796 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:35:52.807796 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:35:52.807796 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:35:52.807796 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:35:52.807796 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:35:52.807796 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:35:52.807796 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:35:52.807796 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:35:52.807796 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 30 00:35:52.807796 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 30 00:35:52.807796 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 30 00:35:52.807796 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 30 00:35:52.808659 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 30 00:35:52.808659 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 30 00:35:52.808659 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 30 00:35:52.808659 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 30 00:35:52.808659 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:35:52.808659 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:35:52.808659 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:35:52.808659 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:35:52.808659 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:35:52.808659 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:35:52.808659 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:35:52.808659 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application with Lock( Oct 30 00:35:52.808659 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:35:52.808659 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:35:52.808659 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:35:52.808659 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:35:52.809436 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:35:52.809436 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:35:52.809436 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:35:52.809436 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:35:52.809436 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 30 00:35:52.809436 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 30 00:35:52.809436 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 30 00:35:52.809436 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 30 00:35:52.809436 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 30 00:35:52.809436 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 30 00:35:52.809436 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 30 00:35:52.809436 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application Oct 30 00:35:52.812016 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 212/427] 10.222.0.42 () {56 vars in 1102 bytes} [Sun Oct 30 00:35:52 2022] GET /identity/v3/roles/service => generated 85 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:35:52.817926 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74f47ab-93cf-4bfb-89f9-465cb6931bf8 None admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:35:52.842780 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=100 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:35:52.851828 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=100 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:35:52.883308 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec7fedf-fcc3-4a57-94e9-8d673be110ad None admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:35:52.928571 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df3c762-0d6e-4b66-970b-29c67d8083c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:35:52.929076 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df3c762-0d6e-4b66-970b-29c67d8083c2 None admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:52.929359 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df3c762-0d6e-4b66-970b-29c67d8083c2 None admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:52.929630 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df3c762-0d6e-4b66-970b-29c67d8083c2 None admin] PATH_INFO: `/v3/users/nova` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:52.938777 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df3c762-0d6e-4b66-970b-29c67d8083c2 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:35:52.944437 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df3c762-0d6e-4b66-970b-29c67d8083c2 None admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:35:52.960631 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74f47ab-93cf-4bfb-89f9-465cb6931bf8 None admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:35:52.964661 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application [None req-7df3c762-0d6e-4b66-970b-29c67d8083c2 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 30 00:35:52.964661 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:35:52.964661 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:35:52.964661 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:35:52.964661 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:35:52.964661 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:35:52.964661 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:35:52.964661 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:35:52.964661 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:35:52.964661 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:35:52.964661 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:35:52.964661 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:35:52.964661 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 30 00:35:52.964661 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 30 00:35:52.964661 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 30 00:35:52.964661 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 30 00:35:52.965608 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:35:52.965608 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:35:52.965608 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 30 00:35:52.965608 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 30 00:35:52.965608 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 30 00:35:52.965608 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 30 00:35:52.965608 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:35:52.965608 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:35:52.965608 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:35:52.965608 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:35:52.965608 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:35:52.965608 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application with Lock( Oct 30 00:35:52.965608 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:35:52.965608 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:35:52.965608 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:35:52.965608 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:35:52.965608 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:35:52.965608 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:35:52.971520 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:35:52.971520 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:35:52.971520 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 30 00:35:52.971520 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 30 00:35:52.971520 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 30 00:35:52.971520 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 30 00:35:52.971520 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 30 00:35:52.971520 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 30 00:35:52.971520 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 30 00:35:52.971520 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application Oct 30 00:35:52.971520 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 216/428] 10.222.0.42 () {56 vars in 1093 bytes} [Sun Oct 30 00:35:52 2022] GET /identity/v3/users/nova => generated 82 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:35:52.985791 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df3c762-0d6e-4b66-970b-29c67d8083c2 None admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:35:53.008218 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d700205-5ba5-4cbc-812e-c1ac447afc5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:35:53.009220 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d700205-5ba5-4cbc-812e-c1ac447afc5a None admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:53.009836 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d700205-5ba5-4cbc-812e-c1ac447afc5a None admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:53.010723 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d700205-5ba5-4cbc-812e-c1ac447afc5a None admin] PATH_INFO: `/v3/roles` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:53.012149 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d700205-5ba5-4cbc-812e-c1ac447afc5a None admin] RBAC: Adding query filter params (name=service) {{(pid=87956) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:35:53.012651 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d700205-5ba5-4cbc-812e-c1ac447afc5a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:35:53.014215 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d700205-5ba5-4cbc-812e-c1ac447afc5a None admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:35:53.024421 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 213/429] 10.222.0.42 () {56 vars in 1103 bytes} [Sun Oct 30 00:35:52 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:35:53.029355 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d700205-5ba5-4cbc-812e-c1ac447afc5a None admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:35:53.135133 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=100 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:35:53.142245 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df3c762-0d6e-4b66-970b-29c67d8083c2 None admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:35:53.170758 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d700205-5ba5-4cbc-812e-c1ac447afc5a None admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:35:53.182337 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412e5ea2-f949-448b-91f1-f340652ea520 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:35:53.183504 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412e5ea2-f949-448b-91f1-f340652ea520 None admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:53.183972 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412e5ea2-f949-448b-91f1-f340652ea520 None admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:53.184463 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412e5ea2-f949-448b-91f1-f340652ea520 None admin] PATH_INFO: `/v3/users` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:53.185391 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412e5ea2-f949-448b-91f1-f340652ea520 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=87955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:35:53.185752 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412e5ea2-f949-448b-91f1-f340652ea520 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:35:53.187268 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412e5ea2-f949-448b-91f1-f340652ea520 None admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:35:53.198132 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=100 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:35:53.207965 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 217/430] 10.222.0.42 () {56 vars in 1133 bytes} [Sun Oct 30 00:35:52 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:35:53.212429 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2a1973-3cec-4696-a604-1a737c1c209c None None] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:53.213347 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59eda3f1-83c1-467e-b15a-383350a63791 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:35:53.214195 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59eda3f1-83c1-467e-b15a-383350a63791 None admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:53.214682 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2a1973-3cec-4696-a604-1a737c1c209c None None] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:53.215230 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59eda3f1-83c1-467e-b15a-383350a63791 None admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:53.215573 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2a1973-3cec-4696-a604-1a737c1c209c None None] PATH_INFO: `/` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:53.215910 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59eda3f1-83c1-467e-b15a-383350a63791 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:53.221272 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 218/431] 10.222.0.42 () {54 vars in 927 bytes} [Sun Oct 30 00:35:53 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:35:53.221272 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2a1973-3cec-4696-a604-1a737c1c209c None None] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:35:53.232359 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59eda3f1-83c1-467e-b15a-383350a63791 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:35:53.234152 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59eda3f1-83c1-467e-b15a-383350a63791 None admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:35:53.251845 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application [None req-59eda3f1-83c1-467e-b15a-383350a63791 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 30 00:35:53.251845 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:35:53.251845 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:35:53.251845 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:35:53.251845 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:35:53.251845 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:35:53.251845 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:35:53.251845 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:35:53.251845 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:35:53.251845 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:35:53.251845 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:35:53.251845 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:35:53.251845 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 30 00:35:53.251845 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 30 00:35:53.251845 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 30 00:35:53.251845 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 30 00:35:53.252804 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:35:53.252804 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:35:53.252804 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:35:53.252804 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:35:53.252804 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:35:53.252804 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:35:53.252804 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:35:53.252804 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application with Lock( Oct 30 00:35:53.252804 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:35:53.252804 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:35:53.252804 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:35:53.252804 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:35:53.252804 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:35:53.252804 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:35:53.252804 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:35:53.252804 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:35:53.252804 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 30 00:35:53.253639 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 30 00:35:53.253639 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 30 00:35:53.253639 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application Oct 30 00:35:53.253639 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 214/432] 10.222.0.42 () {56 vars in 1108 bytes} [Sun Oct 30 00:35:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:35:53.254292 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363923b8-e78a-4cd8-ae2b-12ee4a8164d6 None None] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:53.254512 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363923b8-e78a-4cd8-ae2b-12ee4a8164d6 None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:53.254780 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363923b8-e78a-4cd8-ae2b-12ee4a8164d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:53.272987 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.auth.core [None req-363923b8-e78a-4cd8-ae2b-12ee4a8164d6 None None] MFA Rules not processed for user `eb55b6cbca4945abb21b0e49eb745e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=87956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:35:53.274171 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-363923b8-e78a-4cd8-ae2b-12ee4a8164d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:35:53.351139 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2a1973-3cec-4696-a604-1a737c1c209c None None] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:35:53.354565 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 215/433] 10.222.0.42 () {58 vars in 1024 bytes} [Sun Oct 30 00:35:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 30 00:35:53.355038 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363923b8-e78a-4cd8-ae2b-12ee4a8164d6 None None] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:35:53.394049 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecccb73-d88b-469a-824b-cbb1b2083d79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:35:53.395486 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecccb73-d88b-469a-824b-cbb1b2083d79 None admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:53.395781 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecccb73-d88b-469a-824b-cbb1b2083d79 None admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:53.396052 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecccb73-d88b-469a-824b-cbb1b2083d79 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:53.417062 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=100 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:35:53.477413 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=100 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:35:53.479934 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363923b8-e78a-4cd8-ae2b-12ee4a8164d6 None None] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:35:53.488757 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ecccb73-d88b-469a-824b-cbb1b2083d79 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:35:53.490991 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ecccb73-d88b-469a-824b-cbb1b2083d79 None admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:35:53.516692 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f94c4f7-e0f2-4c12-9575-e7d4f110b360 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:35:53.517331 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f94c4f7-e0f2-4c12-9575-e7d4f110b360 None admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:53.517615 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f94c4f7-e0f2-4c12-9575-e7d4f110b360 None admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:53.517887 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f94c4f7-e0f2-4c12-9575-e7d4f110b360 None admin] PATH_INFO: `/v3/domains` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:53.518534 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f94c4f7-e0f2-4c12-9575-e7d4f110b360 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87956) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:35:53.518836 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f94c4f7-e0f2-4c12-9575-e7d4f110b360 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:35:53.520246 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f94c4f7-e0f2-4c12-9575-e7d4f110b360 None admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:35:53.533096 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 216/434] 10.222.0.42 () {56 vars in 1109 bytes} [Sun Oct 30 00:35:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:35:53.538033 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f94c4f7-e0f2-4c12-9575-e7d4f110b360 None admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:35:53.619799 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 219/435] 10.222.0.42 () {58 vars in 1282 bytes} [Sun Oct 30 00:35:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 30 00:35:53.625260 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecccb73-d88b-469a-824b-cbb1b2083d79 None admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:35:53.755157 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f94c4f7-e0f2-4c12-9575-e7d4f110b360 None admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:35:53.759102 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=100 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:35:53.763870 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecccb73-d88b-469a-824b-cbb1b2083d79 None admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:35:53.770282 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=100 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:35:53.792143 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454f4b13-e7a2-4310-9dbd-72cd639e2c46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:35:53.792783 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454f4b13-e7a2-4310-9dbd-72cd639e2c46 None admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:53.793055 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454f4b13-e7a2-4310-9dbd-72cd639e2c46 None admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:53.793320 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454f4b13-e7a2-4310-9dbd-72cd639e2c46 None admin] PATH_INFO: `/v3/users/swift` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:53.800073 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de46a9d0-4b06-4d5b-b1dd-a9575eebcb03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:35:53.800705 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de46a9d0-4b06-4d5b-b1dd-a9575eebcb03 None admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:53.800925 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454f4b13-e7a2-4310-9dbd-72cd639e2c46 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:35:53.801016 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de46a9d0-4b06-4d5b-b1dd-a9575eebcb03 None admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:53.801233 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de46a9d0-4b06-4d5b-b1dd-a9575eebcb03 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:53.802354 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454f4b13-e7a2-4310-9dbd-72cd639e2c46 None admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:35:53.811060 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de46a9d0-4b06-4d5b-b1dd-a9575eebcb03 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:35:53.812517 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de46a9d0-4b06-4d5b-b1dd-a9575eebcb03 None admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:35:53.813474 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application [None req-454f4b13-e7a2-4310-9dbd-72cd639e2c46 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 30 00:35:53.813474 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:35:53.813474 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:35:53.813474 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:35:53.813474 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:35:53.813474 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:35:53.813474 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:35:53.813474 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:35:53.813474 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:35:53.813474 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:35:53.813474 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:35:53.813474 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:35:53.813474 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 30 00:35:53.813474 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 30 00:35:53.813474 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 30 00:35:53.813474 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 30 00:35:53.814439 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:35:53.814439 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:35:53.814439 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 30 00:35:53.814439 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 30 00:35:53.814439 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 30 00:35:53.814439 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 30 00:35:53.814439 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:35:53.814439 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:35:53.814439 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:35:53.814439 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:35:53.814439 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:35:53.814439 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application with Lock( Oct 30 00:35:53.814439 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:35:53.814439 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:35:53.814439 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:35:53.814439 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:35:53.814439 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:35:53.814439 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:35:53.815354 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:35:53.815354 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:35:53.815354 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 30 00:35:53.815354 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 30 00:35:53.815354 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 30 00:35:53.815354 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 30 00:35:53.815354 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 30 00:35:53.815354 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 30 00:35:53.815354 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 30 00:35:53.815354 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application Oct 30 00:35:53.815354 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 217/436] 10.222.0.42 () {56 vars in 1096 bytes} [Sun Oct 30 00:35:53 2022] GET /identity/v3/users/swift => generated 83 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:35:53.815918 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02b37e2-ded5-412b-9f8f-8361dace8ade None None] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:53.816430 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02b37e2-ded5-412b-9f8f-8361dace8ade None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:53.816430 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02b37e2-ded5-412b-9f8f-8361dace8ade None None] PATH_INFO: `/` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:53.817775 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 218/437] 10.222.0.42 () {54 vars in 927 bytes} [Sun Oct 30 00:35:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:35:53.819957 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02b37e2-ded5-412b-9f8f-8361dace8ade None None] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:35:53.827834 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application [None req-de46a9d0-4b06-4d5b-b1dd-a9575eebcb03 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 30 00:35:53.827834 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:35:53.827834 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:35:53.827834 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:35:53.827834 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:35:53.827834 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:35:53.827834 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:35:53.827834 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:35:53.827834 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:35:53.827834 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:35:53.827834 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:35:53.827834 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:35:53.827834 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 30 00:35:53.827834 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 30 00:35:53.827834 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 30 00:35:53.827834 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 30 00:35:53.828705 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:35:53.828705 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:35:53.828705 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:35:53.828705 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:35:53.828705 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:35:53.828705 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:35:53.828705 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:35:53.828705 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application with Lock( Oct 30 00:35:53.828705 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:35:53.828705 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:35:53.828705 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:35:53.828705 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:35:53.828705 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:35:53.828705 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:35:53.828705 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:35:53.828705 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:35:53.828705 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 30 00:35:53.829883 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 30 00:35:53.829883 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 30 00:35:53.829883 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application Oct 30 00:35:53.829883 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 220/438] 10.222.0.42 () {56 vars in 1108 bytes} [Sun Oct 30 00:35:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:35:53.830372 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31cbc27-6ef3-4a07-8009-f8a19c17f126 None None] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:53.830649 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31cbc27-6ef3-4a07-8009-f8a19c17f126 None None] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:53.830916 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31cbc27-6ef3-4a07-8009-f8a19c17f126 None None] PATH_INFO: `/` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:53.832410 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 221/439] 10.222.0.42 () {54 vars in 927 bytes} [Sun Oct 30 00:35:53 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:35:53.833102 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31cbc27-6ef3-4a07-8009-f8a19c17f126 None None] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:35:53.922176 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02b37e2-ded5-412b-9f8f-8361dace8ade None None] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:35:53.934073 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31cbc27-6ef3-4a07-8009-f8a19c17f126 None None] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:35:53.957954 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86d8966-3eec-4e5e-a40d-5982911a94c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:35:53.958594 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86d8966-3eec-4e5e-a40d-5982911a94c7 None admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:53.958863 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86d8966-3eec-4e5e-a40d-5982911a94c7 None admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:53.959132 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86d8966-3eec-4e5e-a40d-5982911a94c7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:53.967245 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8292d82-9e9a-4e3d-947e-f5cb1bf37f55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:35:53.967841 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8292d82-9e9a-4e3d-947e-f5cb1bf37f55 None admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:53.968112 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8292d82-9e9a-4e3d-947e-f5cb1bf37f55 None admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:53.968380 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8292d82-9e9a-4e3d-947e-f5cb1bf37f55 None admin] PATH_INFO: `/v3/users` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:53.969109 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8292d82-9e9a-4e3d-947e-f5cb1bf37f55 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=87955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:35:53.969262 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86d8966-3eec-4e5e-a40d-5982911a94c7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 30 00:35:53.969389 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8292d82-9e9a-4e3d-947e-f5cb1bf37f55 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:35:53.970816 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8292d82-9e9a-4e3d-947e-f5cb1bf37f55 None admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:35:53.974918 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application [None req-e86d8966-3eec-4e5e-a40d-5982911a94c7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 30 00:35:53.974918 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:35:53.974918 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:35:53.974918 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:35:53.974918 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:35:53.974918 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:35:53.974918 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:35:53.974918 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:35:53.974918 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:35:53.974918 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:35:53.974918 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:35:53.974918 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:35:53.974918 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 30 00:35:53.974918 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 30 00:35:53.974918 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 30 00:35:53.974918 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 30 00:35:53.975853 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 30 00:35:53.975853 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 30 00:35:53.975853 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 30 00:35:53.975853 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 30 00:35:53.975853 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:35:53.975853 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:35:53.975853 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:35:53.975853 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:35:53.975853 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:35:53.975853 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:35:53.975853 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:35:53.975853 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application with Lock( Oct 30 00:35:53.975853 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:35:53.975853 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:35:53.975853 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:35:53.975853 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:35:53.976657 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:35:53.976657 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:35:53.976657 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:35:53.976657 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:35:53.976657 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 30 00:35:53.976657 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 30 00:35:53.976657 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 30 00:35:53.976657 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 30 00:35:53.976657 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 30 00:35:53.976657 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 30 00:35:53.976657 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 30 00:35:53.976657 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application Oct 30 00:35:53.977686 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 219/440] 10.222.0.42 () {56 vars in 1102 bytes} [Sun Oct 30 00:35:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:35:53.979011 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef264367-ff18-49e4-af70-931285d116df None None] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:53.979438 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef264367-ff18-49e4-af70-931285d116df None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:53.980495 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef264367-ff18-49e4-af70-931285d116df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:53.987790 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 222/441] 10.222.0.42 () {56 vars in 1135 bytes} [Sun Oct 30 00:35:53 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:35:53.988904 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8292d82-9e9a-4e3d-947e-f5cb1bf37f55 None admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:35:53.999474 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=100 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:35:54.004589 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.auth.core [None req-ef264367-ff18-49e4-af70-931285d116df None None] MFA Rules not processed for user `eb55b6cbca4945abb21b0e49eb745e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=87956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:35:54.005850 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-ef264367-ff18-49e4-af70-931285d116df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:35:54.032681 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=100 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:35:54.076525 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 220/442] 10.222.0.42 () {58 vars in 1024 bytes} [Sun Oct 30 00:35:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 30 00:35:54.077770 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01fdfe8-2ffe-4325-9e82-30807286ba84 None None] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:54.078049 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01fdfe8-2ffe-4325-9e82-30807286ba84 None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:54.078314 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01fdfe8-2ffe-4325-9e82-30807286ba84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:54.091122 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8292d82-9e9a-4e3d-947e-f5cb1bf37f55 None admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:35:54.096322 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.auth.core [None req-c01fdfe8-2ffe-4325-9e82-30807286ba84 None None] MFA Rules not processed for user `eb55b6cbca4945abb21b0e49eb745e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=87956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:35:54.097488 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-c01fdfe8-2ffe-4325-9e82-30807286ba84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:35:54.128763 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b5a70e-fe23-4d02-aa85-1b612da1322e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:35:54.129360 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b5a70e-fe23-4d02-aa85-1b612da1322e None admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:54.129633 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b5a70e-fe23-4d02-aa85-1b612da1322e None admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:54.129896 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b5a70e-fe23-4d02-aa85-1b612da1322e None admin] PATH_INFO: `/v3/domains` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:54.130524 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b5a70e-fe23-4d02-aa85-1b612da1322e None admin] RBAC: Adding query filter params (name=Default) {{(pid=87955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:35:54.130819 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b5a70e-fe23-4d02-aa85-1b612da1322e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:35:54.132194 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b5a70e-fe23-4d02-aa85-1b612da1322e None admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:35:54.147953 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 223/443] 10.222.0.42 () {56 vars in 1109 bytes} [Sun Oct 30 00:35:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:35:54.147953 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b5a70e-fe23-4d02-aa85-1b612da1322e None admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:35:54.171089 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 221/444] 10.222.0.42 () {58 vars in 1024 bytes} [Sun Oct 30 00:35:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 30 00:35:54.172159 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01fdfe8-2ffe-4325-9e82-30807286ba84 None None] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:35:54.229573 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=100 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:35:54.264563 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b5a70e-fe23-4d02-aa85-1b612da1322e None admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:35:54.300777 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b3f8e0-c247-419d-9ac1-80d957f25475 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:35:54.301672 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b3f8e0-c247-419d-9ac1-80d957f25475 None admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:54.302114 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b3f8e0-c247-419d-9ac1-80d957f25475 None admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:54.302545 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b3f8e0-c247-419d-9ac1-80d957f25475 None admin] PATH_INFO: `/v3/roles` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:54.303572 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b3f8e0-c247-419d-9ac1-80d957f25475 None admin] RBAC: Adding query filter params (name=service) {{(pid=87955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:35:54.304060 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b3f8e0-c247-419d-9ac1-80d957f25475 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:35:54.304785 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=100 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:35:54.305919 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b3f8e0-c247-419d-9ac1-80d957f25475 None admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:35:54.313870 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01fdfe8-2ffe-4325-9e82-30807286ba84 None None] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:35:54.319564 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 224/445] 10.222.0.42 () {56 vars in 1103 bytes} [Sun Oct 30 00:35:54 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:35:54.320653 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b3f8e0-c247-419d-9ac1-80d957f25475 None admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:35:54.356435 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10050237-c84f-4016-9031-0a998abf1220 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:35:54.357067 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10050237-c84f-4016-9031-0a998abf1220 None admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:54.357340 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10050237-c84f-4016-9031-0a998abf1220 None admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:54.357606 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10050237-c84f-4016-9031-0a998abf1220 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:54.368197 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10050237-c84f-4016-9031-0a998abf1220 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:35:54.369872 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10050237-c84f-4016-9031-0a998abf1220 None admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:35:54.385345 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application [None req-10050237-c84f-4016-9031-0a998abf1220 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 30 00:35:54.385345 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:35:54.385345 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:35:54.385345 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:35:54.385345 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:35:54.385345 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:35:54.385345 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:35:54.385345 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:35:54.385345 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:35:54.385345 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:35:54.385345 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:35:54.385345 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:35:54.385345 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 30 00:35:54.385345 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 30 00:35:54.385345 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 30 00:35:54.385345 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 30 00:35:54.386243 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:35:54.386243 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:35:54.386243 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:35:54.386243 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:35:54.386243 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:35:54.386243 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:35:54.386243 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:35:54.386243 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application with Lock( Oct 30 00:35:54.386243 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:35:54.386243 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:35:54.386243 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:35:54.386243 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:35:54.386243 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:35:54.386243 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:35:54.386243 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:35:54.386243 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:35:54.386243 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 30 00:35:54.387709 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 30 00:35:54.387709 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 30 00:35:54.387709 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application Oct 30 00:35:54.387709 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 222/446] 10.222.0.42 () {56 vars in 1108 bytes} [Sun Oct 30 00:35:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:35:54.387709 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10050237-c84f-4016-9031-0a998abf1220 None admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:35:54.424660 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b3f8e0-c247-419d-9ac1-80d957f25475 None admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:35:54.455156 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=100 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:35:54.461485 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b96b1e-8e02-4df7-8247-70187f8b70ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:35:54.462109 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b96b1e-8e02-4df7-8247-70187f8b70ea None admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:54.462384 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b96b1e-8e02-4df7-8247-70187f8b70ea None admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:54.462678 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b96b1e-8e02-4df7-8247-70187f8b70ea None admin] PATH_INFO: `/v3/projects/service` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:54.469276 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b96b1e-8e02-4df7-8247-70187f8b70ea None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:35:54.470902 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b96b1e-8e02-4df7-8247-70187f8b70ea None admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:35:54.481914 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application [None req-a7b96b1e-8e02-4df7-8247-70187f8b70ea None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 30 00:35:54.481914 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:35:54.481914 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:35:54.481914 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:35:54.481914 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:35:54.481914 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:35:54.481914 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:35:54.481914 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:35:54.481914 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:35:54.481914 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:35:54.481914 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:35:54.481914 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:35:54.481914 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 30 00:35:54.481914 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 30 00:35:54.481914 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 30 00:35:54.482742 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 30 00:35:54.482742 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:35:54.482742 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:35:54.482742 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:35:54.482742 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:35:54.482742 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:35:54.482742 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:35:54.482742 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:35:54.482742 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application with Lock( Oct 30 00:35:54.482742 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:35:54.482742 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:35:54.482742 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:35:54.482742 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:35:54.482742 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:35:54.482742 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:35:54.482742 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:35:54.482742 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:35:54.484011 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 30 00:35:54.484011 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 30 00:35:54.484011 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 30 00:35:54.484011 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 30 00:35:54.484011 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 30 00:35:54.484011 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 30 00:35:54.484011 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 30 00:35:54.484011 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application Oct 30 00:35:54.484011 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 225/447] 10.222.0.42 () {56 vars in 1111 bytes} [Sun Oct 30 00:35:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:35:54.484011 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b96b1e-8e02-4df7-8247-70187f8b70ea None admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:35:54.493278 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10050237-c84f-4016-9031-0a998abf1220 None admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:35:54.526523 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e86afda-cacd-421e-a88c-47ad9222d3f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:35:54.527153 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e86afda-cacd-421e-a88c-47ad9222d3f4 None admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:54.527454 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e86afda-cacd-421e-a88c-47ad9222d3f4 None admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:54.527695 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e86afda-cacd-421e-a88c-47ad9222d3f4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:54.537949 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e86afda-cacd-421e-a88c-47ad9222d3f4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:35:54.539413 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e86afda-cacd-421e-a88c-47ad9222d3f4 None admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:35:54.545836 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=100 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:35:54.554672 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application [None req-1e86afda-cacd-421e-a88c-47ad9222d3f4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 30 00:35:54.554672 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:35:54.554672 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:35:54.554672 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:35:54.554672 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:35:54.554672 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:35:54.554672 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:35:54.554672 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:35:54.554672 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:35:54.554672 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:35:54.554672 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:35:54.554672 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:35:54.554672 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 30 00:35:54.554672 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 30 00:35:54.554672 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 30 00:35:54.554672 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 30 00:35:54.555878 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:35:54.555878 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:35:54.555878 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:35:54.555878 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:35:54.555878 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:35:54.555878 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:35:54.555878 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:35:54.555878 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application with Lock( Oct 30 00:35:54.555878 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:35:54.555878 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:35:54.555878 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:35:54.555878 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:35:54.555878 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:35:54.555878 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:35:54.555878 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:35:54.555878 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:35:54.555878 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 30 00:35:54.556801 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 30 00:35:54.556801 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 30 00:35:54.556801 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application Oct 30 00:35:54.556801 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 223/448] 10.222.0.42 () {56 vars in 1108 bytes} [Sun Oct 30 00:35:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:35:54.561415 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e86afda-cacd-421e-a88c-47ad9222d3f4 None admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:35:54.579581 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b96b1e-8e02-4df7-8247-70187f8b70ea None admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:35:54.611691 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4084bd16-71e6-4265-9849-a84416f9cade None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:35:54.612314 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4084bd16-71e6-4265-9849-a84416f9cade None admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:54.612588 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4084bd16-71e6-4265-9849-a84416f9cade None admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:54.612852 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4084bd16-71e6-4265-9849-a84416f9cade None admin] PATH_INFO: `/v3/roles/service` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:54.622493 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4084bd16-71e6-4265-9849-a84416f9cade None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 30 00:35:54.628309 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application [None req-4084bd16-71e6-4265-9849-a84416f9cade None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 30 00:35:54.628309 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:35:54.628309 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:35:54.628309 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:35:54.628309 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:35:54.628309 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:35:54.628309 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:35:54.628309 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:35:54.628309 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:35:54.628309 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:35:54.628309 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:35:54.628309 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:35:54.628309 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 30 00:35:54.628309 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 30 00:35:54.628309 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 30 00:35:54.628309 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 30 00:35:54.629224 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 30 00:35:54.629224 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 30 00:35:54.629224 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 30 00:35:54.629224 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 30 00:35:54.629224 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:35:54.629224 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:35:54.629224 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:35:54.629224 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:35:54.629224 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:35:54.629224 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:35:54.629224 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:35:54.629224 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application with Lock( Oct 30 00:35:54.629224 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:35:54.629224 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:35:54.629224 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:35:54.629224 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:35:54.630028 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:35:54.630028 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:35:54.630028 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:35:54.630028 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:35:54.630028 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 30 00:35:54.630028 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 30 00:35:54.630028 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 30 00:35:54.630028 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 30 00:35:54.630028 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 30 00:35:54.630028 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 30 00:35:54.630028 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 30 00:35:54.630028 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application Oct 30 00:35:54.630028 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 226/449] 10.222.0.42 () {56 vars in 1102 bytes} [Sun Oct 30 00:35:54 2022] GET /identity/v3/roles/service => generated 85 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:35:54.630826 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4084bd16-71e6-4265-9849-a84416f9cade None admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:35:54.660958 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e86afda-cacd-421e-a88c-47ad9222d3f4 None admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:35:54.677003 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=100 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:35:54.694609 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e7f5b0-9557-49f7-a2ba-dfe4a549270d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:35:54.695255 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e7f5b0-9557-49f7-a2ba-dfe4a549270d None admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:54.695527 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e7f5b0-9557-49f7-a2ba-dfe4a549270d None admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:54.695798 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e7f5b0-9557-49f7-a2ba-dfe4a549270d None admin] PATH_INFO: `/v3/domains` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:54.696426 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e7f5b0-9557-49f7-a2ba-dfe4a549270d None admin] RBAC: Adding query filter params (name=Default) {{(pid=87956) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:35:54.696731 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e7f5b0-9557-49f7-a2ba-dfe4a549270d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:35:54.698158 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e7f5b0-9557-49f7-a2ba-dfe4a549270d None admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:35:54.710660 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 224/450] 10.222.0.42 () {56 vars in 1109 bytes} [Sun Oct 30 00:35:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:35:54.711526 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e7f5b0-9557-49f7-a2ba-dfe4a549270d None admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:35:54.731054 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4084bd16-71e6-4265-9849-a84416f9cade None admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:35:54.763066 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f17e73b-6fde-4d4b-9012-0b096445ce1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:35:54.763710 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f17e73b-6fde-4d4b-9012-0b096445ce1d None admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:54.763984 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f17e73b-6fde-4d4b-9012-0b096445ce1d None admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:54.764250 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f17e73b-6fde-4d4b-9012-0b096445ce1d None admin] PATH_INFO: `/v3/roles/service` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:54.768364 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=100 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:35:54.774367 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f17e73b-6fde-4d4b-9012-0b096445ce1d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 30 00:35:54.779742 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application [None req-2f17e73b-6fde-4d4b-9012-0b096445ce1d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 30 00:35:54.779742 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:35:54.779742 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:35:54.779742 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:35:54.779742 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:35:54.779742 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:35:54.779742 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:35:54.779742 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:35:54.779742 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:35:54.779742 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:35:54.779742 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:35:54.779742 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:35:54.779742 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 30 00:35:54.779742 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 30 00:35:54.779742 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 30 00:35:54.779742 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 30 00:35:54.780772 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 30 00:35:54.780772 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 30 00:35:54.780772 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 30 00:35:54.780772 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 30 00:35:54.780772 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:35:54.780772 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:35:54.780772 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:35:54.780772 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:35:54.780772 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:35:54.780772 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:35:54.780772 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:35:54.780772 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application with Lock( Oct 30 00:35:54.780772 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:35:54.780772 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:35:54.780772 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:35:54.780772 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:35:54.781757 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:35:54.781757 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:35:54.781757 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:35:54.781757 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:35:54.781757 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 30 00:35:54.781757 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 30 00:35:54.781757 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 30 00:35:54.781757 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 30 00:35:54.781757 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 30 00:35:54.781757 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 30 00:35:54.781757 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 30 00:35:54.781757 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application Oct 30 00:35:54.781757 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 227/451] 10.222.0.42 () {56 vars in 1102 bytes} [Sun Oct 30 00:35:54 2022] GET /identity/v3/roles/service => generated 85 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:35:54.782540 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f17e73b-6fde-4d4b-9012-0b096445ce1d None admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:35:54.812344 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e7f5b0-9557-49f7-a2ba-dfe4a549270d None admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:35:54.845409 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4652e1c6-4fef-4c05-9ca4-c0b130884c66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:35:54.846005 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4652e1c6-4fef-4c05-9ca4-c0b130884c66 None admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:54.846274 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4652e1c6-4fef-4c05-9ca4-c0b130884c66 None admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:54.846541 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4652e1c6-4fef-4c05-9ca4-c0b130884c66 None admin] PATH_INFO: `/v3/projects` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:54.847301 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4652e1c6-4fef-4c05-9ca4-c0b130884c66 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87956) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:35:54.847602 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4652e1c6-4fef-4c05-9ca4-c0b130884c66 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:35:54.849013 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4652e1c6-4fef-4c05-9ca4-c0b130884c66 None admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:35:54.860094 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 225/452] 10.222.0.42 () {56 vars in 1148 bytes} [Sun Oct 30 00:35:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:35:54.860860 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4652e1c6-4fef-4c05-9ca4-c0b130884c66 None admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:35:54.882282 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f17e73b-6fde-4d4b-9012-0b096445ce1d None admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:35:54.892535 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=100 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:35:54.915120 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e117932-1780-477a-8e84-a1279df86b22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:35:54.915871 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e117932-1780-477a-8e84-a1279df86b22 None admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:54.916147 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e117932-1780-477a-8e84-a1279df86b22 None admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:54.916417 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e117932-1780-477a-8e84-a1279df86b22 None admin] PATH_INFO: `/v3/domains` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:54.917048 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e117932-1780-477a-8e84-a1279df86b22 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:35:54.917343 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e117932-1780-477a-8e84-a1279df86b22 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:35:54.918701 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e117932-1780-477a-8e84-a1279df86b22 None admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:35:54.929867 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 228/453] 10.222.0.42 () {56 vars in 1109 bytes} [Sun Oct 30 00:35:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:35:54.930645 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e117932-1780-477a-8e84-a1279df86b22 None admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:35:54.955847 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4652e1c6-4fef-4c05-9ca4-c0b130884c66 None admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:35:54.971775 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=100 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:35:54.988191 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d56c3a-c9ba-4c6d-aaec-fb752dd88777 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:35:54.988793 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d56c3a-c9ba-4c6d-aaec-fb752dd88777 None admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:54.989063 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d56c3a-c9ba-4c6d-aaec-fb752dd88777 None admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:54.989327 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d56c3a-c9ba-4c6d-aaec-fb752dd88777 None admin] PATH_INFO: `/v3/roles` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:54.989980 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d56c3a-c9ba-4c6d-aaec-fb752dd88777 None admin] RBAC: Adding query filter params (name=service) {{(pid=87956) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:35:54.990276 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d56c3a-c9ba-4c6d-aaec-fb752dd88777 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:35:54.991657 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d56c3a-c9ba-4c6d-aaec-fb752dd88777 None admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:35:54.999158 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 226/454] 10.222.0.42 () {56 vars in 1103 bytes} [Sun Oct 30 00:35:54 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:35:54.999954 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d56c3a-c9ba-4c6d-aaec-fb752dd88777 None admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:35:55.028305 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e117932-1780-477a-8e84-a1279df86b22 None admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:35:55.062370 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7288fa78-8c7d-4ad0-bad5-21b348b6a4ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:35:55.062929 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7288fa78-8c7d-4ad0-bad5-21b348b6a4ba None admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:55.063223 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7288fa78-8c7d-4ad0-bad5-21b348b6a4ba None admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:55.063503 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7288fa78-8c7d-4ad0-bad5-21b348b6a4ba None admin] PATH_INFO: `/v3/projects/service` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:55.070793 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7288fa78-8c7d-4ad0-bad5-21b348b6a4ba None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:35:55.072022 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7288fa78-8c7d-4ad0-bad5-21b348b6a4ba None admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:35:55.083474 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application [None req-7288fa78-8c7d-4ad0-bad5-21b348b6a4ba None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 30 00:35:55.083474 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:35:55.083474 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:35:55.083474 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:35:55.083474 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:35:55.083474 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:35:55.083474 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:35:55.083474 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:35:55.083474 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:35:55.083474 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:35:55.083474 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:35:55.083474 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:35:55.083474 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 30 00:35:55.083474 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 30 00:35:55.083474 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 30 00:35:55.084512 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 30 00:35:55.084512 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:35:55.084512 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:35:55.084512 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:35:55.084512 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:35:55.084512 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:35:55.084512 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:35:55.084512 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:35:55.084512 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application with Lock( Oct 30 00:35:55.084512 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:35:55.084512 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:35:55.084512 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:35:55.084512 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:35:55.084512 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:35:55.084512 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:35:55.084512 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:35:55.084512 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:35:55.085829 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 30 00:35:55.085829 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 30 00:35:55.085829 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 30 00:35:55.085829 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 30 00:35:55.085829 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 30 00:35:55.085829 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 30 00:35:55.085829 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 30 00:35:55.085829 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application Oct 30 00:35:55.085829 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 229/455] 10.222.0.42 () {56 vars in 1111 bytes} [Sun Oct 30 00:35:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:35:55.085829 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7288fa78-8c7d-4ad0-bad5-21b348b6a4ba None admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:35:55.098162 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d56c3a-c9ba-4c6d-aaec-fb752dd88777 None admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:35:55.114319 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=100 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:35:55.131696 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26b0ca8-0604-4cd1-a228-ed08b0676198 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:35:55.132301 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26b0ca8-0604-4cd1-a228-ed08b0676198 None admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:55.132572 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26b0ca8-0604-4cd1-a228-ed08b0676198 None admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:55.132824 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26b0ca8-0604-4cd1-a228-ed08b0676198 None admin] PATH_INFO: `/v3/roles` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:55.133477 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26b0ca8-0604-4cd1-a228-ed08b0676198 None admin] RBAC: Adding query filter params (name=service) {{(pid=87956) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:35:55.133772 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26b0ca8-0604-4cd1-a228-ed08b0676198 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:35:55.135177 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26b0ca8-0604-4cd1-a228-ed08b0676198 None admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:35:55.142803 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 227/456] 10.222.0.42 () {56 vars in 1103 bytes} [Sun Oct 30 00:35:54 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:35:55.143599 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26b0ca8-0604-4cd1-a228-ed08b0676198 None admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:35:55.184291 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=100 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:35:55.185184 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7288fa78-8c7d-4ad0-bad5-21b348b6a4ba None admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:35:55.217782 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a94e1f-5710-44a4-a8da-c955315e6ec3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:35:55.218394 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a94e1f-5710-44a4-a8da-c955315e6ec3 None admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:55.218669 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a94e1f-5710-44a4-a8da-c955315e6ec3 None admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:55.218937 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a94e1f-5710-44a4-a8da-c955315e6ec3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:55.219698 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a94e1f-5710-44a4-a8da-c955315e6ec3 None admin] RBAC: Adding query filter params (role.id=904973500441476eadb9406925a575df, scope.project.id=17d2387fdf794d4eaef07bbcd7b39f2a, user.id=fde877b6ddc74f4a87baf21471eb31d2) {{(pid=87955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:35:55.220001 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a94e1f-5710-44a4-a8da-c955315e6ec3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:35:55.221469 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a94e1f-5710-44a4-a8da-c955315e6ec3 None admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:35:55.227086 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 230/457] 10.222.0.42 () {56 vars in 1374 bytes} [Sun Oct 30 00:35:55 2022] GET /identity/v3/role_assignments?user.id=fde877b6ddc74f4a87baf21471eb31d2&scope.project.id=17d2387fdf794d4eaef07bbcd7b39f2a&role.id=904973500441476eadb9406925a575df => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:35:55.227886 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a94e1f-5710-44a4-a8da-c955315e6ec3 None admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:35:55.242127 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26b0ca8-0604-4cd1-a228-ed08b0676198 None admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:35:55.283819 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c9ae27-a514-4574-af86-85d0a68bd9b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:35:55.284499 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c9ae27-a514-4574-af86-85d0a68bd9b4 None admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:55.284821 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c9ae27-a514-4574-af86-85d0a68bd9b4 None admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:55.285076 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c9ae27-a514-4574-af86-85d0a68bd9b4 None admin] PATH_INFO: `/v3/users/glance` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:55.293809 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c9ae27-a514-4574-af86-85d0a68bd9b4 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:35:55.295303 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c9ae27-a514-4574-af86-85d0a68bd9b4 None admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:35:55.307783 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application [None req-94c9ae27-a514-4574-af86-85d0a68bd9b4 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Oct 30 00:35:55.307783 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:35:55.307783 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:35:55.307783 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:35:55.307783 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:35:55.307783 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:35:55.307783 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:35:55.307783 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:35:55.307783 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:35:55.307783 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:35:55.307783 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:35:55.307783 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:35:55.307783 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 30 00:35:55.307783 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 30 00:35:55.307783 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 30 00:35:55.307783 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 30 00:35:55.308748 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:35:55.308748 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:35:55.308748 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 30 00:35:55.308748 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 30 00:35:55.308748 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 30 00:35:55.308748 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 30 00:35:55.308748 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:35:55.308748 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:35:55.308748 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:35:55.308748 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:35:55.308748 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:35:55.308748 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application with Lock( Oct 30 00:35:55.308748 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:35:55.308748 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:35:55.308748 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:35:55.308748 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:35:55.308748 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:35:55.308748 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:35:55.309645 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:35:55.309645 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:35:55.309645 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 30 00:35:55.309645 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 30 00:35:55.309645 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 30 00:35:55.309645 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 30 00:35:55.309645 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 30 00:35:55.309645 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 30 00:35:55.309645 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Oct 30 00:35:55.309645 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application Oct 30 00:35:55.309645 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 228/458] 10.222.0.42 () {56 vars in 1099 bytes} [Sun Oct 30 00:35:55 2022] GET /identity/v3/users/glance => generated 84 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:35:55.310245 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c9ae27-a514-4574-af86-85d0a68bd9b4 None admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:35:55.339802 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=100 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:35:55.349010 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a94e1f-5710-44a4-a8da-c955315e6ec3 None admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:35:55.391681 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99316c2a-ef92-4fb1-b4e8-8f1911840687 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:35:55.392327 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99316c2a-ef92-4fb1-b4e8-8f1911840687 None admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:55.392600 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99316c2a-ef92-4fb1-b4e8-8f1911840687 None admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:55.392868 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99316c2a-ef92-4fb1-b4e8-8f1911840687 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:55.404167 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99316c2a-ef92-4fb1-b4e8-8f1911840687 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:35:55.406753 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99316c2a-ef92-4fb1-b4e8-8f1911840687 None admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:35:55.421105 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application [None req-99316c2a-ef92-4fb1-b4e8-8f1911840687 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 30 00:35:55.421105 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:35:55.421105 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:35:55.421105 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:35:55.421105 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:35:55.421105 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:35:55.421105 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:35:55.421105 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:35:55.421105 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:35:55.421105 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:35:55.421105 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:35:55.421105 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:35:55.421105 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 30 00:35:55.421105 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 30 00:35:55.421105 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 30 00:35:55.421105 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 30 00:35:55.422034 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:35:55.422034 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:35:55.422034 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:35:55.422034 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:35:55.422034 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:35:55.422034 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:35:55.422034 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:35:55.422034 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application with Lock( Oct 30 00:35:55.422034 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:35:55.422034 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:35:55.422034 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:35:55.422034 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:35:55.422034 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:35:55.422034 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:35:55.422034 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:35:55.422034 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:35:55.422034 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 30 00:35:55.422880 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 30 00:35:55.422880 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 30 00:35:55.422880 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application Oct 30 00:35:55.422880 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 231/459] 10.222.0.42 () {56 vars in 1108 bytes} [Sun Oct 30 00:35:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:35:55.423100 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99316c2a-ef92-4fb1-b4e8-8f1911840687 None admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:35:55.430723 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c9ae27-a514-4574-af86-85d0a68bd9b4 None admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:35:55.432898 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=100 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:35:55.471180 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6158d580-e699-4831-97a3-994d3bd47f84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:35:55.471822 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6158d580-e699-4831-97a3-994d3bd47f84 None admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:55.472100 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6158d580-e699-4831-97a3-994d3bd47f84 None admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:55.472365 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6158d580-e699-4831-97a3-994d3bd47f84 None admin] PATH_INFO: `/v3/projects` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:55.473088 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6158d580-e699-4831-97a3-994d3bd47f84 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87956) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:35:55.473390 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6158d580-e699-4831-97a3-994d3bd47f84 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:35:55.474831 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6158d580-e699-4831-97a3-994d3bd47f84 None admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:35:55.488169 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 229/460] 10.222.0.42 () {56 vars in 1148 bytes} [Sun Oct 30 00:35:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:35:55.492411 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6158d580-e699-4831-97a3-994d3bd47f84 None admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:35:55.530935 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99316c2a-ef92-4fb1-b4e8-8f1911840687 None admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:35:55.567831 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6260765a-402e-40bb-9f68-1bca858f7845 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:35:55.568612 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6260765a-402e-40bb-9f68-1bca858f7845 None admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:55.569002 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6260765a-402e-40bb-9f68-1bca858f7845 None admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:55.569587 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6260765a-402e-40bb-9f68-1bca858f7845 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:55.581580 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6260765a-402e-40bb-9f68-1bca858f7845 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:35:55.583461 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6260765a-402e-40bb-9f68-1bca858f7845 None admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:35:55.590813 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=100 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:35:55.599804 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application [None req-6260765a-402e-40bb-9f68-1bca858f7845 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 30 00:35:55.599804 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:35:55.599804 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:35:55.599804 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:35:55.599804 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:35:55.599804 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:35:55.599804 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:35:55.599804 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:35:55.599804 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:35:55.599804 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:35:55.599804 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:35:55.599804 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:35:55.599804 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 30 00:35:55.599804 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 30 00:35:55.599804 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 30 00:35:55.599804 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 30 00:35:55.600890 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:35:55.600890 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:35:55.600890 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:35:55.600890 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:35:55.600890 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:35:55.600890 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:35:55.600890 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:35:55.600890 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application with Lock( Oct 30 00:35:55.600890 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:35:55.600890 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:35:55.600890 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:35:55.600890 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:35:55.600890 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:35:55.600890 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:35:55.600890 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:35:55.600890 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:35:55.600890 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 30 00:35:55.601925 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 30 00:35:55.601925 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 30 00:35:55.601925 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application Oct 30 00:35:55.607285 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 232/461] 10.222.0.42 () {56 vars in 1108 bytes} [Sun Oct 30 00:35:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:35:55.607285 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6260765a-402e-40bb-9f68-1bca858f7845 None admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:35:55.611326 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6158d580-e699-4831-97a3-994d3bd47f84 None admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:35:55.646659 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c45ba67-0201-48ba-93da-0ae0d774ad37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:35:55.647419 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c45ba67-0201-48ba-93da-0ae0d774ad37 None admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:55.647731 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c45ba67-0201-48ba-93da-0ae0d774ad37 None admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:55.648060 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c45ba67-0201-48ba-93da-0ae0d774ad37 None admin] PATH_INFO: `/v3/users` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:55.649051 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c45ba67-0201-48ba-93da-0ae0d774ad37 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=87956) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:35:55.649218 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c45ba67-0201-48ba-93da-0ae0d774ad37 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:35:55.650764 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c45ba67-0201-48ba-93da-0ae0d774ad37 None admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:35:55.692481 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 230/462] 10.222.0.42 () {56 vars in 1137 bytes} [Sun Oct 30 00:35:55 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:35:55.693176 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c45ba67-0201-48ba-93da-0ae0d774ad37 None admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:35:55.713319 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6260765a-402e-40bb-9f68-1bca858f7845 None admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:35:55.715401 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=100 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:35:55.750634 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10368c9e-7067-4c4a-b898-9c29fbff0000 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:35:55.751287 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10368c9e-7067-4c4a-b898-9c29fbff0000 None admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:55.751561 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10368c9e-7067-4c4a-b898-9c29fbff0000 None admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:55.751998 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10368c9e-7067-4c4a-b898-9c29fbff0000 None admin] PATH_INFO: `/v3/domains` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:55.752958 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10368c9e-7067-4c4a-b898-9c29fbff0000 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:35:55.753346 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10368c9e-7067-4c4a-b898-9c29fbff0000 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:35:55.754630 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10368c9e-7067-4c4a-b898-9c29fbff0000 None admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:35:55.766963 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 233/463] 10.222.0.42 () {56 vars in 1109 bytes} [Sun Oct 30 00:35:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:35:55.767936 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10368c9e-7067-4c4a-b898-9c29fbff0000 None admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:35:55.801492 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c45ba67-0201-48ba-93da-0ae0d774ad37 None admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:35:55.830764 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=100 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:35:55.838747 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f023d7-6e00-460f-8304-50753c9229b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:35:55.839752 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f023d7-6e00-460f-8304-50753c9229b3 None admin] REQUEST_METHOD: `PUT` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:55.839752 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f023d7-6e00-460f-8304-50753c9229b3 None admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:55.840024 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f023d7-6e00-460f-8304-50753c9229b3 None admin] PATH_INFO: `/v3/projects/17d2387fdf794d4eaef07bbcd7b39f2a/users/b6d6e884a8104a428e4de6be1cfa467c/roles/904973500441476eadb9406925a575df` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:55.855091 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f023d7-6e00-460f-8304-50753c9229b3 None admin] RBAC: Authorizing `identity:create_grant(project_id=17d2387fdf794d4eaef07bbcd7b39f2a, user_id=b6d6e884a8104a428e4de6be1cfa467c, role_id=904973500441476eadb9406925a575df)` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:35:55.856505 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f023d7-6e00-460f-8304-50753c9229b3 None admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:35:55.869651 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 231/464] 10.222.0.42 () {58 vars in 1439 bytes} [Sun Oct 30 00:35:55 2022] PUT /identity/v3/projects/17d2387fdf794d4eaef07bbcd7b39f2a/users/b6d6e884a8104a428e4de6be1cfa467c/roles/904973500441476eadb9406925a575df => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 00:35:55.870776 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f023d7-6e00-460f-8304-50753c9229b3 None admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:35:55.890748 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10368c9e-7067-4c4a-b898-9c29fbff0000 None admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:35:55.939993 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2146c846-78c5-4965-b7e9-ee709677ef33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:35:55.940689 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2146c846-78c5-4965-b7e9-ee709677ef33 None admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:55.940976 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2146c846-78c5-4965-b7e9-ee709677ef33 None admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:55.941256 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2146c846-78c5-4965-b7e9-ee709677ef33 None admin] PATH_INFO: `/v3/domains` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:55.942276 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2146c846-78c5-4965-b7e9-ee709677ef33 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:35:55.942592 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2146c846-78c5-4965-b7e9-ee709677ef33 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:35:55.944243 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2146c846-78c5-4965-b7e9-ee709677ef33 None admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:35:55.953011 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:35:55.962739 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 234/465] 10.222.0.42 () {56 vars in 1109 bytes} [Sun Oct 30 00:35:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:35:55.962739 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2146c846-78c5-4965-b7e9-ee709677ef33 None admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:35:56.006340 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f023d7-6e00-460f-8304-50753c9229b3 None admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:35:56.061809 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e7b0e6-4c92-4968-8af6-9043c7e2c194 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:35:56.062434 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e7b0e6-4c92-4968-8af6-9043c7e2c194 None admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:56.062710 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e7b0e6-4c92-4968-8af6-9043c7e2c194 None admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:56.062981 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e7b0e6-4c92-4968-8af6-9043c7e2c194 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:56.096808 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2146c846-78c5-4965-b7e9-ee709677ef33 None admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:35:56.119601 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=100 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:35:56.134817 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e7b0e6-4c92-4968-8af6-9043c7e2c194 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:35:56.137126 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e7b0e6-4c92-4968-8af6-9043c7e2c194 None admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:35:56.142793 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5194a87-a6e5-41f2-be10-b46f398aa254 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:35:56.143510 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5194a87-a6e5-41f2-be10-b46f398aa254 None admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:56.143788 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5194a87-a6e5-41f2-be10-b46f398aa254 None admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:56.144061 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5194a87-a6e5-41f2-be10-b46f398aa254 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:56.155511 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5194a87-a6e5-41f2-be10-b46f398aa254 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:35:56.157332 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5194a87-a6e5-41f2-be10-b46f398aa254 None admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:35:56.175022 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application [None req-c5194a87-a6e5-41f2-be10-b46f398aa254 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Oct 30 00:35:56.175022 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:35:56.175022 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:35:56.175022 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:35:56.175022 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:35:56.175022 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:35:56.175022 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:35:56.175022 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:35:56.175022 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:35:56.175022 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:35:56.175022 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:35:56.175022 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:35:56.175022 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 30 00:35:56.175022 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 30 00:35:56.175022 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 30 00:35:56.175022 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 30 00:35:56.176015 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:35:56.176015 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:35:56.176015 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 30 00:35:56.176015 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 30 00:35:56.176015 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 30 00:35:56.176015 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 30 00:35:56.176015 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:35:56.176015 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:35:56.176015 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:35:56.176015 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:35:56.176015 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:35:56.176015 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application with Lock( Oct 30 00:35:56.176015 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:35:56.176015 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:35:56.176015 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:35:56.176015 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:35:56.176015 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:35:56.176015 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:35:56.177296 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:35:56.177296 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:35:56.177296 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 30 00:35:56.177296 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 30 00:35:56.177296 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 30 00:35:56.177296 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 30 00:35:56.177296 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 30 00:35:56.177296 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 30 00:35:56.177296 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Oct 30 00:35:56.177296 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application Oct 30 00:35:56.177296 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 235/466] 10.222.0.42 () {56 vars in 1099 bytes} [Sun Oct 30 00:35:55 2022] GET /identity/v3/users/cinder => generated 84 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:35:56.177296 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5194a87-a6e5-41f2-be10-b46f398aa254 None admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:35:56.222972 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=100 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:35:56.266106 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 232/467] 10.222.0.42 () {58 vars in 1282 bytes} [Sun Oct 30 00:35:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 30 00:35:56.266766 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e7b0e6-4c92-4968-8af6-9043c7e2c194 None admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:35:56.306887 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5194a87-a6e5-41f2-be10-b46f398aa254 None admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:35:56.352406 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8796be-ed24-43b0-9dba-0e51b1d3dfba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:35:56.353345 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8796be-ed24-43b0-9dba-0e51b1d3dfba None admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:56.353628 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8796be-ed24-43b0-9dba-0e51b1d3dfba None admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:56.353899 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8796be-ed24-43b0-9dba-0e51b1d3dfba None admin] PATH_INFO: `/v3/users/neutron` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:56.364589 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8796be-ed24-43b0-9dba-0e51b1d3dfba None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:35:56.366339 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8796be-ed24-43b0-9dba-0e51b1d3dfba None admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:35:56.378044 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e7b0e6-4c92-4968-8af6-9043c7e2c194 None admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:35:56.380162 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application [None req-7c8796be-ed24-43b0-9dba-0e51b1d3dfba None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Oct 30 00:35:56.380162 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:35:56.380162 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:35:56.380162 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:35:56.380162 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:35:56.380162 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:35:56.380162 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:35:56.380162 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:35:56.380162 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:35:56.380162 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:35:56.380162 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:35:56.380162 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:35:56.380162 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 30 00:35:56.380162 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 30 00:35:56.380162 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 30 00:35:56.380162 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 30 00:35:56.381199 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:35:56.381199 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:35:56.381199 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 30 00:35:56.381199 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 30 00:35:56.381199 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 30 00:35:56.381199 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 30 00:35:56.381199 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:35:56.381199 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:35:56.381199 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:35:56.381199 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:35:56.381199 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:35:56.381199 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application with Lock( Oct 30 00:35:56.381199 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:35:56.381199 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:35:56.381199 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:35:56.381199 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:35:56.381199 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:35:56.381199 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:35:56.382296 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:35:56.382296 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:35:56.382296 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 30 00:35:56.382296 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 30 00:35:56.382296 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 30 00:35:56.382296 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 30 00:35:56.382296 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 30 00:35:56.382296 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 30 00:35:56.382296 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Oct 30 00:35:56.382296 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application Oct 30 00:35:56.382998 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 236/468] 10.222.0.42 () {56 vars in 1102 bytes} [Sun Oct 30 00:35:56 2022] GET /identity/v3/users/neutron => generated 85 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:35:56.384193 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8796be-ed24-43b0-9dba-0e51b1d3dfba None admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:35:56.424074 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5003065b-290f-449f-971e-c3b7aff88df5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:35:56.425281 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5003065b-290f-449f-971e-c3b7aff88df5 None admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:56.425995 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5003065b-290f-449f-971e-c3b7aff88df5 None admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:56.426842 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5003065b-290f-449f-971e-c3b7aff88df5 None admin] PATH_INFO: `/v3/users` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:56.428078 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5003065b-290f-449f-971e-c3b7aff88df5 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=87956) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:35:56.428606 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5003065b-290f-449f-971e-c3b7aff88df5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:35:56.431410 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5003065b-290f-449f-971e-c3b7aff88df5 None admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:35:56.436932 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=100 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:35:56.455324 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 233/469] 10.222.0.42 () {56 vars in 1137 bytes} [Sun Oct 30 00:35:56 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:35:56.456926 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5003065b-290f-449f-971e-c3b7aff88df5 None admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:35:56.493195 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=100 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:35:56.511614 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8796be-ed24-43b0-9dba-0e51b1d3dfba None admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:35:56.550656 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e751fa99-4872-4104-9c3d-d9a669e72e36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:35:56.551866 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e751fa99-4872-4104-9c3d-d9a669e72e36 None admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:56.552340 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e751fa99-4872-4104-9c3d-d9a669e72e36 None admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:56.553042 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e751fa99-4872-4104-9c3d-d9a669e72e36 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:56.566329 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e751fa99-4872-4104-9c3d-d9a669e72e36 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:35:56.568095 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e751fa99-4872-4104-9c3d-d9a669e72e36 None admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:35:56.569221 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5003065b-290f-449f-971e-c3b7aff88df5 None admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:35:56.585829 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application [None req-e751fa99-4872-4104-9c3d-d9a669e72e36 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 30 00:35:56.585829 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:35:56.585829 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:35:56.585829 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:35:56.585829 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:35:56.585829 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:35:56.585829 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:35:56.585829 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:35:56.585829 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:35:56.585829 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:35:56.585829 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:35:56.585829 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:35:56.585829 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 30 00:35:56.585829 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 30 00:35:56.585829 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 30 00:35:56.585829 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 30 00:35:56.586809 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:35:56.586809 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:35:56.586809 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:35:56.586809 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:35:56.586809 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:35:56.586809 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:35:56.586809 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:35:56.586809 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application with Lock( Oct 30 00:35:56.586809 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:35:56.586809 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:35:56.586809 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:35:56.586809 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:35:56.586809 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:35:56.586809 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:35:56.586809 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:35:56.586809 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:35:56.586809 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 30 00:35:56.587710 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 30 00:35:56.587710 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 30 00:35:56.587710 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application Oct 30 00:35:56.588714 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 237/470] 10.222.0.42 () {56 vars in 1108 bytes} [Sun Oct 30 00:35:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:35:56.589818 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e751fa99-4872-4104-9c3d-d9a669e72e36 None admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:35:56.611648 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6327954-df5a-4471-b5da-896a879d8034 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:35:56.612625 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6327954-df5a-4471-b5da-896a879d8034 None admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:56.613121 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6327954-df5a-4471-b5da-896a879d8034 None admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:56.613581 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6327954-df5a-4471-b5da-896a879d8034 None admin] PATH_INFO: `/v3/users` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:56.615041 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6327954-df5a-4471-b5da-896a879d8034 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=87956) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:35:56.615564 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6327954-df5a-4471-b5da-896a879d8034 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:35:56.617679 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6327954-df5a-4471-b5da-896a879d8034 None admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:35:56.649696 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 234/471] 10.222.0.42 () {56 vars in 1139 bytes} [Sun Oct 30 00:35:56 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:35:56.649696 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6327954-df5a-4471-b5da-896a879d8034 None admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:35:56.699214 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=100 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:35:56.713391 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e751fa99-4872-4104-9c3d-d9a669e72e36 None admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:35:56.753414 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=100 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:35:56.758121 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57287e51-80f4-4431-ba01-af246370ebda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:35:56.759550 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57287e51-80f4-4431-ba01-af246370ebda None admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:56.759992 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57287e51-80f4-4431-ba01-af246370ebda None admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:56.760264 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57287e51-80f4-4431-ba01-af246370ebda None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:56.772048 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6327954-df5a-4471-b5da-896a879d8034 None admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:35:56.810944 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624ac1bb-faf8-4e6a-b358-e783ddee06dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:35:56.812010 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624ac1bb-faf8-4e6a-b358-e783ddee06dd None admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:56.812476 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624ac1bb-faf8-4e6a-b358-e783ddee06dd None admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:56.812930 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624ac1bb-faf8-4e6a-b358-e783ddee06dd None admin] PATH_INFO: `/v3/domains` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:56.813853 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624ac1bb-faf8-4e6a-b358-e783ddee06dd None admin] RBAC: Adding query filter params (name=Default) {{(pid=87956) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:35:56.814359 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624ac1bb-faf8-4e6a-b358-e783ddee06dd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:35:56.816088 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624ac1bb-faf8-4e6a-b358-e783ddee06dd None admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:35:56.829246 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 235/472] 10.222.0.42 () {56 vars in 1109 bytes} [Sun Oct 30 00:35:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:35:56.830506 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624ac1bb-faf8-4e6a-b358-e783ddee06dd None admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:35:56.838349 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57287e51-80f4-4431-ba01-af246370ebda None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:35:56.839920 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57287e51-80f4-4431-ba01-af246370ebda None admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:35:56.936743 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624ac1bb-faf8-4e6a-b358-e783ddee06dd None admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:35:56.938866 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=100 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:35:56.949308 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 238/473] 10.222.0.42 () {58 vars in 1282 bytes} [Sun Oct 30 00:35:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 30 00:35:56.950264 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57287e51-80f4-4431-ba01-af246370ebda None admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:35:56.982764 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6930b7-12f2-4477-9f51-570bf20a9a69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:35:56.983397 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6930b7-12f2-4477-9f51-570bf20a9a69 None admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:56.983668 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6930b7-12f2-4477-9f51-570bf20a9a69 None admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:56.983931 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6930b7-12f2-4477-9f51-570bf20a9a69 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:57.000160 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=100 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:35:57.055081 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6930b7-12f2-4477-9f51-570bf20a9a69 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:35:57.056617 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6930b7-12f2-4477-9f51-570bf20a9a69 None admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:35:57.068841 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57287e51-80f4-4431-ba01-af246370ebda None admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:35:57.110294 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77611d33-1f4e-4e07-9f3b-ba5c18305b77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:35:57.111867 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77611d33-1f4e-4e07-9f3b-ba5c18305b77 None admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:57.112605 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77611d33-1f4e-4e07-9f3b-ba5c18305b77 None admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:57.113046 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77611d33-1f4e-4e07-9f3b-ba5c18305b77 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:57.120850 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77611d33-1f4e-4e07-9f3b-ba5c18305b77 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:35:57.123293 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77611d33-1f4e-4e07-9f3b-ba5c18305b77 None admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:35:57.135979 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application [None req-77611d33-1f4e-4e07-9f3b-ba5c18305b77 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 30 00:35:57.135979 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:35:57.135979 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:35:57.135979 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:35:57.135979 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:35:57.135979 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:35:57.135979 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:35:57.135979 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:35:57.135979 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:35:57.135979 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:35:57.135979 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:35:57.135979 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:35:57.135979 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 30 00:35:57.135979 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 30 00:35:57.135979 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 30 00:35:57.136848 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 30 00:35:57.136848 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:35:57.136848 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:35:57.136848 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:35:57.136848 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:35:57.136848 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:35:57.136848 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:35:57.136848 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:35:57.136848 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application with Lock( Oct 30 00:35:57.136848 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:35:57.136848 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:35:57.136848 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:35:57.136848 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:35:57.136848 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:35:57.136848 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:35:57.136848 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:35:57.136848 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:35:57.137675 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 30 00:35:57.137675 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 30 00:35:57.137675 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 30 00:35:57.137675 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 30 00:35:57.137675 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 30 00:35:57.137675 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 30 00:35:57.137675 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 30 00:35:57.137675 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application Oct 30 00:35:57.139847 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 239/474] 10.222.0.42 () {56 vars in 1111 bytes} [Sun Oct 30 00:35:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:35:57.140892 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77611d33-1f4e-4e07-9f3b-ba5c18305b77 None admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:35:57.175547 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 236/475] 10.222.0.42 () {58 vars in 1282 bytes} [Sun Oct 30 00:35:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 30 00:35:57.175547 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6930b7-12f2-4477-9f51-570bf20a9a69 None admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:35:57.202666 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=100 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:35:57.227229 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=100 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:35:57.277050 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77611d33-1f4e-4e07-9f3b-ba5c18305b77 None admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:35:57.284751 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6930b7-12f2-4477-9f51-570bf20a9a69 None admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:35:57.323447 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60e57c3-c82d-43f5-8cfa-b8b7effb3b73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:35:57.323943 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4112674d-552a-458d-a6b8-7e54d75ae043 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:35:57.324132 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60e57c3-c82d-43f5-8cfa-b8b7effb3b73 None admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:57.324357 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60e57c3-c82d-43f5-8cfa-b8b7effb3b73 None admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:57.324621 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60e57c3-c82d-43f5-8cfa-b8b7effb3b73 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:57.325553 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4112674d-552a-458d-a6b8-7e54d75ae043 None admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:57.326025 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4112674d-552a-458d-a6b8-7e54d75ae043 None admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:57.326485 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4112674d-552a-458d-a6b8-7e54d75ae043 None admin] PATH_INFO: `/v3/projects` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:57.327425 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4112674d-552a-458d-a6b8-7e54d75ae043 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87956) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:35:57.327959 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4112674d-552a-458d-a6b8-7e54d75ae043 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:35:57.329984 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4112674d-552a-458d-a6b8-7e54d75ae043 None admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:35:57.337617 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60e57c3-c82d-43f5-8cfa-b8b7effb3b73 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:35:57.339831 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60e57c3-c82d-43f5-8cfa-b8b7effb3b73 None admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:35:57.344655 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 237/476] 10.222.0.42 () {56 vars in 1148 bytes} [Sun Oct 30 00:35:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:35:57.345900 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4112674d-552a-458d-a6b8-7e54d75ae043 None admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:35:57.358676 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application [None req-b60e57c3-c82d-43f5-8cfa-b8b7effb3b73 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 30 00:35:57.358676 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:35:57.358676 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:35:57.358676 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:35:57.358676 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:35:57.358676 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:35:57.358676 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:35:57.358676 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:35:57.358676 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:35:57.358676 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:35:57.358676 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:35:57.358676 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:35:57.358676 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 30 00:35:57.358676 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 30 00:35:57.358676 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 30 00:35:57.358676 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 30 00:35:57.359622 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:35:57.359622 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:35:57.359622 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:35:57.359622 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:35:57.359622 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:35:57.359622 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:35:57.359622 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:35:57.359622 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application with Lock( Oct 30 00:35:57.359622 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:35:57.359622 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:35:57.359622 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:35:57.359622 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:35:57.359622 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:35:57.359622 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:35:57.359622 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:35:57.359622 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:35:57.359622 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 30 00:35:57.361082 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 30 00:35:57.361082 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 30 00:35:57.361082 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application Oct 30 00:35:57.361082 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 240/477] 10.222.0.42 () {56 vars in 1108 bytes} [Sun Oct 30 00:35:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:35:57.361082 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60e57c3-c82d-43f5-8cfa-b8b7effb3b73 None admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:35:57.454125 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4112674d-552a-458d-a6b8-7e54d75ae043 None admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:35:57.461629 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=100 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:35:57.478127 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60e57c3-c82d-43f5-8cfa-b8b7effb3b73 None admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:35:57.479768 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=100 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:35:57.492369 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f74c219-def3-4604-96df-28e71a76dca2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:35:57.493005 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f74c219-def3-4604-96df-28e71a76dca2 None admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:57.493528 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f74c219-def3-4604-96df-28e71a76dca2 None admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:57.493636 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f74c219-def3-4604-96df-28e71a76dca2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:57.504145 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f74c219-def3-4604-96df-28e71a76dca2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:35:57.505575 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f74c219-def3-4604-96df-28e71a76dca2 None admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:35:57.514769 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22f8f73-456b-479d-a0e6-0e2f41470193 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:35:57.515471 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22f8f73-456b-479d-a0e6-0e2f41470193 None admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:57.515804 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22f8f73-456b-479d-a0e6-0e2f41470193 None admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:57.516137 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22f8f73-456b-479d-a0e6-0e2f41470193 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:57.516932 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22f8f73-456b-479d-a0e6-0e2f41470193 None admin] RBAC: Adding query filter params (role.id=904973500441476eadb9406925a575df, scope.project.id=17d2387fdf794d4eaef07bbcd7b39f2a, user.id=36a86cf3eaf24b369737b65046142593) {{(pid=87955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:35:57.517300 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22f8f73-456b-479d-a0e6-0e2f41470193 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:35:57.518790 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22f8f73-456b-479d-a0e6-0e2f41470193 None admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:35:57.520051 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application [None req-7f74c219-def3-4604-96df-28e71a76dca2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 30 00:35:57.520051 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:35:57.520051 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:35:57.520051 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:35:57.520051 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:35:57.520051 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:35:57.520051 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:35:57.520051 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:35:57.520051 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:35:57.520051 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:35:57.520051 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:35:57.520051 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:35:57.520051 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 30 00:35:57.520051 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 30 00:35:57.520051 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 30 00:35:57.520051 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 30 00:35:57.521067 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:35:57.521067 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:35:57.521067 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:35:57.521067 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:35:57.521067 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:35:57.521067 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:35:57.521067 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:35:57.521067 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application with Lock( Oct 30 00:35:57.521067 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:35:57.521067 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:35:57.521067 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:35:57.521067 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:35:57.521067 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:35:57.521067 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:35:57.521067 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:35:57.521067 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:35:57.521067 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 30 00:35:57.527655 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 30 00:35:57.527655 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 30 00:35:57.527655 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application Oct 30 00:35:57.527655 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 238/478] 10.222.0.42 () {56 vars in 1108 bytes} [Sun Oct 30 00:35:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:35:57.527655 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f74c219-def3-4604-96df-28e71a76dca2 None admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:35:57.528019 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 241/479] 10.222.0.42 () {56 vars in 1374 bytes} [Sun Oct 30 00:35:57 2022] GET /identity/v3/role_assignments?user.id=36a86cf3eaf24b369737b65046142593&scope.project.id=17d2387fdf794d4eaef07bbcd7b39f2a&role.id=904973500441476eadb9406925a575df => generated 608 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:35:57.528629 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c9f4e2-e028-4b63-90ff-c4da14b3a786 None None] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:57.529165 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c9f4e2-e028-4b63-90ff-c4da14b3a786 None None] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:57.529589 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c9f4e2-e028-4b63-90ff-c4da14b3a786 None None] PATH_INFO: `/` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:57.531335 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 242/480] 10.222.0.42 () {54 vars in 927 bytes} [Sun Oct 30 00:35:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:35:57.536869 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c9f4e2-e028-4b63-90ff-c4da14b3a786 None None] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:35:57.648364 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f74c219-def3-4604-96df-28e71a76dca2 None admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:35:57.681396 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c9f4e2-e028-4b63-90ff-c4da14b3a786 None None] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:35:57.686639 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c9e879-a045-4be2-8909-37761f167d31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:35:57.687468 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c9e879-a045-4be2-8909-37761f167d31 None admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:57.687840 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c9e879-a045-4be2-8909-37761f167d31 None admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:57.688227 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c9e879-a045-4be2-8909-37761f167d31 None admin] PATH_INFO: `/v3/domains` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:57.689052 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c9e879-a045-4be2-8909-37761f167d31 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87956) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:35:57.689455 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c9e879-a045-4be2-8909-37761f167d31 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:35:57.690958 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c9e879-a045-4be2-8909-37761f167d31 None admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:35:57.705404 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 239/481] 10.222.0.42 () {56 vars in 1109 bytes} [Sun Oct 30 00:35:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:35:57.706738 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cffef3-f612-496f-9164-8acd43d95113 None None] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:57.707116 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cffef3-f612-496f-9164-8acd43d95113 None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:57.707544 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cffef3-f612-496f-9164-8acd43d95113 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:57.728635 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3385ae69-a85f-4899-8248-676d827723bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:35:57.728635 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3385ae69-a85f-4899-8248-676d827723bf None admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:57.728896 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3385ae69-a85f-4899-8248-676d827723bf None admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:57.729149 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3385ae69-a85f-4899-8248-676d827723bf None admin] PATH_INFO: `/v3/domains` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:57.730641 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.auth.core [None req-15cffef3-f612-496f-9164-8acd43d95113 None None] MFA Rules not processed for user `eb55b6cbca4945abb21b0e49eb745e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=87956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:35:57.730762 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3385ae69-a85f-4899-8248-676d827723bf None admin] RBAC: Adding query filter params (name=Default) {{(pid=87955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:35:57.730956 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3385ae69-a85f-4899-8248-676d827723bf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:35:57.732279 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-15cffef3-f612-496f-9164-8acd43d95113 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:35:57.732380 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3385ae69-a85f-4899-8248-676d827723bf None admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:35:57.747888 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 243/482] 10.222.0.42 () {56 vars in 1109 bytes} [Sun Oct 30 00:35:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:35:57.747888 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3385ae69-a85f-4899-8248-676d827723bf None admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:35:57.748878 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=100 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:35:57.791601 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=100 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:35:57.844512 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 240/483] 10.222.0.42 () {58 vars in 1024 bytes} [Sun Oct 30 00:35:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 30 00:35:57.845396 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cffef3-f612-496f-9164-8acd43d95113 None None] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:35:57.907268 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3385ae69-a85f-4899-8248-676d827723bf None admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:35:57.950815 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba4f33b-2108-4769-b987-a15543c09400 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:35:57.951490 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba4f33b-2108-4769-b987-a15543c09400 None admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:57.951767 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba4f33b-2108-4769-b987-a15543c09400 None admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:57.952035 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba4f33b-2108-4769-b987-a15543c09400 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:57.964716 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba4f33b-2108-4769-b987-a15543c09400 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:35:57.966092 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba4f33b-2108-4769-b987-a15543c09400 None admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:35:57.985088 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application [None req-fba4f33b-2108-4769-b987-a15543c09400 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 30 00:35:57.985088 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:35:57.985088 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:35:57.985088 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:35:57.985088 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:35:57.985088 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:35:57.985088 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:35:57.985088 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:35:57.985088 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:35:57.985088 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:35:57.985088 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:35:57.985088 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:35:57.985088 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 30 00:35:57.985088 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 30 00:35:57.985088 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 30 00:35:57.986081 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 30 00:35:57.986081 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:35:57.986081 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:35:57.986081 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:35:57.986081 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:35:57.986081 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:35:57.986081 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:35:57.986081 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:35:57.986081 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application with Lock( Oct 30 00:35:57.986081 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:35:57.986081 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:35:57.986081 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:35:57.986081 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:35:57.986081 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:35:57.986081 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:35:57.986081 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:35:57.986081 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:35:57.986892 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 30 00:35:57.986892 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 30 00:35:57.986892 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 30 00:35:57.986892 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 30 00:35:57.986892 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 30 00:35:57.986892 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 30 00:35:57.986892 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 30 00:35:57.986892 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application Oct 30 00:35:57.992670 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 244/484] 10.222.0.42 () {56 vars in 1111 bytes} [Sun Oct 30 00:35:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:35:57.999133 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba4f33b-2108-4769-b987-a15543c09400 None admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:35:58.126976 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cffef3-f612-496f-9164-8acd43d95113 None None] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:35:58.173777 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=100 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:35:58.209355 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba4f33b-2108-4769-b987-a15543c09400 None admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:35:58.224988 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158c2411-0009-4106-86df-25e0c0a29cc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:35:58.227348 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158c2411-0009-4106-86df-25e0c0a29cc7 None admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:58.228072 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158c2411-0009-4106-86df-25e0c0a29cc7 None admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:58.228344 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158c2411-0009-4106-86df-25e0c0a29cc7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:58.237208 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158c2411-0009-4106-86df-25e0c0a29cc7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:35:58.238945 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158c2411-0009-4106-86df-25e0c0a29cc7 None admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:35:58.251271 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application [None req-158c2411-0009-4106-86df-25e0c0a29cc7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 30 00:35:58.251271 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:35:58.251271 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:35:58.251271 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:35:58.251271 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:35:58.251271 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:35:58.251271 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:35:58.251271 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:35:58.251271 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:35:58.251271 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:35:58.251271 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:35:58.251271 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:35:58.251271 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 30 00:35:58.251271 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 30 00:35:58.251271 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 30 00:35:58.252141 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 30 00:35:58.252141 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:35:58.252141 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:35:58.252141 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:35:58.252141 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:35:58.252141 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:35:58.252141 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:35:58.252141 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:35:58.252141 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application with Lock( Oct 30 00:35:58.252141 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:35:58.252141 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:35:58.252141 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:35:58.252141 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:35:58.252141 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:35:58.252141 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:35:58.252141 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:35:58.252141 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:35:58.253062 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 30 00:35:58.253062 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 30 00:35:58.253062 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 30 00:35:58.253062 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 30 00:35:58.253062 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 30 00:35:58.253062 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 30 00:35:58.253062 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 30 00:35:58.253062 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application Oct 30 00:35:58.253062 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 241/485] 10.222.0.42 () {56 vars in 1111 bytes} [Sun Oct 30 00:35:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 407 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:35:58.253946 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e2b421-6955-4af6-8ae8-63adf28b1969 None None] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:58.254346 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e2b421-6955-4af6-8ae8-63adf28b1969 None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:58.254696 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e2b421-6955-4af6-8ae8-63adf28b1969 None None] PATH_INFO: `/` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:58.260098 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 242/486] 10.222.0.42 () {54 vars in 927 bytes} [Sun Oct 30 00:35:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:35:58.260098 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e2b421-6955-4af6-8ae8-63adf28b1969 None None] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:35:58.268612 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ffa35f-aa37-4a2d-9c3f-622e70916d6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:35:58.269143 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=100 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:35:58.270812 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ffa35f-aa37-4a2d-9c3f-622e70916d6f None admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:58.271321 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ffa35f-aa37-4a2d-9c3f-622e70916d6f None admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:58.272183 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ffa35f-aa37-4a2d-9c3f-622e70916d6f None admin] PATH_INFO: `/v3/projects` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:58.273481 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ffa35f-aa37-4a2d-9c3f-622e70916d6f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:35:58.273796 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ffa35f-aa37-4a2d-9c3f-622e70916d6f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:35:58.276742 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ffa35f-aa37-4a2d-9c3f-622e70916d6f None admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:35:58.294963 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 245/487] 10.222.0.42 () {56 vars in 1148 bytes} [Sun Oct 30 00:35:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:35:58.295919 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ffa35f-aa37-4a2d-9c3f-622e70916d6f None admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:35:58.365485 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e2b421-6955-4af6-8ae8-63adf28b1969 None None] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:35:58.399688 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8808b26d-44f2-46d1-b157-16754c0ae292 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:35:58.400304 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8808b26d-44f2-46d1-b157-16754c0ae292 None admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:58.400576 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8808b26d-44f2-46d1-b157-16754c0ae292 None admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:58.400855 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8808b26d-44f2-46d1-b157-16754c0ae292 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:58.402338 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ffa35f-aa37-4a2d-9c3f-622e70916d6f None admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:35:58.411062 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8808b26d-44f2-46d1-b157-16754c0ae292 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 30 00:35:58.415939 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application [None req-8808b26d-44f2-46d1-b157-16754c0ae292 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 30 00:35:58.415939 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:35:58.415939 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:35:58.415939 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:35:58.415939 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:35:58.415939 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:35:58.415939 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:35:58.415939 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:35:58.415939 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:35:58.415939 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:35:58.415939 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:35:58.415939 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:35:58.415939 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 30 00:35:58.415939 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 30 00:35:58.415939 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 30 00:35:58.415939 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 30 00:35:58.416833 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 30 00:35:58.416833 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 30 00:35:58.416833 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 30 00:35:58.416833 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 30 00:35:58.416833 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:35:58.416833 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:35:58.416833 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:35:58.416833 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:35:58.416833 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:35:58.416833 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:35:58.416833 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:35:58.416833 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application with Lock( Oct 30 00:35:58.416833 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:35:58.416833 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:35:58.416833 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:35:58.416833 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:35:58.417621 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:35:58.417621 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:35:58.417621 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:35:58.417621 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:35:58.417621 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 30 00:35:58.417621 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 30 00:35:58.417621 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 30 00:35:58.417621 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 30 00:35:58.417621 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 30 00:35:58.417621 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 30 00:35:58.417621 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 30 00:35:58.417621 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application Oct 30 00:35:58.417621 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 243/488] 10.222.0.42 () {56 vars in 1096 bytes} [Sun Oct 30 00:35:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:35:58.418759 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc67396-b83b-43f9-997a-b48123572b75 None None] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:58.418996 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc67396-b83b-43f9-997a-b48123572b75 None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:58.419287 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc67396-b83b-43f9-997a-b48123572b75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:58.437069 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.auth.core [None req-4dc67396-b83b-43f9-997a-b48123572b75 None None] MFA Rules not processed for user `eb55b6cbca4945abb21b0e49eb745e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=87956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:35:58.438273 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-4dc67396-b83b-43f9-997a-b48123572b75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:35:58.444456 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe359dc5-8c2d-4ace-abf5-2b32367e595f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:35:58.445069 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe359dc5-8c2d-4ace-abf5-2b32367e595f None admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:58.445354 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe359dc5-8c2d-4ace-abf5-2b32367e595f None admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:58.445609 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe359dc5-8c2d-4ace-abf5-2b32367e595f None admin] PATH_INFO: `/v3/projects` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:58.446309 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe359dc5-8c2d-4ace-abf5-2b32367e595f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:35:58.446638 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe359dc5-8c2d-4ace-abf5-2b32367e595f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:35:58.448101 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe359dc5-8c2d-4ace-abf5-2b32367e595f None admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:35:58.460759 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 246/489] 10.222.0.42 () {56 vars in 1148 bytes} [Sun Oct 30 00:35:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:35:58.466190 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe359dc5-8c2d-4ace-abf5-2b32367e595f None admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:35:58.475155 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=100 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:35:58.499755 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=100 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:35:58.515222 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 244/490] 10.222.0.42 () {58 vars in 1024 bytes} [Sun Oct 30 00:35:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 30 00:35:58.515222 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc67396-b83b-43f9-997a-b48123572b75 None None] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:35:58.573139 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe359dc5-8c2d-4ace-abf5-2b32367e595f None admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:35:58.617217 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f20f713-8f6c-4c61-8ad7-f467c7a0ad7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:35:58.617834 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f20f713-8f6c-4c61-8ad7-f467c7a0ad7c None admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:58.618158 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f20f713-8f6c-4c61-8ad7-f467c7a0ad7c None admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:58.618516 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f20f713-8f6c-4c61-8ad7-f467c7a0ad7c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:58.619411 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f20f713-8f6c-4c61-8ad7-f467c7a0ad7c None admin] RBAC: Adding query filter params (role.id=904973500441476eadb9406925a575df, scope.project.id=17d2387fdf794d4eaef07bbcd7b39f2a, user.id=48d928ff7fe24348ac900f09c56acc20) {{(pid=87955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:35:58.619717 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f20f713-8f6c-4c61-8ad7-f467c7a0ad7c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:35:58.621498 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f20f713-8f6c-4c61-8ad7-f467c7a0ad7c None admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:35:58.629306 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 247/491] 10.222.0.42 () {56 vars in 1374 bytes} [Sun Oct 30 00:35:58 2022] GET /identity/v3/role_assignments?user.id=48d928ff7fe24348ac900f09c56acc20&scope.project.id=17d2387fdf794d4eaef07bbcd7b39f2a&role.id=904973500441476eadb9406925a575df => generated 608 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:35:58.630173 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f20f713-8f6c-4c61-8ad7-f467c7a0ad7c None admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:35:58.642429 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc67396-b83b-43f9-997a-b48123572b75 None None] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:35:58.691062 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5994bd-207e-4691-a7cd-4ea5805ccdfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:35:58.692094 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5994bd-207e-4691-a7cd-4ea5805ccdfb None admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:58.692558 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5994bd-207e-4691-a7cd-4ea5805ccdfb None admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:58.693121 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5994bd-207e-4691-a7cd-4ea5805ccdfb None admin] PATH_INFO: `/v3/roles` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:58.694026 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5994bd-207e-4691-a7cd-4ea5805ccdfb None admin] RBAC: Adding query filter params (name=admin) {{(pid=87956) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:35:58.694510 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5994bd-207e-4691-a7cd-4ea5805ccdfb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:35:58.696202 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5994bd-207e-4691-a7cd-4ea5805ccdfb None admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:35:58.711628 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=100 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:35:58.717774 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 245/492] 10.222.0.42 () {56 vars in 1099 bytes} [Sun Oct 30 00:35:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:35:58.723376 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5994bd-207e-4691-a7cd-4ea5805ccdfb None admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:35:58.748191 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f20f713-8f6c-4c61-8ad7-f467c7a0ad7c None admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:35:58.796612 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a535ba-7189-4148-865d-a18a33e3262a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:35:58.797249 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a535ba-7189-4148-865d-a18a33e3262a None admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:58.797548 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a535ba-7189-4148-865d-a18a33e3262a None admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:58.797817 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a535ba-7189-4148-865d-a18a33e3262a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:58.798563 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a535ba-7189-4148-865d-a18a33e3262a None admin] RBAC: Adding query filter params (role.id=904973500441476eadb9406925a575df, scope.project.id=17d2387fdf794d4eaef07bbcd7b39f2a, user.id=5693f186c6ad4d9394f02ee3477cdcd3) {{(pid=87955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:35:58.798868 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a535ba-7189-4148-865d-a18a33e3262a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:35:58.800350 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a535ba-7189-4148-865d-a18a33e3262a None admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:35:58.814858 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 248/493] 10.222.0.42 () {56 vars in 1374 bytes} [Sun Oct 30 00:35:58 2022] GET /identity/v3/role_assignments?user.id=5693f186c6ad4d9394f02ee3477cdcd3&scope.project.id=17d2387fdf794d4eaef07bbcd7b39f2a&role.id=904973500441476eadb9406925a575df => generated 608 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:35:58.815763 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a535ba-7189-4148-865d-a18a33e3262a None admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:35:58.830290 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=100 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:35:58.889340 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5994bd-207e-4691-a7cd-4ea5805ccdfb None admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:35:58.959940 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29b0681-ca0d-4e98-8d68-81b78b7b1807 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:35:58.960609 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29b0681-ca0d-4e98-8d68-81b78b7b1807 None admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:58.960884 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29b0681-ca0d-4e98-8d68-81b78b7b1807 None admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:58.961150 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29b0681-ca0d-4e98-8d68-81b78b7b1807 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:58.975536 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29b0681-ca0d-4e98-8d68-81b78b7b1807 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:35:58.977923 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29b0681-ca0d-4e98-8d68-81b78b7b1807 None admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:35:58.983960 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a535ba-7189-4148-865d-a18a33e3262a None admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:35:58.998834 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application [None req-f29b0681-ca0d-4e98-8d68-81b78b7b1807 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 30 00:35:58.998834 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:35:58.998834 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:35:58.998834 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:35:58.998834 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:35:58.998834 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:35:58.998834 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:35:58.998834 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:35:58.998834 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:35:58.998834 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:35:58.998834 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:35:58.998834 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:35:58.998834 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 30 00:35:58.998834 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 30 00:35:58.998834 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 30 00:35:58.998834 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 30 00:35:59.000293 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:35:59.000293 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:35:59.000293 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:35:59.000293 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:35:59.000293 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:35:59.000293 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:35:59.000293 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:35:59.000293 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application with Lock( Oct 30 00:35:59.000293 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:35:59.000293 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:35:59.000293 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:35:59.000293 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:35:59.000293 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:35:59.000293 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:35:59.000293 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:35:59.000293 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:35:59.000293 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 30 00:35:59.001305 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 30 00:35:59.001305 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 30 00:35:59.001305 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application Oct 30 00:35:59.001305 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 246/494] 10.222.0.42 () {56 vars in 1108 bytes} [Sun Oct 30 00:35:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 30 00:35:59.007936 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29b0681-ca0d-4e98-8d68-81b78b7b1807 None admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:35:59.031141 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6e85ee-c630-4547-9bba-99e2c83da6e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:35:59.031847 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6e85ee-c630-4547-9bba-99e2c83da6e6 None admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:59.032120 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6e85ee-c630-4547-9bba-99e2c83da6e6 None admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:59.032771 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6e85ee-c630-4547-9bba-99e2c83da6e6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:59.034730 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=100 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:35:59.050929 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6e85ee-c630-4547-9bba-99e2c83da6e6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 30 00:35:59.058773 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application [None req-6e6e85ee-c630-4547-9bba-99e2c83da6e6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 30 00:35:59.058773 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:35:59.058773 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:35:59.058773 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:35:59.058773 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:35:59.058773 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:35:59.058773 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:35:59.058773 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:35:59.058773 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:35:59.058773 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:35:59.058773 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:35:59.058773 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:35:59.058773 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 30 00:35:59.058773 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 30 00:35:59.058773 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 30 00:35:59.058773 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 30 00:35:59.059765 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 30 00:35:59.059765 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 30 00:35:59.059765 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 30 00:35:59.059765 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 30 00:35:59.059765 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:35:59.059765 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:35:59.059765 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:35:59.059765 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:35:59.059765 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:35:59.059765 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:35:59.059765 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:35:59.059765 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application with Lock( Oct 30 00:35:59.059765 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:35:59.059765 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:35:59.059765 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:35:59.059765 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:35:59.060714 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:35:59.060714 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:35:59.060714 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:35:59.060714 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:35:59.060714 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 30 00:35:59.060714 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 30 00:35:59.060714 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 30 00:35:59.060714 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 30 00:35:59.060714 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 30 00:35:59.060714 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 30 00:35:59.060714 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 30 00:35:59.060714 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application Oct 30 00:35:59.060714 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 249/495] 10.222.0.42 () {56 vars in 1102 bytes} [Sun Oct 30 00:35:58 2022] GET /identity/v3/roles/service => generated 85 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:35:59.066342 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6e85ee-c630-4547-9bba-99e2c83da6e6 None admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:35:59.133487 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29b0681-ca0d-4e98-8d68-81b78b7b1807 None admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:35:59.147552 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=100 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:35:59.172178 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d91d33-5abb-456e-94a7-7e193ac6d5cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:35:59.172980 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d91d33-5abb-456e-94a7-7e193ac6d5cd None admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:59.173347 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d91d33-5abb-456e-94a7-7e193ac6d5cd None admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:59.173641 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d91d33-5abb-456e-94a7-7e193ac6d5cd None admin] PATH_INFO: `/v3/domains` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:59.174378 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d91d33-5abb-456e-94a7-7e193ac6d5cd None admin] RBAC: Adding query filter params (name=Default) {{(pid=87956) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:35:59.174905 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d91d33-5abb-456e-94a7-7e193ac6d5cd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:35:59.176392 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d91d33-5abb-456e-94a7-7e193ac6d5cd None admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:35:59.182630 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6e85ee-c630-4547-9bba-99e2c83da6e6 None admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:35:59.189436 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 247/496] 10.222.0.42 () {56 vars in 1109 bytes} [Sun Oct 30 00:35:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 30 00:35:59.194721 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d91d33-5abb-456e-94a7-7e193ac6d5cd None admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:35:59.219545 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3d3592-e467-4f32-835e-03271f2982b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:35:59.220666 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3d3592-e467-4f32-835e-03271f2982b3 None admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:59.221081 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3d3592-e467-4f32-835e-03271f2982b3 None admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:59.221487 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3d3592-e467-4f32-835e-03271f2982b3 None admin] PATH_INFO: `/v3/roles` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:59.222286 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3d3592-e467-4f32-835e-03271f2982b3 None admin] RBAC: Adding query filter params (name=service) {{(pid=87955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:35:59.222794 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3d3592-e467-4f32-835e-03271f2982b3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:35:59.224458 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3d3592-e467-4f32-835e-03271f2982b3 None admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:35:59.233752 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 250/497] 10.222.0.42 () {56 vars in 1103 bytes} [Sun Oct 30 00:35:59 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 30 00:35:59.242323 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3d3592-e467-4f32-835e-03271f2982b3 None admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:35:59.311586 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=100 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:35:59.317251 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d91d33-5abb-456e-94a7-7e193ac6d5cd None admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:35:59.352942 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f7868e-367f-4c1e-8aec-05b707b7ffc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:35:59.353573 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f7868e-367f-4c1e-8aec-05b707b7ffc4 None admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:59.353927 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f7868e-367f-4c1e-8aec-05b707b7ffc4 None admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:59.354196 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f7868e-367f-4c1e-8aec-05b707b7ffc4 None admin] PATH_INFO: `/v3/users/nova` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:59.356787 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3d3592-e467-4f32-835e-03271f2982b3 None admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:35:59.361512 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f7868e-367f-4c1e-8aec-05b707b7ffc4 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:35:59.362949 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f7868e-367f-4c1e-8aec-05b707b7ffc4 None admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:35:59.390100 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application [None req-d8f7868e-367f-4c1e-8aec-05b707b7ffc4 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 30 00:35:59.390100 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:35:59.390100 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:35:59.390100 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:35:59.390100 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:35:59.390100 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:35:59.390100 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:35:59.390100 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:35:59.390100 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:35:59.390100 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:35:59.390100 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:35:59.390100 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:35:59.390100 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 30 00:35:59.390100 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 30 00:35:59.390100 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 30 00:35:59.390100 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 30 00:35:59.391166 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:35:59.391166 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:35:59.391166 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 30 00:35:59.391166 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 30 00:35:59.391166 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 30 00:35:59.391166 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 30 00:35:59.391166 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:35:59.391166 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:35:59.391166 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:35:59.391166 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:35:59.391166 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:35:59.391166 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application with Lock( Oct 30 00:35:59.391166 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:35:59.391166 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:35:59.391166 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:35:59.391166 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:35:59.391166 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:35:59.391166 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:35:59.392118 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:35:59.392118 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:35:59.392118 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 30 00:35:59.392118 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 30 00:35:59.392118 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 30 00:35:59.392118 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 30 00:35:59.392118 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 30 00:35:59.392118 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 30 00:35:59.392118 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 30 00:35:59.392118 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application Oct 30 00:35:59.395571 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 248/498] 10.222.0.42 () {56 vars in 1093 bytes} [Sun Oct 30 00:35:59 2022] GET /identity/v3/users/nova => generated 82 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 30 00:35:59.403531 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f7868e-367f-4c1e-8aec-05b707b7ffc4 None admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:35:59.428437 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fde6c0-e641-4f6c-a755-377ff2e62e06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:35:59.429068 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fde6c0-e641-4f6c-a755-377ff2e62e06 None admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:59.429342 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fde6c0-e641-4f6c-a755-377ff2e62e06 None admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:59.429609 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fde6c0-e641-4f6c-a755-377ff2e62e06 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:59.453491 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90fde6c0-e641-4f6c-a755-377ff2e62e06 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:35:59.454947 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90fde6c0-e641-4f6c-a755-377ff2e62e06 None admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:35:59.455734 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=100 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:35:59.488590 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application [None req-90fde6c0-e641-4f6c-a755-377ff2e62e06 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 30 00:35:59.488590 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:35:59.488590 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:35:59.488590 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:35:59.488590 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:35:59.488590 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:35:59.488590 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:35:59.488590 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:35:59.488590 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:35:59.488590 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:35:59.488590 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:35:59.488590 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:35:59.488590 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 30 00:35:59.488590 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 30 00:35:59.488590 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 30 00:35:59.488590 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 30 00:35:59.489572 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:35:59.489572 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:35:59.489572 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:35:59.489572 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:35:59.489572 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:35:59.489572 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:35:59.489572 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:35:59.489572 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application with Lock( Oct 30 00:35:59.489572 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:35:59.489572 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:35:59.489572 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:35:59.489572 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:35:59.489572 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:35:59.489572 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:35:59.489572 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:35:59.489572 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:35:59.489572 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 30 00:35:59.492432 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 30 00:35:59.492432 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 30 00:35:59.492432 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application Oct 30 00:35:59.492432 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 251/499] 10.222.0.42 () {56 vars in 1108 bytes} [Sun Oct 30 00:35:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:35:59.496153 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fde6c0-e641-4f6c-a755-377ff2e62e06 None admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:35:59.541148 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f7868e-367f-4c1e-8aec-05b707b7ffc4 None admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:35:59.581276 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01abcac1-1caf-4351-bf86-a3e5674c53ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:35:59.582232 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01abcac1-1caf-4351-bf86-a3e5674c53ff None admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:59.582676 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01abcac1-1caf-4351-bf86-a3e5674c53ff None admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:59.583110 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01abcac1-1caf-4351-bf86-a3e5674c53ff None admin] PATH_INFO: `/v3/users` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:59.584463 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01abcac1-1caf-4351-bf86-a3e5674c53ff None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=87956) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:35:59.585116 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01abcac1-1caf-4351-bf86-a3e5674c53ff None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:35:59.586958 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01abcac1-1caf-4351-bf86-a3e5674c53ff None admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:35:59.608587 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 249/500] 10.222.0.42 () {56 vars in 1133 bytes} [Sun Oct 30 00:35:59 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:35:59.613933 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01abcac1-1caf-4351-bf86-a3e5674c53ff None admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:35:59.740499 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fde6c0-e641-4f6c-a755-377ff2e62e06 None admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:35:59.750782 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=100 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:35:59.762986 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=100 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:35:59.779272 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e71aadc-50fe-4838-89df-76d430f2d962 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:35:59.780191 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01abcac1-1caf-4351-bf86-a3e5674c53ff None admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:35:59.780463 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e71aadc-50fe-4838-89df-76d430f2d962 None admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:59.780930 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e71aadc-50fe-4838-89df-76d430f2d962 None admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:59.781390 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e71aadc-50fe-4838-89df-76d430f2d962 None admin] PATH_INFO: `/v3/domains` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:59.782239 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e71aadc-50fe-4838-89df-76d430f2d962 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:35:59.782731 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e71aadc-50fe-4838-89df-76d430f2d962 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:35:59.784344 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e71aadc-50fe-4838-89df-76d430f2d962 None admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:35:59.797280 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 252/501] 10.222.0.42 () {56 vars in 1109 bytes} [Sun Oct 30 00:35:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:35:59.807284 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e71aadc-50fe-4838-89df-76d430f2d962 None admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:35:59.852083 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a062eb-972c-4a98-a62d-04303e40df87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:35:59.852711 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a062eb-972c-4a98-a62d-04303e40df87 None admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:35:59.852986 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a062eb-972c-4a98-a62d-04303e40df87 None admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:35:59.853251 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a062eb-972c-4a98-a62d-04303e40df87 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:35:59.873582 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a062eb-972c-4a98-a62d-04303e40df87 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:35:59.875051 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a062eb-972c-4a98-a62d-04303e40df87 None admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:35:59.904543 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application [None req-e9a062eb-972c-4a98-a62d-04303e40df87 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 30 00:35:59.904543 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:35:59.904543 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:35:59.904543 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:35:59.904543 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:35:59.904543 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:35:59.904543 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:35:59.904543 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:35:59.904543 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:35:59.904543 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:35:59.904543 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:35:59.904543 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:35:59.904543 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 30 00:35:59.904543 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 30 00:35:59.904543 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 30 00:35:59.904543 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 30 00:35:59.905827 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:35:59.905827 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:35:59.905827 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:35:59.905827 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:35:59.905827 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:35:59.905827 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:35:59.905827 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:35:59.905827 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application with Lock( Oct 30 00:35:59.905827 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:35:59.905827 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:35:59.905827 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:35:59.905827 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:35:59.905827 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:35:59.905827 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:35:59.905827 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:35:59.905827 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:35:59.905827 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 30 00:35:59.906890 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 30 00:35:59.906890 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 30 00:35:59.906890 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application Oct 30 00:35:59.906890 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 250/502] 10.222.0.42 () {56 vars in 1108 bytes} [Sun Oct 30 00:35:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 30 00:35:59.911858 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a062eb-972c-4a98-a62d-04303e40df87 None admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:35:59.934054 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e71aadc-50fe-4838-89df-76d430f2d962 None admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:36:00.022700 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a062eb-972c-4a98-a62d-04303e40df87 None admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:36:00.032563 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c1cc4b-f359-45fd-ad06-3fe813a6efec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:36:00.033219 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c1cc4b-f359-45fd-ad06-3fe813a6efec None admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:36:00.033493 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c1cc4b-f359-45fd-ad06-3fe813a6efec None admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:36:00.033764 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c1cc4b-f359-45fd-ad06-3fe813a6efec None admin] PATH_INFO: `/v3/users/swift` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:36:00.054456 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c1cc4b-f359-45fd-ad06-3fe813a6efec None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:36:00.054456 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c1cc4b-f359-45fd-ad06-3fe813a6efec None admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:36:00.079833 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application [None req-c2c1cc4b-f359-45fd-ad06-3fe813a6efec None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 30 00:36:00.079833 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:36:00.079833 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:36:00.079833 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:36:00.079833 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:36:00.079833 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:36:00.079833 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:36:00.079833 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:36:00.079833 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:36:00.079833 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:36:00.079833 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:36:00.079833 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:36:00.079833 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 30 00:36:00.079833 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 30 00:36:00.079833 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 30 00:36:00.079833 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 30 00:36:00.080815 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:36:00.080815 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:36:00.080815 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 30 00:36:00.080815 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 30 00:36:00.080815 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 30 00:36:00.080815 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 30 00:36:00.080815 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:36:00.080815 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:36:00.080815 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:36:00.080815 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:36:00.080815 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:36:00.080815 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application with Lock( Oct 30 00:36:00.080815 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:36:00.080815 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:36:00.080815 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:36:00.080815 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:36:00.080815 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:36:00.080815 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:36:00.081838 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:36:00.081838 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:36:00.081838 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 30 00:36:00.081838 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 30 00:36:00.081838 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 30 00:36:00.081838 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 30 00:36:00.081838 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 30 00:36:00.081838 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 30 00:36:00.081838 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 30 00:36:00.081838 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application Oct 30 00:36:00.081838 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 253/503] 10.222.0.42 () {56 vars in 1096 bytes} [Sun Oct 30 00:35:59 2022] GET /identity/v3/users/swift => generated 83 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:36:00.088996 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5022639-7010-42ea-828b-9ae653bdd78e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:36:00.089619 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5022639-7010-42ea-828b-9ae653bdd78e None admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:36:00.089891 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5022639-7010-42ea-828b-9ae653bdd78e None admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:36:00.090159 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5022639-7010-42ea-828b-9ae653bdd78e None admin] PATH_INFO: `/v3/domains` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:36:00.090809 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5022639-7010-42ea-828b-9ae653bdd78e None admin] RBAC: Adding query filter params (name=Default) {{(pid=87956) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:36:00.091103 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5022639-7010-42ea-828b-9ae653bdd78e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:36:00.092506 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5022639-7010-42ea-828b-9ae653bdd78e None admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:36:00.094695 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c1cc4b-f359-45fd-ad06-3fe813a6efec None admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:36:00.117498 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 251/504] 10.222.0.42 () {56 vars in 1109 bytes} [Sun Oct 30 00:35:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:36:00.125190 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5022639-7010-42ea-828b-9ae653bdd78e None admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:36:00.127947 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=100 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:36:00.163577 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=100 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:36:00.243523 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c1cc4b-f359-45fd-ad06-3fe813a6efec None admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:36:00.265485 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5022639-7010-42ea-828b-9ae653bdd78e None admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:36:00.280888 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012d5c79-1165-4a58-8015-c0cc35fe1a3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:36:00.281502 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012d5c79-1165-4a58-8015-c0cc35fe1a3d None admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:36:00.281775 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012d5c79-1165-4a58-8015-c0cc35fe1a3d None admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:36:00.282044 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012d5c79-1165-4a58-8015-c0cc35fe1a3d None admin] PATH_INFO: `/v3/users` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:36:00.283061 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012d5c79-1165-4a58-8015-c0cc35fe1a3d None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=87955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:36:00.283401 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012d5c79-1165-4a58-8015-c0cc35fe1a3d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:36:00.284823 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012d5c79-1165-4a58-8015-c0cc35fe1a3d None admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:36:00.304973 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 254/505] 10.222.0.42 () {56 vars in 1135 bytes} [Sun Oct 30 00:36:00 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:36:00.306387 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224d3d82-999e-4894-b22c-3f4c0dc8f35d None None] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:36:00.306674 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224d3d82-999e-4894-b22c-3f4c0dc8f35d None None] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:36:00.306951 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224d3d82-999e-4894-b22c-3f4c0dc8f35d None None] PATH_INFO: `/` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:36:00.312465 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 255/506] 10.222.0.42 () {54 vars in 927 bytes} [Sun Oct 30 00:36:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:36:00.312465 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224d3d82-999e-4894-b22c-3f4c0dc8f35d None None] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:36:00.318485 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c94bdd6-ef22-48ec-9b34-1e13a5c993c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:36:00.319870 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c94bdd6-ef22-48ec-9b34-1e13a5c993c5 None admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:36:00.320297 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c94bdd6-ef22-48ec-9b34-1e13a5c993c5 None admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:36:00.320711 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c94bdd6-ef22-48ec-9b34-1e13a5c993c5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:36:00.331352 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c94bdd6-ef22-48ec-9b34-1e13a5c993c5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:36:00.333448 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c94bdd6-ef22-48ec-9b34-1e13a5c993c5 None admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:36:00.351605 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application [None req-0c94bdd6-ef22-48ec-9b34-1e13a5c993c5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 30 00:36:00.351605 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:36:00.351605 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:36:00.351605 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:36:00.351605 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:36:00.351605 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:36:00.351605 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:36:00.351605 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:36:00.351605 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:36:00.351605 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:36:00.351605 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:36:00.351605 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:36:00.351605 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 30 00:36:00.351605 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 30 00:36:00.351605 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 30 00:36:00.352637 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 30 00:36:00.352637 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:36:00.352637 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:36:00.352637 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:36:00.352637 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:36:00.352637 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:36:00.352637 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:36:00.352637 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:36:00.352637 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application with Lock( Oct 30 00:36:00.352637 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:36:00.352637 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:36:00.352637 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:36:00.352637 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:36:00.352637 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:36:00.352637 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:36:00.352637 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:36:00.352637 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:36:00.353540 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 30 00:36:00.353540 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 30 00:36:00.353540 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 30 00:36:00.353540 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 30 00:36:00.353540 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 30 00:36:00.353540 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 30 00:36:00.353540 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 30 00:36:00.353540 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application Oct 30 00:36:00.353540 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 252/507] 10.222.0.42 () {56 vars in 1111 bytes} [Sun Oct 30 00:36:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:36:00.354918 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdd0cec-5d4e-48d4-ad66-c12a55f77dc7 None None] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:36:00.355315 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdd0cec-5d4e-48d4-ad66-c12a55f77dc7 None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:36:00.355728 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdd0cec-5d4e-48d4-ad66-c12a55f77dc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:36:00.374580 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.auth.core [None req-ccdd0cec-5d4e-48d4-ad66-c12a55f77dc7 None None] MFA Rules not processed for user `eb55b6cbca4945abb21b0e49eb745e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=87956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:36:00.375943 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-ccdd0cec-5d4e-48d4-ad66-c12a55f77dc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:36:00.414806 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=100 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:36:00.432065 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224d3d82-999e-4894-b22c-3f4c0dc8f35d None None] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:36:00.449791 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=100 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:36:00.471223 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 253/508] 10.222.0.42 () {58 vars in 1024 bytes} [Sun Oct 30 00:36:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 30 00:36:00.471223 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdd0cec-5d4e-48d4-ad66-c12a55f77dc7 None None] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:36:00.481393 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f6aa46-9150-4165-bc25-0200f15aac13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:36:00.481996 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f6aa46-9150-4165-bc25-0200f15aac13 None admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:36:00.482272 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f6aa46-9150-4165-bc25-0200f15aac13 None admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:36:00.482577 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f6aa46-9150-4165-bc25-0200f15aac13 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:36:00.613096 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f6aa46-9150-4165-bc25-0200f15aac13 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:36:00.614550 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f6aa46-9150-4165-bc25-0200f15aac13 None admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:36:00.642410 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdd0cec-5d4e-48d4-ad66-c12a55f77dc7 None None] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:36:00.678158 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700627fa-6113-4aef-a6a2-2ce85cc82f78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:36:00.678771 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700627fa-6113-4aef-a6a2-2ce85cc82f78 None admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:36:00.679092 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700627fa-6113-4aef-a6a2-2ce85cc82f78 None admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:36:00.679436 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700627fa-6113-4aef-a6a2-2ce85cc82f78 None admin] PATH_INFO: `/v3/projects` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:36:00.680267 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700627fa-6113-4aef-a6a2-2ce85cc82f78 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87956) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:36:00.680568 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700627fa-6113-4aef-a6a2-2ce85cc82f78 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:36:00.682067 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700627fa-6113-4aef-a6a2-2ce85cc82f78 None admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:36:00.699489 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 254/509] 10.222.0.42 () {56 vars in 1148 bytes} [Sun Oct 30 00:36:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:36:00.700744 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700627fa-6113-4aef-a6a2-2ce85cc82f78 None admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:36:00.771559 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=100 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:36:00.797798 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=100 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:36:00.815880 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 256/510] 10.222.0.42 () {58 vars in 1282 bytes} [Sun Oct 30 00:36:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 505 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 30 00:36:00.817226 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f6aa46-9150-4165-bc25-0200f15aac13 None admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:36:00.843615 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700627fa-6113-4aef-a6a2-2ce85cc82f78 None admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:36:00.883620 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cda6397-c5cc-48a6-87e2-6b4234383bec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:36:00.884286 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cda6397-c5cc-48a6-87e2-6b4234383bec None admin] REQUEST_METHOD: `PUT` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:36:00.884555 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cda6397-c5cc-48a6-87e2-6b4234383bec None admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:36:00.884820 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cda6397-c5cc-48a6-87e2-6b4234383bec None admin] PATH_INFO: `/v3/projects/17d2387fdf794d4eaef07bbcd7b39f2a/users/fde877b6ddc74f4a87baf21471eb31d2/roles/6ccaa8c11f29456fb4e4eeccb21616c7` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:36:00.887368 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cda6397-c5cc-48a6-87e2-6b4234383bec None admin] RBAC: Authorizing `identity:create_grant(project_id=17d2387fdf794d4eaef07bbcd7b39f2a, user_id=fde877b6ddc74f4a87baf21471eb31d2, role_id=6ccaa8c11f29456fb4e4eeccb21616c7)` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:36:00.889077 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cda6397-c5cc-48a6-87e2-6b4234383bec None admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:36:00.905884 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 255/511] 10.222.0.42 () {58 vars in 1439 bytes} [Sun Oct 30 00:36:00 2022] PUT /identity/v3/projects/17d2387fdf794d4eaef07bbcd7b39f2a/users/fde877b6ddc74f4a87baf21471eb31d2/roles/6ccaa8c11f29456fb4e4eeccb21616c7 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 00:36:00.906889 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cda6397-c5cc-48a6-87e2-6b4234383bec None admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:36:00.993849 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f6aa46-9150-4165-bc25-0200f15aac13 None admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:36:01.033589 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c20ade-ebd2-41ce-aeef-8ad57973c2b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:36:01.034693 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c20ade-ebd2-41ce-aeef-8ad57973c2b2 None admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:36:01.035227 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c20ade-ebd2-41ce-aeef-8ad57973c2b2 None admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:36:01.035866 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c20ade-ebd2-41ce-aeef-8ad57973c2b2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:36:01.053330 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c20ade-ebd2-41ce-aeef-8ad57973c2b2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:36:01.054581 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cda6397-c5cc-48a6-87e2-6b4234383bec None admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:36:01.055733 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c20ade-ebd2-41ce-aeef-8ad57973c2b2 None admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:36:01.069758 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:36:01.097254 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74c7b1c-a92a-48f6-93d7-9eda085017ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:36:01.097889 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74c7b1c-a92a-48f6-93d7-9eda085017ee None admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:36:01.098162 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74c7b1c-a92a-48f6-93d7-9eda085017ee None admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:36:01.098427 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74c7b1c-a92a-48f6-93d7-9eda085017ee None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:36:01.099897 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application [None req-76c20ade-ebd2-41ce-aeef-8ad57973c2b2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 30 00:36:01.099897 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:36:01.099897 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:36:01.099897 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:36:01.099897 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:36:01.099897 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:36:01.099897 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:36:01.099897 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:36:01.099897 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:36:01.099897 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:36:01.099897 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:36:01.099897 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:36:01.099897 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 30 00:36:01.099897 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 30 00:36:01.099897 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 30 00:36:01.099897 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 30 00:36:01.100941 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:36:01.100941 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:36:01.100941 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:36:01.100941 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:36:01.100941 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:36:01.100941 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:36:01.100941 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:36:01.100941 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application with Lock( Oct 30 00:36:01.100941 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:36:01.100941 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:36:01.100941 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:36:01.100941 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:36:01.100941 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:36:01.100941 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:36:01.100941 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:36:01.100941 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:36:01.100941 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 30 00:36:01.101879 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 30 00:36:01.101879 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 30 00:36:01.101879 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application Oct 30 00:36:01.109378 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 257/512] 10.222.0.42 () {56 vars in 1108 bytes} [Sun Oct 30 00:36:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 292 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:36:01.111868 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74c7b1c-a92a-48f6-93d7-9eda085017ee None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:36:01.111868 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74c7b1c-a92a-48f6-93d7-9eda085017ee None admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:36:01.115995 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c20ade-ebd2-41ce-aeef-8ad57973c2b2 None admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:36:01.126872 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application [None req-d74c7b1c-a92a-48f6-93d7-9eda085017ee None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 30 00:36:01.126872 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:36:01.126872 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:36:01.126872 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:36:01.126872 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:36:01.126872 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:36:01.126872 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:36:01.126872 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:36:01.126872 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:36:01.126872 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:36:01.126872 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:36:01.126872 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:36:01.126872 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 30 00:36:01.126872 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 30 00:36:01.126872 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 30 00:36:01.126872 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 30 00:36:01.127922 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:36:01.127922 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:36:01.127922 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:36:01.127922 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:36:01.127922 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:36:01.127922 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:36:01.127922 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:36:01.127922 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application with Lock( Oct 30 00:36:01.127922 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:36:01.127922 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:36:01.127922 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:36:01.127922 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:36:01.127922 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:36:01.127922 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:36:01.127922 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:36:01.127922 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:36:01.127922 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 30 00:36:01.128823 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 30 00:36:01.128823 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 30 00:36:01.128823 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application Oct 30 00:36:01.128823 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 256/513] 10.222.0.42 () {56 vars in 1108 bytes} [Sun Oct 30 00:36:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:36:01.134157 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74c7b1c-a92a-48f6-93d7-9eda085017ee None admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:36:01.184042 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=100 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:36:01.259120 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c20ade-ebd2-41ce-aeef-8ad57973c2b2 None admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:36:01.264688 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74c7b1c-a92a-48f6-93d7-9eda085017ee None admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:36:01.314848 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f9a0a9-3d1e-46cc-a46b-185b8f8f8921 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:36:01.316424 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f9a0a9-3d1e-46cc-a46b-185b8f8f8921 None admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:36:01.316711 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f9a0a9-3d1e-46cc-a46b-185b8f8f8921 None admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:36:01.316986 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f9a0a9-3d1e-46cc-a46b-185b8f8f8921 None admin] PATH_INFO: `/v3/domains` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:36:01.317644 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f9a0a9-3d1e-46cc-a46b-185b8f8f8921 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:36:01.317945 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f9a0a9-3d1e-46cc-a46b-185b8f8f8921 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:36:01.319353 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f9a0a9-3d1e-46cc-a46b-185b8f8f8921 None admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:36:01.327106 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8221bdaa-7f6a-4659-87ff-799650338e4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:36:01.329189 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8221bdaa-7f6a-4659-87ff-799650338e4c None admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:36:01.329665 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8221bdaa-7f6a-4659-87ff-799650338e4c None admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:36:01.330129 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8221bdaa-7f6a-4659-87ff-799650338e4c None admin] PATH_INFO: `/v3/domains` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:36:01.331593 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8221bdaa-7f6a-4659-87ff-799650338e4c None admin] RBAC: Adding query filter params (name=Default) {{(pid=87956) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:36:01.332196 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8221bdaa-7f6a-4659-87ff-799650338e4c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:36:01.333760 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8221bdaa-7f6a-4659-87ff-799650338e4c None admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:36:01.334095 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 258/514] 10.222.0.42 () {56 vars in 1109 bytes} [Sun Oct 30 00:36:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 30 00:36:01.335373 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08c979b-2f7a-4f40-bbc0-69ac21074819 None None] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:36:01.335657 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08c979b-2f7a-4f40-bbc0-69ac21074819 None None] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:36:01.335931 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08c979b-2f7a-4f40-bbc0-69ac21074819 None None] PATH_INFO: `/` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:36:01.341347 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 259/515] 10.222.0.42 () {54 vars in 927 bytes} [Sun Oct 30 00:36:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:36:01.341347 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08c979b-2f7a-4f40-bbc0-69ac21074819 None None] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:36:01.355719 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 257/516] 10.222.0.42 () {56 vars in 1109 bytes} [Sun Oct 30 00:36:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 30 00:36:01.357876 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf724b5-b448-4aac-b00c-5391fac7d436 None None] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:36:01.358342 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf724b5-b448-4aac-b00c-5391fac7d436 None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:36:01.359024 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf724b5-b448-4aac-b00c-5391fac7d436 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:36:01.381709 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.auth.core [None req-0bf724b5-b448-4aac-b00c-5391fac7d436 None None] MFA Rules not processed for user `eb55b6cbca4945abb21b0e49eb745e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=87956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:36:01.383211 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-0bf724b5-b448-4aac-b00c-5391fac7d436 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:36:01.407790 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=100 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:36:01.457301 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=100 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:36:01.467395 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 258/517] 10.222.0.42 () {58 vars in 1024 bytes} [Sun Oct 30 00:36:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 30 00:36:01.467575 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08c979b-2f7a-4f40-bbc0-69ac21074819 None None] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:36:01.467670 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf724b5-b448-4aac-b00c-5391fac7d436 None None] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:36:01.505691 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1b59c4-1b13-452a-a0e2-027df240cb49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:36:01.506479 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1b59c4-1b13-452a-a0e2-027df240cb49 None admin] REQUEST_METHOD: `POST` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:36:01.506887 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1b59c4-1b13-452a-a0e2-027df240cb49 None admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:36:01.507273 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1b59c4-1b13-452a-a0e2-027df240cb49 None admin] PATH_INFO: `/v3/users` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:36:01.508045 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1b59c4-1b13-452a-a0e2-027df240cb49 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:36:01.509911 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1b59c4-1b13-452a-a0e2-027df240cb49 None admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:36:01.540638 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 260/518] 10.222.0.42 () {60 vars in 1132 bytes} [Sun Oct 30 00:36:01 2022] POST /identity/v3/users => generated 254 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 30 00:36:01.542369 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fb1a44-bcda-4c09-82b4-551b42f3e89c None None] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:36:01.542824 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fb1a44-bcda-4c09-82b4-551b42f3e89c None None] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:36:01.543256 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fb1a44-bcda-4c09-82b4-551b42f3e89c None None] PATH_INFO: `/` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:36:01.545399 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 261/519] 10.222.0.42 () {54 vars in 927 bytes} [Sun Oct 30 00:36:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:36:01.555275 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0665db-5491-4dbc-b597-77ff7479d957 None None] REQUEST_METHOD: `POST` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:36:01.555275 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0665db-5491-4dbc-b597-77ff7479d957 None None] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:36:01.555275 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0665db-5491-4dbc-b597-77ff7479d957 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:36:01.584216 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf724b5-b448-4aac-b00c-5391fac7d436 None None] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:36:01.611437 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.auth.core [None req-7a0665db-5491-4dbc-b597-77ff7479d957 None None] MFA Rules not processed for user `eb55b6cbca4945abb21b0e49eb745e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=87955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:36:01.612661 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-7a0665db-5491-4dbc-b597-77ff7479d957 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:36:01.626959 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b52bec1-9219-4fb6-892c-69973d06ae1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:36:01.627650 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b52bec1-9219-4fb6-892c-69973d06ae1f None admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:36:01.627924 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b52bec1-9219-4fb6-892c-69973d06ae1f None admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:36:01.628196 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b52bec1-9219-4fb6-892c-69973d06ae1f None admin] PATH_INFO: `/v3/projects/service` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:36:01.640885 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b52bec1-9219-4fb6-892c-69973d06ae1f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:36:01.642392 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b52bec1-9219-4fb6-892c-69973d06ae1f None admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:36:01.663876 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application [None req-8b52bec1-9219-4fb6-892c-69973d06ae1f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 30 00:36:01.663876 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:36:01.663876 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:36:01.663876 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:36:01.663876 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:36:01.663876 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:36:01.663876 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:36:01.663876 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:36:01.663876 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:36:01.663876 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:36:01.663876 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:36:01.663876 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:36:01.663876 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 30 00:36:01.663876 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 30 00:36:01.663876 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 30 00:36:01.664904 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 30 00:36:01.664904 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:36:01.664904 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:36:01.664904 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:36:01.664904 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:36:01.664904 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:36:01.664904 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:36:01.664904 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:36:01.664904 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application with Lock( Oct 30 00:36:01.664904 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:36:01.664904 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:36:01.664904 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:36:01.664904 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:36:01.664904 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:36:01.664904 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:36:01.664904 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:36:01.664904 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:36:01.665789 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 30 00:36:01.665789 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 30 00:36:01.665789 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 30 00:36:01.665789 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 30 00:36:01.665789 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 30 00:36:01.665789 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 30 00:36:01.665789 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 30 00:36:01.665789 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application Oct 30 00:36:01.666875 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 259/520] 10.222.0.42 () {56 vars in 1111 bytes} [Sun Oct 30 00:36:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:36:01.671663 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b52bec1-9219-4fb6-892c-69973d06ae1f None admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:36:01.707266 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=100 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:36:01.764024 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 262/521] 10.222.0.42 () {58 vars in 1024 bytes} [Sun Oct 30 00:36:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 30 00:36:01.781241 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b52bec1-9219-4fb6-892c-69973d06ae1f None admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:36:01.791885 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0665db-5491-4dbc-b597-77ff7479d957 None None] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:36:01.815706 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ac8f80-71f2-430b-a7d6-f0c5a81abd9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:36:01.816320 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ac8f80-71f2-430b-a7d6-f0c5a81abd9b None admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:36:01.816606 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ac8f80-71f2-430b-a7d6-f0c5a81abd9b None admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:36:01.816863 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ac8f80-71f2-430b-a7d6-f0c5a81abd9b None admin] PATH_INFO: `/v3/projects` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:36:01.817551 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ac8f80-71f2-430b-a7d6-f0c5a81abd9b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87956) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:36:01.817850 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ac8f80-71f2-430b-a7d6-f0c5a81abd9b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:36:01.819314 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ac8f80-71f2-430b-a7d6-f0c5a81abd9b None admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:36:01.835981 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 260/522] 10.222.0.42 () {56 vars in 1148 bytes} [Sun Oct 30 00:36:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 30 00:36:01.841878 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ac8f80-71f2-430b-a7d6-f0c5a81abd9b None admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:36:01.919028 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0665db-5491-4dbc-b597-77ff7479d957 None None] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:36:01.926774 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=100 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:36:01.931788 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:36:01.957685 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ac8f80-71f2-430b-a7d6-f0c5a81abd9b None admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:36:01.974014 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22582bc-71ec-43d4-b492-3ef7e0e855ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:36:01.974650 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22582bc-71ec-43d4-b492-3ef7e0e855ca None admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:36:01.975168 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22582bc-71ec-43d4-b492-3ef7e0e855ca None admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:36:01.975486 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22582bc-71ec-43d4-b492-3ef7e0e855ca None admin] PATH_INFO: `/v3/services/network` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:36:01.977346 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22582bc-71ec-43d4-b492-3ef7e0e855ca None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:36:01.978706 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22582bc-71ec-43d4-b492-3ef7e0e855ca None admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:36:01.999852 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application [None req-c22582bc-71ec-43d4-b492-3ef7e0e855ca None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Oct 30 00:36:01.999852 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:36:01.999852 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 30 00:36:01.999852 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 30 00:36:01.999852 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 30 00:36:01.999852 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 30 00:36:01.999852 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 30 00:36:01.999852 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 30 00:36:01.999852 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 30 00:36:01.999852 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application Oct 30 00:36:01.999852 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 30 00:36:01.999852 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application Oct 30 00:36:01.999852 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:36:01.999852 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:36:01.999852 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:36:01.999852 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:36:01.999852 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:36:02.000893 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:36:02.000893 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:36:02.000893 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:36:02.000893 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:36:02.000893 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:36:02.000893 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:36:02.000893 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 30 00:36:02.000893 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 30 00:36:02.000893 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 30 00:36:02.000893 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 30 00:36:02.000893 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:36:02.000893 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:36:02.000893 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:36:02.000893 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:36:02.000893 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:36:02.000893 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:36:02.001719 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:36:02.001719 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application with Lock( Oct 30 00:36:02.001719 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:36:02.001719 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:36:02.001719 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:36:02.001719 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:36:02.001719 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:36:02.001719 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:36:02.001719 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:36:02.001719 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:36:02.001719 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 30 00:36:02.001719 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 30 00:36:02.001719 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 30 00:36:02.001719 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application Oct 30 00:36:02.001719 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 263/523] 10.222.0.42 () {56 vars in 1111 bytes} [Sun Oct 30 00:36:01 2022] GET /identity/v3/services/network => generated 88 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 30 00:36:02.009060 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22582bc-71ec-43d4-b492-3ef7e0e855ca None admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:36:02.025134 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f0c49a-4ee5-4b07-804e-84a63add90c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:36:02.025812 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f0c49a-4ee5-4b07-804e-84a63add90c0 None admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:36:02.026082 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f0c49a-4ee5-4b07-804e-84a63add90c0 None admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:36:02.026345 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f0c49a-4ee5-4b07-804e-84a63add90c0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:36:02.027078 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f0c49a-4ee5-4b07-804e-84a63add90c0 None admin] RBAC: Adding query filter params (role.id=904973500441476eadb9406925a575df, scope.project.id=17d2387fdf794d4eaef07bbcd7b39f2a, user.id=b6d6e884a8104a428e4de6be1cfa467c) {{(pid=87956) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:36:02.027441 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f0c49a-4ee5-4b07-804e-84a63add90c0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:36:02.028904 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f0c49a-4ee5-4b07-804e-84a63add90c0 None admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:36:02.045282 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 261/524] 10.222.0.42 () {56 vars in 1374 bytes} [Sun Oct 30 00:36:01 2022] GET /identity/v3/role_assignments?user.id=b6d6e884a8104a428e4de6be1cfa467c&scope.project.id=17d2387fdf794d4eaef07bbcd7b39f2a&role.id=904973500441476eadb9406925a575df => generated 608 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:36:02.074049 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f0c49a-4ee5-4b07-804e-84a63add90c0 None admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:36:02.208343 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22582bc-71ec-43d4-b492-3ef7e0e855ca None admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:36:02.250148 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5a239a-25ed-4b75-895b-dadeb55e40b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:36:02.250763 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5a239a-25ed-4b75-895b-dadeb55e40b4 None admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:36:02.251041 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5a239a-25ed-4b75-895b-dadeb55e40b4 None admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:36:02.251369 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5a239a-25ed-4b75-895b-dadeb55e40b4 None admin] PATH_INFO: `/v3/services` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:36:02.251995 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5a239a-25ed-4b75-895b-dadeb55e40b4 None admin] RBAC: Adding query filter params (name=network) {{(pid=87955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:36:02.252295 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5a239a-25ed-4b75-895b-dadeb55e40b4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:36:02.253676 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5a239a-25ed-4b75-895b-dadeb55e40b4 None admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:36:02.262852 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f0c49a-4ee5-4b07-804e-84a63add90c0 None admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:36:02.266559 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 264/525] 10.222.0.42 () {56 vars in 1112 bytes} [Sun Oct 30 00:36:02 2022] GET /identity/v3/services?name=network => generated 124 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:36:02.271854 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5a239a-25ed-4b75-895b-dadeb55e40b4 None admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:36:02.304660 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=100 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:36:02.308028 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae19de1-a634-408e-b364-7791044cf023 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:36:02.308671 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae19de1-a634-408e-b364-7791044cf023 None admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:36:02.308946 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae19de1-a634-408e-b364-7791044cf023 None admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:36:02.309213 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae19de1-a634-408e-b364-7791044cf023 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:36:02.309799 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae19de1-a634-408e-b364-7791044cf023 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:36:02.311162 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae19de1-a634-408e-b364-7791044cf023 None admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:36:02.323966 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application [None req-3ae19de1-a634-408e-b364-7791044cf023 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 30 00:36:02.323966 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:36:02.323966 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 30 00:36:02.323966 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 30 00:36:02.323966 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 30 00:36:02.323966 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 30 00:36:02.323966 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 30 00:36:02.323966 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 30 00:36:02.323966 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 30 00:36:02.323966 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application Oct 30 00:36:02.323966 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 30 00:36:02.323966 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application Oct 30 00:36:02.323966 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:36:02.323966 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:36:02.323966 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:36:02.323966 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:36:02.323966 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:36:02.324997 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:36:02.324997 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:36:02.324997 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:36:02.324997 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:36:02.324997 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:36:02.324997 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:36:02.324997 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 30 00:36:02.324997 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 30 00:36:02.324997 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 30 00:36:02.324997 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 30 00:36:02.324997 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:36:02.324997 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:36:02.324997 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:36:02.324997 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:36:02.324997 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:36:02.324997 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:36:02.325811 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:36:02.325811 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application with Lock( Oct 30 00:36:02.325811 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:36:02.325811 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:36:02.325811 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:36:02.325811 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:36:02.325811 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:36:02.325811 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:36:02.325811 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:36:02.325811 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:36:02.325811 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 30 00:36:02.325811 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 30 00:36:02.325811 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 30 00:36:02.325811 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application Oct 30 00:36:02.325811 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 262/526] 10.222.0.42 () {56 vars in 1129 bytes} [Sun Oct 30 00:36:02 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 30 00:36:02.332834 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae19de1-a634-408e-b364-7791044cf023 None admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:36:02.338529 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=100 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:36:02.425218 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5a239a-25ed-4b75-895b-dadeb55e40b4 None admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:36:02.492119 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4670f69c-738f-4867-b0ca-64b5590a4e56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:36:02.493161 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4670f69c-738f-4867-b0ca-64b5590a4e56 None admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:36:02.493640 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4670f69c-738f-4867-b0ca-64b5590a4e56 None admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:36:02.494232 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4670f69c-738f-4867-b0ca-64b5590a4e56 None admin] PATH_INFO: `/v3/services` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:36:02.495082 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4670f69c-738f-4867-b0ca-64b5590a4e56 None admin] RBAC: Adding query filter params (type=network) {{(pid=87955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:36:02.495655 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4670f69c-738f-4867-b0ca-64b5590a4e56 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:36:02.497326 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4670f69c-738f-4867-b0ca-64b5590a4e56 None admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:36:02.504130 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 265/527] 10.222.0.42 () {56 vars in 1112 bytes} [Sun Oct 30 00:36:02 2022] GET /identity/v3/services?type=network => generated 124 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 30 00:36:02.543701 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae19de1-a634-408e-b364-7791044cf023 None admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:36:02.601173 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52beb0f-7c5d-4cd5-a909-7708803b7c3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:36:02.602359 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52beb0f-7c5d-4cd5-a909-7708803b7c3d None admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:36:02.602841 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52beb0f-7c5d-4cd5-a909-7708803b7c3d None admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:36:02.603372 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52beb0f-7c5d-4cd5-a909-7708803b7c3d None admin] PATH_INFO: `/v3/services` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:36:02.604295 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52beb0f-7c5d-4cd5-a909-7708803b7c3d None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=87956) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:36:02.604817 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52beb0f-7c5d-4cd5-a909-7708803b7c3d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:36:02.606476 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52beb0f-7c5d-4cd5-a909-7708803b7c3d None admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:36:02.615303 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 263/528] 10.222.0.42 () {56 vars in 1124 bytes} [Sun Oct 30 00:36:02 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:36:02.621568 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4670f69c-738f-4867-b0ca-64b5590a4e56 None admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:36:02.717565 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=100 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:36:02.743590 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4670f69c-738f-4867-b0ca-64b5590a4e56 None admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:36:02.779690 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefdce70-0a54-4a40-b3b1-c63a9cfc09f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:36:02.780735 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefdce70-0a54-4a40-b3b1-c63a9cfc09f6 None admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:36:02.781224 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefdce70-0a54-4a40-b3b1-c63a9cfc09f6 None admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:36:02.781689 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefdce70-0a54-4a40-b3b1-c63a9cfc09f6 None admin] PATH_INFO: `/v3/services` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:36:02.782545 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cefdce70-0a54-4a40-b3b1-c63a9cfc09f6 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=87955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:36:02.783055 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cefdce70-0a54-4a40-b3b1-c63a9cfc09f6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:36:02.784720 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cefdce70-0a54-4a40-b3b1-c63a9cfc09f6 None admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:36:02.790993 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 266/529] 10.222.0.42 () {56 vars in 1124 bytes} [Sun Oct 30 00:36:02 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:36:03.469561 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8408a946-ef20-43d2-a9e9-612927b1fac8 None None] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:36:03.470075 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8408a946-ef20-43d2-a9e9-612927b1fac8 None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:36:03.470075 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8408a946-ef20-43d2-a9e9-612927b1fac8 None None] PATH_INFO: `/` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:36:03.471679 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 264/530] 10.222.0.42 () {54 vars in 927 bytes} [Sun Oct 30 00:36:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:36:03.486737 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba5b351-9023-4bf0-b55d-8b77b432358a None None] REQUEST_METHOD: `POST` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:36:03.487261 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba5b351-9023-4bf0-b55d-8b77b432358a None None] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:36:03.487369 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba5b351-9023-4bf0-b55d-8b77b432358a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:36:03.512198 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.auth.core [None req-bba5b351-9023-4bf0-b55d-8b77b432358a None None] MFA Rules not processed for user `eb55b6cbca4945abb21b0e49eb745e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=87955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:36:03.513411 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-bba5b351-9023-4bf0-b55d-8b77b432358a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:36:03.601478 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 267/531] 10.222.0.42 () {58 vars in 1024 bytes} [Sun Oct 30 00:36:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 30 00:36:03.969656 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8408a946-ef20-43d2-a9e9-612927b1fac8 None None] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:36:04.074387 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=100 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:36:04.132171 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8408a946-ef20-43d2-a9e9-612927b1fac8 None None] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:36:04.183549 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70688ca0-b8bd-40fd-b8bc-68301837f540 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:36:04.184635 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70688ca0-b8bd-40fd-b8bc-68301837f540 None admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:36:04.185137 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70688ca0-b8bd-40fd-b8bc-68301837f540 None admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:36:04.185611 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70688ca0-b8bd-40fd-b8bc-68301837f540 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:36:04.201010 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70688ca0-b8bd-40fd-b8bc-68301837f540 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 30 00:36:04.206590 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application [None req-70688ca0-b8bd-40fd-b8bc-68301837f540 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 30 00:36:04.206590 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:36:04.206590 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:36:04.206590 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:36:04.206590 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:36:04.206590 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:36:04.206590 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:36:04.206590 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:36:04.206590 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:36:04.206590 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:36:04.206590 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:36:04.206590 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:36:04.206590 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 30 00:36:04.206590 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 30 00:36:04.206590 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 30 00:36:04.206590 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 30 00:36:04.207584 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 30 00:36:04.207584 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 30 00:36:04.207584 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 30 00:36:04.207584 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 30 00:36:04.207584 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:36:04.207584 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:36:04.207584 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:36:04.207584 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:36:04.207584 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:36:04.207584 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:36:04.207584 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:36:04.207584 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application with Lock( Oct 30 00:36:04.207584 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:36:04.207584 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:36:04.207584 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:36:04.207584 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:36:04.208472 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:36:04.208472 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:36:04.208472 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:36:04.208472 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:36:04.208472 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 30 00:36:04.208472 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 30 00:36:04.208472 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 30 00:36:04.208472 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 30 00:36:04.208472 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 30 00:36:04.208472 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 30 00:36:04.208472 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 30 00:36:04.208472 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application Oct 30 00:36:04.215420 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 265/532] 10.222.0.42 () {56 vars in 1096 bytes} [Sun Oct 30 00:36:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:36:04.217512 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba5b351-9023-4bf0-b55d-8b77b432358a None None] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:36:04.220725 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bceddc59-0c92-45ed-a001-4fd2226816c0 None None] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:36:04.220955 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bceddc59-0c92-45ed-a001-4fd2226816c0 None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:36:04.221200 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bceddc59-0c92-45ed-a001-4fd2226816c0 None None] PATH_INFO: `/` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:36:04.222962 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 266/533] 10.222.0.42 () {54 vars in 927 bytes} [Sun Oct 30 00:36:04 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 30 00:36:04.231188 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f4bf53-36e5-40d4-bbd6-442b9297e986 None None] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:36:04.231188 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f4bf53-36e5-40d4-bbd6-442b9297e986 None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:36:04.231188 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f4bf53-36e5-40d4-bbd6-442b9297e986 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:36:04.249791 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.auth.core [None req-28f4bf53-36e5-40d4-bbd6-442b9297e986 None None] MFA Rules not processed for user `eb55b6cbca4945abb21b0e49eb745e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=87956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:36:04.251093 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-28f4bf53-36e5-40d4-bbd6-442b9297e986 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:36:04.371075 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=100 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:36:04.378498 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 267/534] 10.222.0.42 () {58 vars in 1024 bytes} [Sun Oct 30 00:36:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 30 00:36:04.421177 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba5b351-9023-4bf0-b55d-8b77b432358a None None] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:36:04.463514 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd499bf-1847-443d-849c-2bc74c025c60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:36:04.464121 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd499bf-1847-443d-849c-2bc74c025c60 None admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:36:04.464388 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd499bf-1847-443d-849c-2bc74c025c60 None admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:36:04.464654 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd499bf-1847-443d-849c-2bc74c025c60 None admin] PATH_INFO: `/v3/roles` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:36:04.465307 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd499bf-1847-443d-849c-2bc74c025c60 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:36:04.465600 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd499bf-1847-443d-849c-2bc74c025c60 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:36:04.467021 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd499bf-1847-443d-849c-2bc74c025c60 None admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:36:04.475913 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 268/535] 10.222.0.42 () {56 vars in 1099 bytes} [Sun Oct 30 00:36:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:36:04.484346 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f4bf53-36e5-40d4-bbd6-442b9297e986 None None] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:36:04.572338 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=100 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:36:04.625259 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f4bf53-36e5-40d4-bbd6-442b9297e986 None None] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:36:04.636208 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cdace1-51a1-43b4-ba5e-9372331be7a5 None None] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:36:04.636746 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cdace1-51a1-43b4-ba5e-9372331be7a5 None None] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:36:04.636746 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cdace1-51a1-43b4-ba5e-9372331be7a5 None None] PATH_INFO: `/` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:36:04.638505 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 269/536] 10.222.0.42 () {54 vars in 927 bytes} [Sun Oct 30 00:36:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:36:04.643951 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee1dd30-f305-4ba7-851e-47b7333639c6 None None] REQUEST_METHOD: `POST` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:36:04.644239 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee1dd30-f305-4ba7-851e-47b7333639c6 None None] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:36:04.644524 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee1dd30-f305-4ba7-851e-47b7333639c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:36:04.677858 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.auth.core [None req-bee1dd30-f305-4ba7-851e-47b7333639c6 None None] MFA Rules not processed for user `eb55b6cbca4945abb21b0e49eb745e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=87955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:36:04.679547 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-bee1dd30-f305-4ba7-851e-47b7333639c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:36:04.687270 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71af9e93-a4c9-4148-88c9-64a4e80cdb28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:36:04.687958 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71af9e93-a4c9-4148-88c9-64a4e80cdb28 None admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:36:04.688244 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71af9e93-a4c9-4148-88c9-64a4e80cdb28 None admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:36:04.688515 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71af9e93-a4c9-4148-88c9-64a4e80cdb28 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:36:04.712395 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71af9e93-a4c9-4148-88c9-64a4e80cdb28 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:36:04.714034 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71af9e93-a4c9-4148-88c9-64a4e80cdb28 None admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:36:04.736244 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application [None req-71af9e93-a4c9-4148-88c9-64a4e80cdb28 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 30 00:36:04.736244 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:36:04.736244 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:36:04.736244 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:36:04.736244 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:36:04.736244 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:36:04.736244 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:36:04.736244 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:36:04.736244 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:36:04.736244 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:36:04.736244 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:36:04.736244 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:36:04.736244 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 30 00:36:04.736244 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 30 00:36:04.736244 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 30 00:36:04.736244 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 30 00:36:04.737260 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:36:04.737260 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:36:04.737260 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:36:04.737260 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:36:04.737260 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:36:04.737260 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:36:04.737260 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:36:04.737260 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application with Lock( Oct 30 00:36:04.737260 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:36:04.737260 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:36:04.737260 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:36:04.737260 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:36:04.737260 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:36:04.737260 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:36:04.737260 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:36:04.737260 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:36:04.737260 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 30 00:36:04.738283 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 30 00:36:04.738283 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 30 00:36:04.738283 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application Oct 30 00:36:04.738283 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 268/537] 10.222.0.42 () {56 vars in 1108 bytes} [Sun Oct 30 00:36:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:36:04.738514 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71af9e93-a4c9-4148-88c9-64a4e80cdb28 None admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:36:04.764874 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 270/538] 10.222.0.42 () {58 vars in 1024 bytes} [Sun Oct 30 00:36:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 30 00:36:04.771985 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee1dd30-f305-4ba7-851e-47b7333639c6 None None] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:36:04.896479 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=100 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:36:04.908674 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71af9e93-a4c9-4148-88c9-64a4e80cdb28 None admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:36:04.928438 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=100 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:36:04.969734 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee1dd30-f305-4ba7-851e-47b7333639c6 None None] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:36:04.981153 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123a60ca-1551-4d5f-944e-22c55f2c3a46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:36:04.981847 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123a60ca-1551-4d5f-944e-22c55f2c3a46 None admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:36:04.982121 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123a60ca-1551-4d5f-944e-22c55f2c3a46 None admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:36:04.982388 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123a60ca-1551-4d5f-944e-22c55f2c3a46 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:36:04.999454 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123a60ca-1551-4d5f-944e-22c55f2c3a46 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 30 00:36:05.007239 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application [None req-123a60ca-1551-4d5f-944e-22c55f2c3a46 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 30 00:36:05.007239 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:36:05.007239 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:36:05.007239 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:36:05.007239 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:36:05.007239 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:36:05.007239 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:36:05.007239 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:36:05.007239 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:36:05.007239 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:36:05.007239 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:36:05.007239 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:36:05.007239 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 30 00:36:05.007239 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 30 00:36:05.007239 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 30 00:36:05.007239 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 30 00:36:05.008202 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 30 00:36:05.008202 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 30 00:36:05.008202 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 30 00:36:05.008202 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 30 00:36:05.008202 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:36:05.008202 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:36:05.008202 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:36:05.008202 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:36:05.008202 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:36:05.008202 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:36:05.008202 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:36:05.008202 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application with Lock( Oct 30 00:36:05.008202 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:36:05.008202 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:36:05.008202 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:36:05.008202 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:36:05.009030 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:36:05.009030 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:36:05.009030 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:36:05.009030 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:36:05.009030 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 30 00:36:05.009030 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 30 00:36:05.009030 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 30 00:36:05.009030 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 30 00:36:05.009030 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 30 00:36:05.009030 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 30 00:36:05.009030 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 30 00:36:05.009030 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application Oct 30 00:36:05.009030 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 269/539] 10.222.0.42 () {56 vars in 1102 bytes} [Sun Oct 30 00:36:04 2022] GET /identity/v3/roles/service => generated 85 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:36:05.015227 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123a60ca-1551-4d5f-944e-22c55f2c3a46 None admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:36:05.038780 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384c5d0d-dd81-462c-8b66-68999a8fbbf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:36:05.039500 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384c5d0d-dd81-462c-8b66-68999a8fbbf3 None admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:36:05.039777 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384c5d0d-dd81-462c-8b66-68999a8fbbf3 None admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:36:05.040055 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384c5d0d-dd81-462c-8b66-68999a8fbbf3 None admin] PATH_INFO: `/v3/domains` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:36:05.040736 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384c5d0d-dd81-462c-8b66-68999a8fbbf3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:36:05.041041 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384c5d0d-dd81-462c-8b66-68999a8fbbf3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:36:05.042558 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384c5d0d-dd81-462c-8b66-68999a8fbbf3 None admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:36:05.069788 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 271/540] 10.222.0.42 () {56 vars in 1109 bytes} [Sun Oct 30 00:36:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:36:05.071335 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384c5d0d-dd81-462c-8b66-68999a8fbbf3 None admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:36:05.178671 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123a60ca-1551-4d5f-944e-22c55f2c3a46 None admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:36:05.196866 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384c5d0d-dd81-462c-8b66-68999a8fbbf3 None admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:36:05.223081 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=100 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:36:05.224133 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb3fc45-d61b-4003-b067-00a1ec273259 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:36:05.226019 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb3fc45-d61b-4003-b067-00a1ec273259 None admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:36:05.226537 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb3fc45-d61b-4003-b067-00a1ec273259 None admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:36:05.227067 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb3fc45-d61b-4003-b067-00a1ec273259 None admin] PATH_INFO: `/v3/roles` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:36:05.227983 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb3fc45-d61b-4003-b067-00a1ec273259 None admin] RBAC: Adding query filter params (name=service) {{(pid=87956) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:36:05.228628 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb3fc45-d61b-4003-b067-00a1ec273259 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:36:05.231144 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb3fc45-d61b-4003-b067-00a1ec273259 None admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:36:05.240369 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b90f5d4-04d5-4bd5-ba41-717e809c31df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:36:05.241473 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b90f5d4-04d5-4bd5-ba41-717e809c31df None admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:36:05.241824 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b90f5d4-04d5-4bd5-ba41-717e809c31df None admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:36:05.242178 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b90f5d4-04d5-4bd5-ba41-717e809c31df None admin] PATH_INFO: `/v3/users/nova` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:36:05.244188 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 270/541] 10.222.0.42 () {56 vars in 1103 bytes} [Sun Oct 30 00:36:05 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:36:05.245642 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb3fc45-d61b-4003-b067-00a1ec273259 None admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:36:05.252429 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b90f5d4-04d5-4bd5-ba41-717e809c31df None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:36:05.253986 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b90f5d4-04d5-4bd5-ba41-717e809c31df None admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:36:05.268537 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application [None req-1b90f5d4-04d5-4bd5-ba41-717e809c31df None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 30 00:36:05.268537 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:36:05.268537 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:36:05.268537 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:36:05.268537 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:36:05.268537 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:36:05.268537 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:36:05.268537 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:36:05.268537 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:36:05.268537 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:36:05.268537 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:36:05.268537 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:36:05.268537 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 30 00:36:05.268537 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 30 00:36:05.268537 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 30 00:36:05.268537 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 30 00:36:05.269574 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:36:05.269574 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:36:05.269574 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 30 00:36:05.269574 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 30 00:36:05.269574 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 30 00:36:05.269574 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 30 00:36:05.269574 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:36:05.269574 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:36:05.269574 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:36:05.269574 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:36:05.269574 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:36:05.269574 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application with Lock( Oct 30 00:36:05.269574 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:36:05.269574 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:36:05.269574 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:36:05.269574 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:36:05.269574 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:36:05.269574 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:36:05.276210 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:36:05.276210 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:36:05.276210 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 30 00:36:05.276210 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 30 00:36:05.276210 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 30 00:36:05.276210 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 30 00:36:05.276210 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 30 00:36:05.276210 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 30 00:36:05.276210 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 30 00:36:05.276210 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application Oct 30 00:36:05.276210 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 272/542] 10.222.0.42 () {56 vars in 1093 bytes} [Sun Oct 30 00:36:05 2022] GET /identity/v3/users/nova => generated 82 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:36:05.276210 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b90f5d4-04d5-4bd5-ba41-717e809c31df None admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:36:05.294361 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=100 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:36:05.386076 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb3fc45-d61b-4003-b067-00a1ec273259 None admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:36:05.406436 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b90f5d4-04d5-4bd5-ba41-717e809c31df None admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:36:05.422629 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51e3c55-fc7b-41f5-9c32-f67cf7de3712 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:36:05.423715 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51e3c55-fc7b-41f5-9c32-f67cf7de3712 None admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:36:05.424261 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51e3c55-fc7b-41f5-9c32-f67cf7de3712 None admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:36:05.424728 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51e3c55-fc7b-41f5-9c32-f67cf7de3712 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:36:05.436547 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51e3c55-fc7b-41f5-9c32-f67cf7de3712 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 30 00:36:05.440667 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee92547-e06e-4b52-83c0-93224474331f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:36:05.441291 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee92547-e06e-4b52-83c0-93224474331f None admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:36:05.441560 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee92547-e06e-4b52-83c0-93224474331f None admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:36:05.441826 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee92547-e06e-4b52-83c0-93224474331f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:36:05.441998 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application [None req-b51e3c55-fc7b-41f5-9c32-f67cf7de3712 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 30 00:36:05.441998 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:36:05.441998 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:36:05.441998 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:36:05.441998 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:36:05.441998 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:36:05.441998 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:36:05.441998 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:36:05.441998 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:36:05.441998 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:36:05.441998 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:36:05.441998 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:36:05.441998 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 30 00:36:05.441998 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 30 00:36:05.441998 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 30 00:36:05.441998 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 30 00:36:05.442915 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 30 00:36:05.442915 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 30 00:36:05.442915 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 30 00:36:05.442915 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 30 00:36:05.442915 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:36:05.442915 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:36:05.442915 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:36:05.442915 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:36:05.442915 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:36:05.442915 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:36:05.442915 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:36:05.442915 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application with Lock( Oct 30 00:36:05.442915 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:36:05.442915 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:36:05.442915 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:36:05.442915 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:36:05.444151 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:36:05.444151 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:36:05.444151 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:36:05.444151 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:36:05.444151 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 30 00:36:05.444151 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 30 00:36:05.444151 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 30 00:36:05.444151 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 30 00:36:05.444151 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 30 00:36:05.444151 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 30 00:36:05.444151 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 30 00:36:05.444151 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application Oct 30 00:36:05.444151 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 271/543] 10.222.0.42 () {56 vars in 1096 bytes} [Sun Oct 30 00:36:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:36:05.444151 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51e3c55-fc7b-41f5-9c32-f67cf7de3712 None admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:36:05.458909 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee92547-e06e-4b52-83c0-93224474331f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:36:05.460375 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee92547-e06e-4b52-83c0-93224474331f None admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:36:05.474244 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application [None req-0ee92547-e06e-4b52-83c0-93224474331f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 30 00:36:05.474244 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:36:05.474244 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:36:05.474244 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:36:05.474244 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:36:05.474244 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:36:05.474244 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:36:05.474244 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:36:05.474244 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:36:05.474244 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:36:05.474244 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:36:05.474244 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:36:05.474244 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 30 00:36:05.474244 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 30 00:36:05.474244 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 30 00:36:05.474244 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 30 00:36:05.480486 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:36:05.480486 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:36:05.480486 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:36:05.480486 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:36:05.480486 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:36:05.480486 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:36:05.480486 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:36:05.480486 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application with Lock( Oct 30 00:36:05.480486 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:36:05.480486 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:36:05.480486 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:36:05.480486 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:36:05.480486 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:36:05.480486 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:36:05.480486 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:36:05.480486 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:36:05.480486 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 30 00:36:05.481431 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 30 00:36:05.481431 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 30 00:36:05.481431 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application Oct 30 00:36:05.481431 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 273/544] 10.222.0.42 () {56 vars in 1108 bytes} [Sun Oct 30 00:36:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:36:05.481431 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd3b1df-aa5f-4de4-9e73-099e69d079f6 None None] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:36:05.481431 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd3b1df-aa5f-4de4-9e73-099e69d079f6 None None] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:36:05.481431 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd3b1df-aa5f-4de4-9e73-099e69d079f6 None None] PATH_INFO: `/` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:36:05.481431 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 274/545] 10.222.0.42 () {54 vars in 927 bytes} [Sun Oct 30 00:36:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:36:05.481431 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd3b1df-aa5f-4de4-9e73-099e69d079f6 None None] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:36:05.518151 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=100 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:36:05.558873 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=100 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:36:05.570565 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51e3c55-fc7b-41f5-9c32-f67cf7de3712 None admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:36:05.593856 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd3b1df-aa5f-4de4-9e73-099e69d079f6 None None] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:36:05.607778 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a332657-b623-470c-9a22-58b095d338da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:36:05.608527 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a332657-b623-470c-9a22-58b095d338da None admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:36:05.608815 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a332657-b623-470c-9a22-58b095d338da None admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:36:05.609088 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a332657-b623-470c-9a22-58b095d338da None admin] PATH_INFO: `/v3/users` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:36:05.609831 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a332657-b623-470c-9a22-58b095d338da None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=87956) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:36:05.610135 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a332657-b623-470c-9a22-58b095d338da None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:36:05.611846 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a332657-b623-470c-9a22-58b095d338da None admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:36:05.631165 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e162bedb-7d96-4248-87fe-71d06bce0437 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:36:05.631855 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e162bedb-7d96-4248-87fe-71d06bce0437 None admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:36:05.632108 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e162bedb-7d96-4248-87fe-71d06bce0437 None admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:36:05.632393 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e162bedb-7d96-4248-87fe-71d06bce0437 None admin] PATH_INFO: `/v3/roles` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:36:05.633111 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e162bedb-7d96-4248-87fe-71d06bce0437 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:36:05.633406 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e162bedb-7d96-4248-87fe-71d06bce0437 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:36:05.634829 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e162bedb-7d96-4248-87fe-71d06bce0437 None admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:36:05.637245 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 272/546] 10.222.0.42 () {56 vars in 1133 bytes} [Sun Oct 30 00:36:05 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:36:05.638131 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a332657-b623-470c-9a22-58b095d338da None admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:36:05.645058 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 275/547] 10.222.0.42 () {56 vars in 1099 bytes} [Sun Oct 30 00:36:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:36:05.651112 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c5123d-7cd8-4a6d-bb85-25fbab27d868 None None] REQUEST_METHOD: `POST` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:36:05.651433 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c5123d-7cd8-4a6d-bb85-25fbab27d868 None None] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:36:05.651672 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c5123d-7cd8-4a6d-bb85-25fbab27d868 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:36:05.670165 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.auth.core [None req-a1c5123d-7cd8-4a6d-bb85-25fbab27d868 None None] MFA Rules not processed for user `eb55b6cbca4945abb21b0e49eb745e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=87955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:36:05.672117 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-a1c5123d-7cd8-4a6d-bb85-25fbab27d868 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:36:05.738177 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 276/548] 10.222.0.42 () {58 vars in 1024 bytes} [Sun Oct 30 00:36:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 30 00:36:05.739016 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c5123d-7cd8-4a6d-bb85-25fbab27d868 None None] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:36:05.740572 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a332657-b623-470c-9a22-58b095d338da None admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:36:05.765696 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=100 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:36:05.782587 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ef95d4-f7f6-47db-b4c3-e7dc08969eff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:36:05.783300 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ef95d4-f7f6-47db-b4c3-e7dc08969eff None admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:36:05.783519 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ef95d4-f7f6-47db-b4c3-e7dc08969eff None admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:36:05.784159 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ef95d4-f7f6-47db-b4c3-e7dc08969eff None admin] PATH_INFO: `/v3/domains` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:36:05.784850 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ef95d4-f7f6-47db-b4c3-e7dc08969eff None admin] RBAC: Adding query filter params (name=Default) {{(pid=87956) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:36:05.785465 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ef95d4-f7f6-47db-b4c3-e7dc08969eff None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:36:05.786897 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ef95d4-f7f6-47db-b4c3-e7dc08969eff None admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:36:05.799521 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 273/549] 10.222.0.42 () {56 vars in 1109 bytes} [Sun Oct 30 00:36:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:36:05.800320 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ef95d4-f7f6-47db-b4c3-e7dc08969eff None admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:36:05.811570 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=100 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:36:05.851645 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c5123d-7cd8-4a6d-bb85-25fbab27d868 None None] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:36:05.888266 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f817d4e-cb20-4bfe-b87c-c0a587e5f467 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:36:05.889144 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f817d4e-cb20-4bfe-b87c-c0a587e5f467 None admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:36:05.889516 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f817d4e-cb20-4bfe-b87c-c0a587e5f467 None admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:36:05.889816 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f817d4e-cb20-4bfe-b87c-c0a587e5f467 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:36:05.903657 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ef95d4-f7f6-47db-b4c3-e7dc08969eff None admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:36:05.938260 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af91a55-486f-4784-8263-27408f59ba10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:36:05.938994 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af91a55-486f-4784-8263-27408f59ba10 None admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:36:05.939298 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af91a55-486f-4784-8263-27408f59ba10 None admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:36:05.939788 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af91a55-486f-4784-8263-27408f59ba10 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:36:05.950073 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af91a55-486f-4784-8263-27408f59ba10 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:36:05.951585 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af91a55-486f-4784-8263-27408f59ba10 None admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:36:05.963034 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f817d4e-cb20-4bfe-b87c-c0a587e5f467 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:36:05.964542 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f817d4e-cb20-4bfe-b87c-c0a587e5f467 None admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:36:05.966767 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application [None req-1af91a55-486f-4784-8263-27408f59ba10 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 30 00:36:05.966767 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:36:05.966767 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:36:05.966767 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:36:05.966767 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:36:05.966767 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:36:05.966767 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:36:05.966767 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:36:05.966767 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:36:05.966767 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:36:05.966767 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:36:05.966767 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:36:05.966767 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 30 00:36:05.966767 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 30 00:36:05.966767 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 30 00:36:05.966767 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 30 00:36:05.967766 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:36:05.967766 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:36:05.967766 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:36:05.967766 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:36:05.967766 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:36:05.967766 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:36:05.967766 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:36:05.967766 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application with Lock( Oct 30 00:36:05.967766 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:36:05.967766 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:36:05.967766 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:36:05.967766 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:36:05.967766 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:36:05.967766 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:36:05.967766 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:36:05.967766 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:36:05.967766 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 30 00:36:05.968700 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 30 00:36:05.968700 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 30 00:36:05.968700 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application Oct 30 00:36:05.968700 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 274/550] 10.222.0.42 () {56 vars in 1108 bytes} [Sun Oct 30 00:36:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:36:05.969358 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea89cb2-b1aa-4882-99d7-4624b664347c None None] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:36:05.970319 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea89cb2-b1aa-4882-99d7-4624b664347c None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:36:05.970319 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea89cb2-b1aa-4882-99d7-4624b664347c None None] PATH_INFO: `/` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:36:05.975386 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 275/551] 10.222.0.42 () {54 vars in 927 bytes} [Sun Oct 30 00:36:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:36:05.975386 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea89cb2-b1aa-4882-99d7-4624b664347c None None] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:36:05.997513 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=100 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:36:06.036182 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=100 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:36:06.073328 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 277/552] 10.222.0.42 () {58 vars in 1282 bytes} [Sun Oct 30 00:36:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 30 00:36:06.074114 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f817d4e-cb20-4bfe-b87c-c0a587e5f467 None admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:36:06.084880 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea89cb2-b1aa-4882-99d7-4624b664347c None None] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:36:06.118468 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acef388-30db-4c05-814e-bfd1e5d2e687 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:36:06.119108 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acef388-30db-4c05-814e-bfd1e5d2e687 None admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:36:06.119417 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acef388-30db-4c05-814e-bfd1e5d2e687 None admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:36:06.119684 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acef388-30db-4c05-814e-bfd1e5d2e687 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:36:06.128077 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3acef388-30db-4c05-814e-bfd1e5d2e687 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:36:06.129574 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3acef388-30db-4c05-814e-bfd1e5d2e687 None admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:36:06.140675 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application [None req-3acef388-30db-4c05-814e-bfd1e5d2e687 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 30 00:36:06.140675 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:36:06.140675 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:36:06.140675 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:36:06.140675 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:36:06.140675 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:36:06.140675 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:36:06.140675 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:36:06.140675 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:36:06.140675 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:36:06.140675 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:36:06.140675 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:36:06.140675 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 30 00:36:06.140675 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 30 00:36:06.140675 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 30 00:36:06.140675 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 30 00:36:06.141766 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:36:06.141766 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:36:06.141766 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 30 00:36:06.141766 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 30 00:36:06.141766 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 30 00:36:06.141766 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 30 00:36:06.141766 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:36:06.141766 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:36:06.141766 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:36:06.141766 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:36:06.141766 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:36:06.141766 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application with Lock( Oct 30 00:36:06.141766 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:36:06.141766 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:36:06.141766 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:36:06.141766 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:36:06.141766 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:36:06.141766 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:36:06.142723 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:36:06.142723 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:36:06.142723 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 30 00:36:06.142723 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 30 00:36:06.142723 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 30 00:36:06.142723 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 30 00:36:06.142723 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 30 00:36:06.142723 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 30 00:36:06.142723 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 30 00:36:06.142723 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application Oct 30 00:36:06.142723 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 276/553] 10.222.0.42 () {56 vars in 1117 bytes} [Sun Oct 30 00:36:05 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:36:06.143339 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8960e587-ebc1-42cc-ab69-4b9d88dd9038 None None] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:36:06.143339 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8960e587-ebc1-42cc-ab69-4b9d88dd9038 None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:36:06.143339 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8960e587-ebc1-42cc-ab69-4b9d88dd9038 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:36:06.160413 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.auth.core [None req-8960e587-ebc1-42cc-ab69-4b9d88dd9038 None None] MFA Rules not processed for user `eb55b6cbca4945abb21b0e49eb745e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=87956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:36:06.161602 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-8960e587-ebc1-42cc-ab69-4b9d88dd9038 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:36:06.175540 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f817d4e-cb20-4bfe-b87c-c0a587e5f467 None admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:36:06.200271 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=100 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:36:06.209262 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a37cd0-9fd0-4afe-97fa-c90f534a9346 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:36:06.209898 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a37cd0-9fd0-4afe-97fa-c90f534a9346 None admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:36:06.210170 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a37cd0-9fd0-4afe-97fa-c90f534a9346 None admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:36:06.210436 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a37cd0-9fd0-4afe-97fa-c90f534a9346 None admin] PATH_INFO: `/v3/domains` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:36:06.211097 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a37cd0-9fd0-4afe-97fa-c90f534a9346 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:36:06.211423 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a37cd0-9fd0-4afe-97fa-c90f534a9346 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:36:06.212782 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a37cd0-9fd0-4afe-97fa-c90f534a9346 None admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:36:06.224134 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 278/554] 10.222.0.42 () {56 vars in 1109 bytes} [Sun Oct 30 00:36:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:36:06.224931 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a37cd0-9fd0-4afe-97fa-c90f534a9346 None admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:36:06.227522 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 277/555] 10.222.0.42 () {58 vars in 1024 bytes} [Sun Oct 30 00:36:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 30 00:36:06.228377 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8960e587-ebc1-42cc-ab69-4b9d88dd9038 None None] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:36:06.282296 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=100 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:36:06.339497 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a37cd0-9fd0-4afe-97fa-c90f534a9346 None admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:36:06.339829 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8960e587-ebc1-42cc-ab69-4b9d88dd9038 None None] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:36:06.374620 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48337ebf-d008-4808-9b6c-91db8d8bebbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:36:06.375354 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48337ebf-d008-4808-9b6c-91db8d8bebbe None admin] REQUEST_METHOD: `POST` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:36:06.375633 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48337ebf-d008-4808-9b6c-91db8d8bebbe None admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:36:06.375904 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48337ebf-d008-4808-9b6c-91db8d8bebbe None admin] PATH_INFO: `/v3/services` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:36:06.376168 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889956a6-2b94-447d-9075-54b117b6426e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:36:06.376553 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48337ebf-d008-4808-9b6c-91db8d8bebbe None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:36:06.376806 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889956a6-2b94-447d-9075-54b117b6426e None admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:36:06.377084 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889956a6-2b94-447d-9075-54b117b6426e None admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:36:06.377352 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889956a6-2b94-447d-9075-54b117b6426e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:36:06.377910 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48337ebf-d008-4808-9b6c-91db8d8bebbe None admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:36:06.389417 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889956a6-2b94-447d-9075-54b117b6426e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:36:06.390999 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889956a6-2b94-447d-9075-54b117b6426e None admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:36:06.394615 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 279/556] 10.222.0.42 () {60 vars in 1141 bytes} [Sun Oct 30 00:36:06 2022] POST /identity/v3/services => generated 240 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 00:36:06.395486 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48337ebf-d008-4808-9b6c-91db8d8bebbe None admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:36:06.422080 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application [None req-889956a6-2b94-447d-9075-54b117b6426e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 30 00:36:06.422080 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:36:06.422080 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:36:06.422080 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:36:06.422080 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:36:06.422080 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:36:06.422080 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:36:06.422080 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:36:06.422080 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:36:06.422080 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:36:06.422080 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:36:06.422080 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:36:06.422080 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 30 00:36:06.422080 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 30 00:36:06.422080 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 30 00:36:06.422080 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 30 00:36:06.423112 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:36:06.423112 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:36:06.423112 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:36:06.423112 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:36:06.423112 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:36:06.423112 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:36:06.423112 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:36:06.423112 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application with Lock( Oct 30 00:36:06.423112 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:36:06.423112 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:36:06.423112 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:36:06.423112 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:36:06.423112 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:36:06.423112 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:36:06.423112 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:36:06.423112 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:36:06.423112 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 30 00:36:06.424065 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 30 00:36:06.424065 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 30 00:36:06.424065 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application Oct 30 00:36:06.426927 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 278/557] 10.222.0.42 () {56 vars in 1108 bytes} [Sun Oct 30 00:36:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:36:06.428150 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889956a6-2b94-447d-9075-54b117b6426e None admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:36:06.455512 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:36:06.551485 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48337ebf-d008-4808-9b6c-91db8d8bebbe None admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:36:06.562563 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889956a6-2b94-447d-9075-54b117b6426e None admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:36:06.565272 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=100 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:36:06.595523 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815a71b5-aeb4-46c0-93f4-4c823bd1502a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:36:06.596070 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815a71b5-aeb4-46c0-93f4-4c823bd1502a None admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:36:06.596349 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815a71b5-aeb4-46c0-93f4-4c823bd1502a None admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:36:06.596618 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815a71b5-aeb4-46c0-93f4-4c823bd1502a None admin] PATH_INFO: `/v3/users` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:36:06.597357 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815a71b5-aeb4-46c0-93f4-4c823bd1502a None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=87955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:36:06.597661 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815a71b5-aeb4-46c0-93f4-4c823bd1502a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:36:06.599095 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815a71b5-aeb4-46c0-93f4-4c823bd1502a None admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:36:06.609186 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ce0b39-de07-4b69-9219-dd743ec3e1b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:36:06.609853 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ce0b39-de07-4b69-9219-dd743ec3e1b1 None admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:36:06.610137 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ce0b39-de07-4b69-9219-dd743ec3e1b1 None admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:36:06.610400 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ce0b39-de07-4b69-9219-dd743ec3e1b1 None admin] PATH_INFO: `/v3/users/swift` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:36:06.618684 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 280/558] 10.222.0.42 () {56 vars in 1149 bytes} [Sun Oct 30 00:36:06 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:36:06.619908 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815a71b5-aeb4-46c0-93f4-4c823bd1502a None admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:36:06.620546 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ce0b39-de07-4b69-9219-dd743ec3e1b1 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:36:06.622038 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ce0b39-de07-4b69-9219-dd743ec3e1b1 None admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:36:06.634448 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application [None req-94ce0b39-de07-4b69-9219-dd743ec3e1b1 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 30 00:36:06.634448 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:36:06.634448 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:36:06.634448 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:36:06.634448 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:36:06.634448 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:36:06.634448 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:36:06.634448 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:36:06.634448 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:36:06.634448 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:36:06.634448 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:36:06.634448 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:36:06.634448 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 30 00:36:06.634448 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 30 00:36:06.634448 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 30 00:36:06.634448 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 30 00:36:06.635725 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:36:06.635725 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:36:06.635725 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 30 00:36:06.635725 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 30 00:36:06.635725 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 30 00:36:06.635725 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 30 00:36:06.635725 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:36:06.635725 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:36:06.635725 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:36:06.635725 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:36:06.635725 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:36:06.635725 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application with Lock( Oct 30 00:36:06.635725 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:36:06.635725 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:36:06.635725 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:36:06.635725 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:36:06.635725 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:36:06.635725 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:36:06.636711 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:36:06.636711 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:36:06.636711 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 30 00:36:06.636711 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 30 00:36:06.636711 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 30 00:36:06.636711 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 30 00:36:06.636711 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 30 00:36:06.636711 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 30 00:36:06.636711 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 30 00:36:06.636711 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application Oct 30 00:36:06.636711 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 279/559] 10.222.0.42 () {56 vars in 1096 bytes} [Sun Oct 30 00:36:06 2022] GET /identity/v3/users/swift => generated 83 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:36:06.637316 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ce0b39-de07-4b69-9219-dd743ec3e1b1 None admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:36:06.735417 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=100 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:36:06.739069 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815a71b5-aeb4-46c0-93f4-4c823bd1502a None admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:36:06.749899 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ce0b39-de07-4b69-9219-dd743ec3e1b1 None admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:36:06.779452 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d36d763-b4b7-43c5-b422-89b4feb8047e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:36:06.780102 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d36d763-b4b7-43c5-b422-89b4feb8047e None admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:36:06.780388 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d36d763-b4b7-43c5-b422-89b4feb8047e None admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:36:06.780658 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d36d763-b4b7-43c5-b422-89b4feb8047e None admin] PATH_INFO: `/v3/domains` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:36:06.781334 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d36d763-b4b7-43c5-b422-89b4feb8047e None admin] RBAC: Adding query filter params (name=Default) {{(pid=87955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:36:06.781644 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d36d763-b4b7-43c5-b422-89b4feb8047e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:36:06.783098 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d36d763-b4b7-43c5-b422-89b4feb8047e None admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:36:06.789197 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c4aa3c-b93d-41a2-819c-b5f42eeb39b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:36:06.789862 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c4aa3c-b93d-41a2-819c-b5f42eeb39b6 None admin] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:36:06.790759 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c4aa3c-b93d-41a2-819c-b5f42eeb39b6 None admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:36:06.791043 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c4aa3c-b93d-41a2-819c-b5f42eeb39b6 None admin] PATH_INFO: `/v3/services` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:36:06.791853 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c4aa3c-b93d-41a2-819c-b5f42eeb39b6 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:36:06.793845 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c4aa3c-b93d-41a2-819c-b5f42eeb39b6 None admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:36:06.800396 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 281/560] 10.222.0.42 () {56 vars in 1109 bytes} [Sun Oct 30 00:36:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:36:06.800396 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d36d763-b4b7-43c5-b422-89b4feb8047e None admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:36:06.811153 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 280/561] 10.222.0.42 () {60 vars in 1141 bytes} [Sun Oct 30 00:36:06 2022] POST /identity/v3/services => generated 251 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 00:36:06.812128 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c4aa3c-b93d-41a2-819c-b5f42eeb39b6 None admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:36:06.856901 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:36:06.929432 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d36d763-b4b7-43c5-b422-89b4feb8047e None admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:36:06.985649 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c4aa3c-b93d-41a2-819c-b5f42eeb39b6 None admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:36:06.988182 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bce75ba-97a8-44cd-87e2-d1603706679a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:36:06.989265 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bce75ba-97a8-44cd-87e2-d1603706679a None admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:36:06.989547 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bce75ba-97a8-44cd-87e2-d1603706679a None admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:36:06.989981 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bce75ba-97a8-44cd-87e2-d1603706679a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:36:07.005122 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bce75ba-97a8-44cd-87e2-d1603706679a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:36:07.006800 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bce75ba-97a8-44cd-87e2-d1603706679a None admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:36:07.025252 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application [None req-7bce75ba-97a8-44cd-87e2-d1603706679a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 30 00:36:07.025252 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:36:07.025252 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:36:07.025252 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:36:07.025252 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:36:07.025252 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:36:07.025252 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:36:07.025252 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:36:07.025252 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:36:07.025252 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:36:07.025252 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:36:07.025252 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:36:07.025252 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 30 00:36:07.025252 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 30 00:36:07.025252 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 30 00:36:07.025252 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 30 00:36:07.026332 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:36:07.026332 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:36:07.026332 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:36:07.026332 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:36:07.026332 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:36:07.026332 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:36:07.026332 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:36:07.026332 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application with Lock( Oct 30 00:36:07.026332 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:36:07.026332 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:36:07.026332 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:36:07.026332 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:36:07.026332 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:36:07.026332 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:36:07.026332 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:36:07.026332 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:36:07.026332 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 30 00:36:07.027273 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 30 00:36:07.027273 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 30 00:36:07.027273 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application Oct 30 00:36:07.027273 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 282/562] 10.222.0.42 () {56 vars in 1108 bytes} [Sun Oct 30 00:36:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:36:07.032629 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bce75ba-97a8-44cd-87e2-d1603706679a None admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:36:07.036868 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332bc626-4fe7-4ae8-8dc0-f58a235e475d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:36:07.037521 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332bc626-4fe7-4ae8-8dc0-f58a235e475d None admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:36:07.037914 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332bc626-4fe7-4ae8-8dc0-f58a235e475d None admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:36:07.038179 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332bc626-4fe7-4ae8-8dc0-f58a235e475d None admin] PATH_INFO: `/v3/users` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:36:07.038979 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332bc626-4fe7-4ae8-8dc0-f58a235e475d None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=87956) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:36:07.039367 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332bc626-4fe7-4ae8-8dc0-f58a235e475d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:36:07.040480 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=100 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:36:07.041631 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332bc626-4fe7-4ae8-8dc0-f58a235e475d None admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:36:07.067546 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 281/563] 10.222.0.42 () {56 vars in 1135 bytes} [Sun Oct 30 00:36:06 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:36:07.068481 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332bc626-4fe7-4ae8-8dc0-f58a235e475d None admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:36:07.161498 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bce75ba-97a8-44cd-87e2-d1603706679a None admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:36:07.171822 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=100 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:36:07.196952 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332bc626-4fe7-4ae8-8dc0-f58a235e475d None admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:36:07.206109 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded5480a-cc00-4a23-b8a4-ca2c903c53b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:36:07.207349 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded5480a-cc00-4a23-b8a4-ca2c903c53b4 None admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:36:07.207629 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded5480a-cc00-4a23-b8a4-ca2c903c53b4 None admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:36:07.207902 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded5480a-cc00-4a23-b8a4-ca2c903c53b4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:36:07.216748 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded5480a-cc00-4a23-b8a4-ca2c903c53b4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:36:07.218457 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded5480a-cc00-4a23-b8a4-ca2c903c53b4 None admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:36:07.233003 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application [None req-ded5480a-cc00-4a23-b8a4-ca2c903c53b4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 30 00:36:07.233003 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:36:07.233003 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:36:07.233003 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:36:07.233003 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:36:07.233003 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:36:07.233003 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:36:07.233003 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:36:07.233003 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:36:07.233003 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:36:07.233003 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:36:07.233003 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:36:07.233003 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 30 00:36:07.233003 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 30 00:36:07.233003 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 30 00:36:07.233954 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 30 00:36:07.233954 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:36:07.233954 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:36:07.233954 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:36:07.233954 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:36:07.233954 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:36:07.233954 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:36:07.233954 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:36:07.233954 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application with Lock( Oct 30 00:36:07.233954 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:36:07.233954 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:36:07.233954 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:36:07.233954 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:36:07.233954 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:36:07.233954 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:36:07.233954 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:36:07.233954 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:36:07.235501 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 30 00:36:07.235501 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 30 00:36:07.235501 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 30 00:36:07.235501 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 30 00:36:07.235501 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 30 00:36:07.235501 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 30 00:36:07.235501 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 30 00:36:07.235501 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application Oct 30 00:36:07.235501 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 283/564] 10.222.0.42 () {56 vars in 1111 bytes} [Sun Oct 30 00:36:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:36:07.235501 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded5480a-cc00-4a23-b8a4-ca2c903c53b4 None admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:36:07.240139 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0fcf8f-5325-46af-b878-d2b5a0e4e1b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:36:07.241118 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0fcf8f-5325-46af-b878-d2b5a0e4e1b6 None admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:36:07.241631 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0fcf8f-5325-46af-b878-d2b5a0e4e1b6 None admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:36:07.242155 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0fcf8f-5325-46af-b878-d2b5a0e4e1b6 None admin] PATH_INFO: `/v3/domains` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:36:07.243042 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0fcf8f-5325-46af-b878-d2b5a0e4e1b6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87956) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:36:07.243560 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0fcf8f-5325-46af-b878-d2b5a0e4e1b6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:36:07.245162 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0fcf8f-5325-46af-b878-d2b5a0e4e1b6 None admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:36:07.258426 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 282/565] 10.222.0.42 () {56 vars in 1109 bytes} [Sun Oct 30 00:36:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:36:07.259801 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0fcf8f-5325-46af-b878-d2b5a0e4e1b6 None admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:36:07.317886 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=100 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:36:07.363747 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded5480a-cc00-4a23-b8a4-ca2c903c53b4 None admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:36:07.371325 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0fcf8f-5325-46af-b878-d2b5a0e4e1b6 None admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:36:07.410973 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1f10dd-4aad-4957-b6e2-f37a6e1a0d9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:36:07.412557 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1f10dd-4aad-4957-b6e2-f37a6e1a0d9b None admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:36:07.413089 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1f10dd-4aad-4957-b6e2-f37a6e1a0d9b None admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:36:07.413592 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1f10dd-4aad-4957-b6e2-f37a6e1a0d9b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:36:07.416855 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b1e640-44b1-40dd-8afa-3bfeb0b46bda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:36:07.418000 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b1e640-44b1-40dd-8afa-3bfeb0b46bda None admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:36:07.418372 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b1e640-44b1-40dd-8afa-3bfeb0b46bda None admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:36:07.418730 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b1e640-44b1-40dd-8afa-3bfeb0b46bda None admin] PATH_INFO: `/v3/projects` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:36:07.419583 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b1e640-44b1-40dd-8afa-3bfeb0b46bda None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87956) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:36:07.419985 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b1e640-44b1-40dd-8afa-3bfeb0b46bda None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:36:07.427408 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1f10dd-4aad-4957-b6e2-f37a6e1a0d9b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:36:07.429098 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1f10dd-4aad-4957-b6e2-f37a6e1a0d9b None admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:36:07.429665 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b1e640-44b1-40dd-8afa-3bfeb0b46bda None admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:36:07.432789 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=100 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:36:07.444738 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 283/566] 10.222.0.42 () {56 vars in 1148 bytes} [Sun Oct 30 00:36:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:36:07.445926 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b1e640-44b1-40dd-8afa-3bfeb0b46bda None admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:36:07.447180 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application [None req-dd1f10dd-4aad-4957-b6e2-f37a6e1a0d9b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 30 00:36:07.447180 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:36:07.447180 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:36:07.447180 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:36:07.447180 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:36:07.447180 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:36:07.447180 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:36:07.447180 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:36:07.447180 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:36:07.447180 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:36:07.447180 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:36:07.447180 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:36:07.447180 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 30 00:36:07.447180 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 30 00:36:07.447180 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 30 00:36:07.447180 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 30 00:36:07.448330 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:36:07.448330 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:36:07.448330 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:36:07.448330 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:36:07.448330 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:36:07.448330 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:36:07.448330 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:36:07.448330 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application with Lock( Oct 30 00:36:07.448330 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:36:07.448330 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:36:07.448330 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:36:07.448330 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:36:07.448330 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:36:07.448330 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:36:07.448330 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:36:07.448330 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:36:07.448330 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 30 00:36:07.449572 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 30 00:36:07.449572 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 30 00:36:07.449572 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application Oct 30 00:36:07.451632 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 284/567] 10.222.0.42 () {56 vars in 1108 bytes} [Sun Oct 30 00:36:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:36:07.453948 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1f10dd-4aad-4957-b6e2-f37a6e1a0d9b None admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:36:07.551431 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b1e640-44b1-40dd-8afa-3bfeb0b46bda None admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:36:07.571165 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1f10dd-4aad-4957-b6e2-f37a6e1a0d9b None admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:36:07.588140 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd7f6ee-54f8-45cc-9964-bdbcef69d6b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:36:07.589203 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd7f6ee-54f8-45cc-9964-bdbcef69d6b5 None admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:36:07.589203 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd7f6ee-54f8-45cc-9964-bdbcef69d6b5 None admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:36:07.589585 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd7f6ee-54f8-45cc-9964-bdbcef69d6b5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:36:07.596158 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=100 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:36:07.597599 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd7f6ee-54f8-45cc-9964-bdbcef69d6b5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:36:07.599279 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd7f6ee-54f8-45cc-9964-bdbcef69d6b5 None admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:36:07.611601 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application [None req-5cd7f6ee-54f8-45cc-9964-bdbcef69d6b5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 30 00:36:07.611601 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:36:07.611601 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:36:07.611601 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:36:07.611601 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:36:07.611601 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:36:07.611601 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:36:07.611601 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:36:07.611601 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:36:07.611601 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:36:07.611601 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:36:07.611601 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:36:07.611601 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 30 00:36:07.611601 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 30 00:36:07.611601 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 30 00:36:07.612787 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 30 00:36:07.612787 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:36:07.612787 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:36:07.612787 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:36:07.612787 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:36:07.612787 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:36:07.612787 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:36:07.612787 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:36:07.612787 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application with Lock( Oct 30 00:36:07.612787 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:36:07.612787 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:36:07.612787 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:36:07.612787 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:36:07.612787 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:36:07.612787 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:36:07.612787 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:36:07.612787 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:36:07.613920 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 30 00:36:07.613920 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 30 00:36:07.613920 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 30 00:36:07.613920 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 30 00:36:07.613920 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 30 00:36:07.613920 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 30 00:36:07.613920 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 30 00:36:07.613920 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application Oct 30 00:36:07.615594 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 284/568] 10.222.0.42 () {56 vars in 1111 bytes} [Sun Oct 30 00:36:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:36:07.616496 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd7f6ee-54f8-45cc-9964-bdbcef69d6b5 None admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:36:07.617287 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e60b373-561f-4fb4-a5c4-f4357b5132df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:36:07.618100 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e60b373-561f-4fb4-a5c4-f4357b5132df None admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:36:07.618519 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e60b373-561f-4fb4-a5c4-f4357b5132df None admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:36:07.618942 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e60b373-561f-4fb4-a5c4-f4357b5132df None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:36:07.619968 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e60b373-561f-4fb4-a5c4-f4357b5132df None admin] RBAC: Adding query filter params (role.id=6ccaa8c11f29456fb4e4eeccb21616c7, scope.project.id=17d2387fdf794d4eaef07bbcd7b39f2a, user.id=fde877b6ddc74f4a87baf21471eb31d2) {{(pid=87955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:36:07.620434 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e60b373-561f-4fb4-a5c4-f4357b5132df None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:36:07.622036 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e60b373-561f-4fb4-a5c4-f4357b5132df None admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:36:07.629143 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 285/569] 10.222.0.42 () {56 vars in 1374 bytes} [Sun Oct 30 00:36:07 2022] GET /identity/v3/role_assignments?user.id=fde877b6ddc74f4a87baf21471eb31d2&scope.project.id=17d2387fdf794d4eaef07bbcd7b39f2a&role.id=6ccaa8c11f29456fb4e4eeccb21616c7 => generated 608 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:36:07.630260 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e60b373-561f-4fb4-a5c4-f4357b5132df None admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:36:07.696545 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=100 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:36:07.760754 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd7f6ee-54f8-45cc-9964-bdbcef69d6b5 None admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:36:07.761576 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e60b373-561f-4fb4-a5c4-f4357b5132df None admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:36:07.805082 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1955632-7b19-46cd-8270-5fa0fb964294 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:36:07.806184 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1955632-7b19-46cd-8270-5fa0fb964294 None admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:36:07.806704 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1955632-7b19-46cd-8270-5fa0fb964294 None admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:36:07.806983 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178fc368-ddc3-41be-99f2-77f1516abebf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:36:07.807475 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1955632-7b19-46cd-8270-5fa0fb964294 None admin] PATH_INFO: `/v3/projects` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:36:07.807667 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178fc368-ddc3-41be-99f2-77f1516abebf None admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:36:07.807946 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178fc368-ddc3-41be-99f2-77f1516abebf None admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:36:07.808226 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178fc368-ddc3-41be-99f2-77f1516abebf None admin] PATH_INFO: `/v3/domains` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:36:07.808904 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178fc368-ddc3-41be-99f2-77f1516abebf None admin] RBAC: Adding query filter params (name=Default) {{(pid=87956) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:36:07.809203 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178fc368-ddc3-41be-99f2-77f1516abebf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:36:07.809410 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1955632-7b19-46cd-8270-5fa0fb964294 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:36:07.809918 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1955632-7b19-46cd-8270-5fa0fb964294 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:36:07.810681 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178fc368-ddc3-41be-99f2-77f1516abebf None admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:36:07.811902 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1955632-7b19-46cd-8270-5fa0fb964294 None admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:36:07.826923 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 286/570] 10.222.0.42 () {56 vars in 1148 bytes} [Sun Oct 30 00:36:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:36:07.828427 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 285/571] 10.222.0.42 () {56 vars in 1109 bytes} [Sun Oct 30 00:36:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:36:07.833460 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1955632-7b19-46cd-8270-5fa0fb964294 None admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:36:07.842722 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178fc368-ddc3-41be-99f2-77f1516abebf None admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:36:07.940097 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=100 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:36:08.018455 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1955632-7b19-46cd-8270-5fa0fb964294 None admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:36:08.030262 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178fc368-ddc3-41be-99f2-77f1516abebf None admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:36:08.048340 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=100 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:36:08.054561 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155d3b83-ad6c-465c-b090-5805cf3719e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:36:08.055288 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155d3b83-ad6c-465c-b090-5805cf3719e1 None admin] REQUEST_METHOD: `PUT` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:36:08.055578 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155d3b83-ad6c-465c-b090-5805cf3719e1 None admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:36:08.055857 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155d3b83-ad6c-465c-b090-5805cf3719e1 None admin] PATH_INFO: `/v3/projects/17d2387fdf794d4eaef07bbcd7b39f2a/users/3e7b21b55fb84a6cad507a8954492d48/roles/904973500441476eadb9406925a575df` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:36:08.072872 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155d3b83-ad6c-465c-b090-5805cf3719e1 None admin] RBAC: Authorizing `identity:create_grant(project_id=17d2387fdf794d4eaef07bbcd7b39f2a, user_id=3e7b21b55fb84a6cad507a8954492d48, role_id=904973500441476eadb9406925a575df)` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:36:08.074685 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155d3b83-ad6c-465c-b090-5805cf3719e1 None admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:36:08.084516 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e7cf55-7f48-459a-b22b-6625892bcd5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:36:08.085455 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e7cf55-7f48-459a-b22b-6625892bcd5a None admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:36:08.086023 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e7cf55-7f48-459a-b22b-6625892bcd5a None admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:36:08.086462 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e7cf55-7f48-459a-b22b-6625892bcd5a None admin] PATH_INFO: `/v3/projects/service` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:36:08.093139 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 287/572] 10.222.0.42 () {58 vars in 1439 bytes} [Sun Oct 30 00:36:07 2022] PUT /identity/v3/projects/17d2387fdf794d4eaef07bbcd7b39f2a/users/3e7b21b55fb84a6cad507a8954492d48/roles/904973500441476eadb9406925a575df => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 00:36:08.094687 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e7cf55-7f48-459a-b22b-6625892bcd5a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:36:08.096554 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e7cf55-7f48-459a-b22b-6625892bcd5a None admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:36:08.110553 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application [None req-c4e7cf55-7f48-459a-b22b-6625892bcd5a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 30 00:36:08.110553 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:36:08.110553 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:36:08.110553 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:36:08.110553 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:36:08.110553 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:36:08.110553 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:36:08.110553 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:36:08.110553 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:36:08.110553 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:36:08.110553 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:36:08.110553 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:36:08.110553 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 30 00:36:08.110553 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 30 00:36:08.110553 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 30 00:36:08.111634 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 30 00:36:08.111634 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:36:08.111634 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:36:08.111634 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:36:08.111634 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:36:08.111634 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:36:08.111634 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:36:08.111634 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:36:08.111634 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application with Lock( Oct 30 00:36:08.111634 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:36:08.111634 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:36:08.111634 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:36:08.111634 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:36:08.111634 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:36:08.111634 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:36:08.111634 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:36:08.111634 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:36:08.112568 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 30 00:36:08.112568 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 30 00:36:08.112568 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 30 00:36:08.112568 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 30 00:36:08.112568 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 30 00:36:08.112568 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 30 00:36:08.112568 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 30 00:36:08.112568 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application Oct 30 00:36:08.115020 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 286/573] 10.222.0.42 () {56 vars in 1111 bytes} [Sun Oct 30 00:36:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:36:08.121647 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155d3b83-ad6c-465c-b090-5805cf3719e1 None admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:36:08.251640 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:36:08.254141 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155d3b83-ad6c-465c-b090-5805cf3719e1 None admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:36:08.293372 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40792b42-b584-4fd2-8ab1-73247f6846c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:36:08.294003 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40792b42-b584-4fd2-8ab1-73247f6846c6 None admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:36:08.294344 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40792b42-b584-4fd2-8ab1-73247f6846c6 None admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:36:08.294625 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40792b42-b584-4fd2-8ab1-73247f6846c6 None admin] PATH_INFO: `/v3/projects` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:36:08.295446 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40792b42-b584-4fd2-8ab1-73247f6846c6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:36:08.295756 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40792b42-b584-4fd2-8ab1-73247f6846c6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:36:08.297213 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40792b42-b584-4fd2-8ab1-73247f6846c6 None admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:36:08.310686 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 288/574] 10.222.0.42 () {56 vars in 1148 bytes} [Sun Oct 30 00:36:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:36:08.320068 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e7cf55-7f48-459a-b22b-6625892bcd5a None admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:36:08.475166 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e7cf55-7f48-459a-b22b-6625892bcd5a None admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:36:08.530014 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4258ab30-acf7-45b3-bdf4-57063cbf9413 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:36:08.531030 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4258ab30-acf7-45b3-bdf4-57063cbf9413 None admin] REQUEST_METHOD: `PUT` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:36:08.531486 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4258ab30-acf7-45b3-bdf4-57063cbf9413 None admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:36:08.532200 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4258ab30-acf7-45b3-bdf4-57063cbf9413 None admin] PATH_INFO: `/v3/projects/17d2387fdf794d4eaef07bbcd7b39f2a/users/b6d6e884a8104a428e4de6be1cfa467c/roles/6ccaa8c11f29456fb4e4eeccb21616c7` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:36:08.540608 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4258ab30-acf7-45b3-bdf4-57063cbf9413 None admin] RBAC: Authorizing `identity:create_grant(project_id=17d2387fdf794d4eaef07bbcd7b39f2a, user_id=b6d6e884a8104a428e4de6be1cfa467c, role_id=6ccaa8c11f29456fb4e4eeccb21616c7)` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:36:08.542306 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4258ab30-acf7-45b3-bdf4-57063cbf9413 None admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:36:08.559144 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 287/575] 10.222.0.42 () {58 vars in 1439 bytes} [Sun Oct 30 00:36:08 2022] PUT /identity/v3/projects/17d2387fdf794d4eaef07bbcd7b39f2a/users/b6d6e884a8104a428e4de6be1cfa467c/roles/6ccaa8c11f29456fb4e4eeccb21616c7 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 00:36:08.866271 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a062285-aec2-4f94-9ddc-e295cbaf20ce None None] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:36:08.867279 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a062285-aec2-4f94-9ddc-e295cbaf20ce None None] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:36:08.867733 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a062285-aec2-4f94-9ddc-e295cbaf20ce None None] PATH_INFO: `/` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:36:08.869708 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 289/576] 10.222.0.42 () {54 vars in 927 bytes} [Sun Oct 30 00:36:08 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:36:08.875481 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054fc311-6d5d-436a-8b02-8d63a39077b9 None None] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:36:08.875949 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054fc311-6d5d-436a-8b02-8d63a39077b9 None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:36:08.876024 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054fc311-6d5d-436a-8b02-8d63a39077b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:36:08.904747 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.auth.core [None req-054fc311-6d5d-436a-8b02-8d63a39077b9 None None] MFA Rules not processed for user `eb55b6cbca4945abb21b0e49eb745e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=87956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:36:08.906025 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-054fc311-6d5d-436a-8b02-8d63a39077b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:36:08.945787 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:36:09.009398 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 288/577] 10.222.0.42 () {58 vars in 1024 bytes} [Sun Oct 30 00:36:08 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 30 00:36:09.405772 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a062285-aec2-4f94-9ddc-e295cbaf20ce None None] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:36:09.410452 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b923c33-e958-4cf6-b0dc-7eb66307a33c None None] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:36:09.410731 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b923c33-e958-4cf6-b0dc-7eb66307a33c None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:36:09.411002 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b923c33-e958-4cf6-b0dc-7eb66307a33c None None] PATH_INFO: `/` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:36:09.413502 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 289/578] 10.222.0.42 () {54 vars in 927 bytes} [Sun Oct 30 00:36:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 30 00:36:09.423847 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed9dd54-63e1-402e-b2ca-35df046dd870 None None] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:36:09.424428 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed9dd54-63e1-402e-b2ca-35df046dd870 None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:36:09.424945 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed9dd54-63e1-402e-b2ca-35df046dd870 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:36:09.457817 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.auth.core [None req-6ed9dd54-63e1-402e-b2ca-35df046dd870 None None] MFA Rules not processed for user `eb55b6cbca4945abb21b0e49eb745e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=87956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:36:09.459001 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-6ed9dd54-63e1-402e-b2ca-35df046dd870 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:36:09.574011 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a062285-aec2-4f94-9ddc-e295cbaf20ce None None] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:36:09.577901 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 290/579] 10.222.0.42 () {58 vars in 1024 bytes} [Sun Oct 30 00:36:09 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 30 00:36:09.630305 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769c340d-a410-4894-b004-d118742450a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:36:09.630943 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769c340d-a410-4894-b004-d118742450a0 None admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:36:09.631238 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769c340d-a410-4894-b004-d118742450a0 None admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:36:09.631514 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769c340d-a410-4894-b004-d118742450a0 None admin] PATH_INFO: `/v3/services/network` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:36:09.632096 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769c340d-a410-4894-b004-d118742450a0 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:36:09.633513 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769c340d-a410-4894-b004-d118742450a0 None admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:36:09.646497 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application [None req-769c340d-a410-4894-b004-d118742450a0 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Oct 30 00:36:09.646497 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:36:09.646497 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 30 00:36:09.646497 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 30 00:36:09.646497 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 30 00:36:09.646497 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 30 00:36:09.646497 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 30 00:36:09.646497 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 30 00:36:09.646497 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 30 00:36:09.646497 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application Oct 30 00:36:09.646497 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 30 00:36:09.646497 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application Oct 30 00:36:09.646497 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:36:09.646497 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:36:09.646497 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:36:09.646497 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:36:09.646497 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:36:09.647636 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:36:09.647636 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:36:09.647636 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:36:09.647636 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:36:09.647636 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:36:09.647636 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:36:09.647636 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 30 00:36:09.647636 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 30 00:36:09.647636 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 30 00:36:09.647636 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 30 00:36:09.647636 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:36:09.647636 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:36:09.647636 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:36:09.647636 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:36:09.647636 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:36:09.647636 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:36:09.648634 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:36:09.648634 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application with Lock( Oct 30 00:36:09.648634 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:36:09.648634 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:36:09.648634 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:36:09.648634 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:36:09.648634 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:36:09.648634 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:36:09.648634 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:36:09.648634 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:36:09.648634 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 30 00:36:09.648634 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 30 00:36:09.648634 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 30 00:36:09.648634 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application Oct 30 00:36:09.648634 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 290/580] 10.222.0.42 () {56 vars in 1111 bytes} [Sun Oct 30 00:36:09 2022] GET /identity/v3/services/network => generated 88 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:36:09.654061 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed9dd54-63e1-402e-b2ca-35df046dd870 None None] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:36:09.788527 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=100 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:36:09.794316 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed9dd54-63e1-402e-b2ca-35df046dd870 None None] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:36:09.828619 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d096b2d-7a5d-48c2-a173-5eb6a72afabf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:36:09.829228 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d096b2d-7a5d-48c2-a173-5eb6a72afabf None admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:36:09.829503 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d096b2d-7a5d-48c2-a173-5eb6a72afabf None admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:36:09.829766 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d096b2d-7a5d-48c2-a173-5eb6a72afabf None admin] PATH_INFO: `/v3/services` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:36:09.830389 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d096b2d-7a5d-48c2-a173-5eb6a72afabf None admin] RBAC: Adding query filter params (name=network) {{(pid=87956) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:36:09.830681 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d096b2d-7a5d-48c2-a173-5eb6a72afabf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:36:09.832170 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d096b2d-7a5d-48c2-a173-5eb6a72afabf None admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:36:09.836953 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 291/581] 10.222.0.42 () {56 vars in 1112 bytes} [Sun Oct 30 00:36:09 2022] GET /identity/v3/services?name=network => generated 124 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:36:09.842427 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769c340d-a410-4894-b004-d118742450a0 None admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:36:09.872330 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=100 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:36:09.972450 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769c340d-a410-4894-b004-d118742450a0 None admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:36:10.002750 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d096b2d-7a5d-48c2-a173-5eb6a72afabf None admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:36:10.008749 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c762f3-55eb-4a13-a54c-a4e88c559663 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:36:10.009369 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c762f3-55eb-4a13-a54c-a4e88c559663 None admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:36:10.009646 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c762f3-55eb-4a13-a54c-a4e88c559663 None admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:36:10.009920 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c762f3-55eb-4a13-a54c-a4e88c559663 None admin] PATH_INFO: `/v3/services` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:36:10.010565 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c762f3-55eb-4a13-a54c-a4e88c559663 None admin] RBAC: Adding query filter params (type=network) {{(pid=87955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:36:10.010864 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c762f3-55eb-4a13-a54c-a4e88c559663 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:36:10.012278 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c762f3-55eb-4a13-a54c-a4e88c559663 None admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:36:10.023223 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 291/582] 10.222.0.42 () {56 vars in 1112 bytes} [Sun Oct 30 00:36:09 2022] GET /identity/v3/services?type=network => generated 350 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:36:10.025627 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c762f3-55eb-4a13-a54c-a4e88c559663 None admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:36:10.115600 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=100 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:36:10.134332 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c762f3-55eb-4a13-a54c-a4e88c559663 None admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:36:10.169957 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dac6d65-5e8f-4195-8d4c-747cbbe3b040 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:36:10.170570 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dac6d65-5e8f-4195-8d4c-747cbbe3b040 None admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:36:10.170852 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dac6d65-5e8f-4195-8d4c-747cbbe3b040 None admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:36:10.171124 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dac6d65-5e8f-4195-8d4c-747cbbe3b040 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:36:10.171863 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dac6d65-5e8f-4195-8d4c-747cbbe3b040 None admin] RBAC: Adding query filter params (interface=public, service_id=9584bb28ae614039a4ecd7e89f16bd00, region_id=RegionOne) {{(pid=87955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:36:10.172171 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dac6d65-5e8f-4195-8d4c-747cbbe3b040 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:36:10.173536 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dac6d65-5e8f-4195-8d4c-747cbbe3b040 None admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:36:10.181612 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 292/583] 10.222.0.42 () {56 vars in 1251 bytes} [Sun Oct 30 00:36:10 2022] GET /identity/v3/endpoints?service_id=9584bb28ae614039a4ecd7e89f16bd00&interface=public®ion_id=RegionOne => generated 194 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:36:10.187377 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dac6d65-5e8f-4195-8d4c-747cbbe3b040 None admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:36:10.228529 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d096b2d-7a5d-48c2-a173-5eb6a72afabf None admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:36:10.267282 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2803cee6-162b-4b42-b79c-a19fed9ec512 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:36:10.268773 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2803cee6-162b-4b42-b79c-a19fed9ec512 None admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:36:10.269063 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2803cee6-162b-4b42-b79c-a19fed9ec512 None admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:36:10.269337 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2803cee6-162b-4b42-b79c-a19fed9ec512 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:36:10.269933 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2803cee6-162b-4b42-b79c-a19fed9ec512 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:36:10.271360 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2803cee6-162b-4b42-b79c-a19fed9ec512 None admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:36:10.281691 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application [None req-2803cee6-162b-4b42-b79c-a19fed9ec512 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 30 00:36:10.281691 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:36:10.281691 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 30 00:36:10.281691 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 30 00:36:10.281691 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 30 00:36:10.281691 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 30 00:36:10.281691 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 30 00:36:10.281691 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 30 00:36:10.281691 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 30 00:36:10.281691 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application Oct 30 00:36:10.281691 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 30 00:36:10.281691 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application Oct 30 00:36:10.281691 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:36:10.281691 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:36:10.281691 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:36:10.281691 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:36:10.281691 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:36:10.282744 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:36:10.282744 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:36:10.282744 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:36:10.282744 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:36:10.282744 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:36:10.282744 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:36:10.282744 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 30 00:36:10.282744 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 30 00:36:10.282744 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 30 00:36:10.282744 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 30 00:36:10.282744 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:36:10.282744 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:36:10.282744 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:36:10.282744 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:36:10.282744 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:36:10.282744 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:36:10.283684 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:36:10.283684 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application with Lock( Oct 30 00:36:10.283684 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:36:10.283684 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:36:10.283684 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:36:10.283684 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:36:10.283684 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:36:10.283684 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:36:10.283684 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:36:10.283684 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:36:10.283684 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 30 00:36:10.283684 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 30 00:36:10.283684 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 30 00:36:10.283684 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application Oct 30 00:36:10.283684 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 292/584] 10.222.0.42 () {56 vars in 1129 bytes} [Sun Oct 30 00:36:10 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:36:10.288803 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2803cee6-162b-4b42-b79c-a19fed9ec512 None admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:36:10.328965 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=100 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:36:10.350751 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dac6d65-5e8f-4195-8d4c-747cbbe3b040 None admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:36:10.386418 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f298f99f-ddf4-448d-9748-00cd34a05636 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:36:10.387022 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f298f99f-ddf4-448d-9748-00cd34a05636 None admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:36:10.387322 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f298f99f-ddf4-448d-9748-00cd34a05636 None admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:36:10.387592 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f298f99f-ddf4-448d-9748-00cd34a05636 None admin] PATH_INFO: `/v3/services` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:36:10.388289 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f298f99f-ddf4-448d-9748-00cd34a05636 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:36:10.389704 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f298f99f-ddf4-448d-9748-00cd34a05636 None admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:36:10.395094 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 293/585] 10.222.0.42 () {56 vars in 1087 bytes} [Sun Oct 30 00:36:10 2022] GET /identity/v3/services => generated 772 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:36:10.459701 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2803cee6-162b-4b42-b79c-a19fed9ec512 None admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:36:10.517714 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45a40f8-2bea-4ce3-be7d-39b0b829e100 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:36:10.518344 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45a40f8-2bea-4ce3-be7d-39b0b829e100 None admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:36:10.518618 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45a40f8-2bea-4ce3-be7d-39b0b829e100 None admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:36:10.518886 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45a40f8-2bea-4ce3-be7d-39b0b829e100 None admin] PATH_INFO: `/v3/services` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:36:10.519555 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45a40f8-2bea-4ce3-be7d-39b0b829e100 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=87956) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:36:10.519855 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45a40f8-2bea-4ce3-be7d-39b0b829e100 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:36:10.521231 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45a40f8-2bea-4ce3-be7d-39b0b829e100 None admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:36:10.531330 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 293/586] 10.222.0.42 () {56 vars in 1124 bytes} [Sun Oct 30 00:36:10 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 30 00:36:10.533093 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f298f99f-ddf4-448d-9748-00cd34a05636 None admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:36:10.561796 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=100 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:36:10.638802 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af267ea9-c7b7-4780-af03-b970f90afb83 None None] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:36:10.638994 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af267ea9-c7b7-4780-af03-b970f90afb83 None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:36:10.639316 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af267ea9-c7b7-4780-af03-b970f90afb83 None None] PATH_INFO: `/` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:36:10.642108 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 294/587] 10.222.0.42 () {54 vars in 927 bytes} [Sun Oct 30 00:36:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:36:10.646344 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42e269c-716e-4250-86fb-44314b9e72d7 None None] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:36:10.646621 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42e269c-716e-4250-86fb-44314b9e72d7 None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:36:10.646893 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42e269c-716e-4250-86fb-44314b9e72d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:36:10.670753 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.auth.core [None req-f42e269c-716e-4250-86fb-44314b9e72d7 None None] MFA Rules not processed for user `eb55b6cbca4945abb21b0e49eb745e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=87956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:36:10.671965 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-f42e269c-716e-4250-86fb-44314b9e72d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:36:10.681064 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f298f99f-ddf4-448d-9748-00cd34a05636 None admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:36:10.724901 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e1ddd6-e2bf-423c-ada7-5812628785ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:36:10.725503 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e1ddd6-e2bf-423c-ada7-5812628785ed None admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:36:10.725773 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e1ddd6-e2bf-423c-ada7-5812628785ed None admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:36:10.726086 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e1ddd6-e2bf-423c-ada7-5812628785ed None admin] PATH_INFO: `/v3/services` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:36:10.726721 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e1ddd6-e2bf-423c-ada7-5812628785ed None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=87955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:36:10.727015 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e1ddd6-e2bf-423c-ada7-5812628785ed None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:36:10.728464 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e1ddd6-e2bf-423c-ada7-5812628785ed None admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:36:10.737437 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 294/588] 10.222.0.42 () {56 vars in 1124 bytes} [Sun Oct 30 00:36:10 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:36:10.744337 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e1ddd6-e2bf-423c-ada7-5812628785ed None admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:36:10.799553 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 295/589] 10.222.0.42 () {58 vars in 1024 bytes} [Sun Oct 30 00:36:10 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 30 00:36:10.847983 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=100 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:36:10.883232 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e1ddd6-e2bf-423c-ada7-5812628785ed None admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:36:10.928012 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57840fb-4bd3-4d9e-b9dc-c04f17c49b18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:36:10.928532 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57840fb-4bd3-4d9e-b9dc-c04f17c49b18 None admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:36:10.928806 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57840fb-4bd3-4d9e-b9dc-c04f17c49b18 None admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:36:10.929070 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57840fb-4bd3-4d9e-b9dc-c04f17c49b18 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:36:10.929821 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57840fb-4bd3-4d9e-b9dc-c04f17c49b18 None admin] RBAC: Adding query filter params (interface=public, service_id=03d72455bcd6484a8e43d2f8e938ae97, region_id=RegionOne) {{(pid=87955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:36:10.930121 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57840fb-4bd3-4d9e-b9dc-c04f17c49b18 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:36:10.931485 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57840fb-4bd3-4d9e-b9dc-c04f17c49b18 None admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:36:10.939609 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 295/590] 10.222.0.42 () {56 vars in 1251 bytes} [Sun Oct 30 00:36:10 2022] GET /identity/v3/endpoints?service_id=03d72455bcd6484a8e43d2f8e938ae97&interface=public®ion_id=RegionOne => generated 194 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 30 00:36:10.945194 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42e269c-716e-4250-86fb-44314b9e72d7 None None] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:36:10.976070 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=100 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:36:11.077481 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42e269c-716e-4250-86fb-44314b9e72d7 None None] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:36:11.111607 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7151ba17-0a63-49ad-b40c-e10f3bda1366 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:36:11.112216 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7151ba17-0a63-49ad-b40c-e10f3bda1366 None admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:36:11.112488 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7151ba17-0a63-49ad-b40c-e10f3bda1366 None admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:36:11.112752 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7151ba17-0a63-49ad-b40c-e10f3bda1366 None admin] PATH_INFO: `/v3/services` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:36:11.113351 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7151ba17-0a63-49ad-b40c-e10f3bda1366 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:36:11.114705 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7151ba17-0a63-49ad-b40c-e10f3bda1366 None admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:36:11.120448 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 296/591] 10.222.0.42 () {56 vars in 1087 bytes} [Sun Oct 30 00:36:10 2022] GET /identity/v3/services => generated 772 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:36:11.151246 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f985379c-0127-4224-9710-11730a552033 None None] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:36:11.151861 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f985379c-0127-4224-9710-11730a552033 None None] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:36:11.152322 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f985379c-0127-4224-9710-11730a552033 None None] PATH_INFO: `/` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:36:11.154206 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 296/592] 10.222.0.42 () {54 vars in 927 bytes} [Sun Oct 30 00:36:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:36:11.160398 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1301f1a3-75dc-4420-9fe8-5de8c02f13a5 None None] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:36:11.160978 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1301f1a3-75dc-4420-9fe8-5de8c02f13a5 None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:36:11.161420 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1301f1a3-75dc-4420-9fe8-5de8c02f13a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:36:11.171647 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f985379c-0127-4224-9710-11730a552033 None None] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:36:11.196474 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.auth.core [None req-1301f1a3-75dc-4420-9fe8-5de8c02f13a5 None None] MFA Rules not processed for user `eb55b6cbca4945abb21b0e49eb745e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=87956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:36:11.197965 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-1301f1a3-75dc-4420-9fe8-5de8c02f13a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:36:11.311809 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 297/593] 10.222.0.42 () {58 vars in 1024 bytes} [Sun Oct 30 00:36:11 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 30 00:36:11.319459 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5415b10f-84be-43fa-9759-ee2f966ec52b None None] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:36:11.319459 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5415b10f-84be-43fa-9759-ee2f966ec52b None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:36:11.319459 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5415b10f-84be-43fa-9759-ee2f966ec52b None None] PATH_INFO: `/` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:36:11.319459 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 298/594] 10.222.0.42 () {54 vars in 927 bytes} [Sun Oct 30 00:36:11 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:36:11.324869 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b9b508-dca9-4ebe-b8ea-f38dcf29eec2 None None] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:36:11.325164 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b9b508-dca9-4ebe-b8ea-f38dcf29eec2 None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:36:11.325415 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b9b508-dca9-4ebe-b8ea-f38dcf29eec2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:36:11.342191 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f985379c-0127-4224-9710-11730a552033 None None] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:36:11.346022 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.auth.core [None req-43b9b508-dca9-4ebe-b8ea-f38dcf29eec2 None None] MFA Rules not processed for user `eb55b6cbca4945abb21b0e49eb745e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=87956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:36:11.346664 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-43b9b508-dca9-4ebe-b8ea-f38dcf29eec2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:36:11.355080 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=100 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:36:11.383007 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6e53f0-3e05-4155-9ef9-f97d748121da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:36:11.383698 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6e53f0-3e05-4155-9ef9-f97d748121da None admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:36:11.383966 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6e53f0-3e05-4155-9ef9-f97d748121da None admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:36:11.384231 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6e53f0-3e05-4155-9ef9-f97d748121da None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:36:11.384802 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6e53f0-3e05-4155-9ef9-f97d748121da None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:36:11.386150 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6e53f0-3e05-4155-9ef9-f97d748121da None admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:36:11.395965 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application [None req-bf6e53f0-3e05-4155-9ef9-f97d748121da None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 30 00:36:11.395965 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:36:11.395965 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 30 00:36:11.395965 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 30 00:36:11.395965 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 30 00:36:11.395965 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 30 00:36:11.395965 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 30 00:36:11.395965 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 30 00:36:11.395965 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 30 00:36:11.395965 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application Oct 30 00:36:11.395965 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 30 00:36:11.395965 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application Oct 30 00:36:11.395965 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:36:11.395965 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:36:11.395965 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:36:11.395965 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:36:11.397264 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:36:11.397264 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:36:11.397264 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:36:11.397264 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:36:11.397264 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:36:11.397264 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:36:11.397264 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:36:11.397264 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 30 00:36:11.397264 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 30 00:36:11.397264 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 30 00:36:11.397264 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 30 00:36:11.397264 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:36:11.397264 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:36:11.397264 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:36:11.397264 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:36:11.397264 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:36:11.397264 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:36:11.398618 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:36:11.398618 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application with Lock( Oct 30 00:36:11.398618 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:36:11.398618 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:36:11.398618 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:36:11.398618 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:36:11.398618 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:36:11.398618 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:36:11.398618 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:36:11.398618 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:36:11.398618 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 30 00:36:11.398618 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 30 00:36:11.398618 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 30 00:36:11.398618 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application Oct 30 00:36:11.398618 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 297/595] 10.222.0.42 () {56 vars in 1132 bytes} [Sun Oct 30 00:36:11 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 30 00:36:11.404021 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6e53f0-3e05-4155-9ef9-f97d748121da None admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:36:11.408416 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=100 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:36:11.438190 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 299/596] 10.222.0.42 () {58 vars in 1024 bytes} [Sun Oct 30 00:36:11 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 30 00:36:11.524485 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6e53f0-3e05-4155-9ef9-f97d748121da None admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:36:11.559428 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e315fd95-6387-4f24-a7dd-5779dad9a74b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:36:11.560792 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e315fd95-6387-4f24-a7dd-5779dad9a74b None admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:36:11.560792 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e315fd95-6387-4f24-a7dd-5779dad9a74b None admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:36:11.560792 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e315fd95-6387-4f24-a7dd-5779dad9a74b None admin] PATH_INFO: `/v3/services` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:36:11.561267 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e315fd95-6387-4f24-a7dd-5779dad9a74b None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=87955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:36:11.561480 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e315fd95-6387-4f24-a7dd-5779dad9a74b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:36:11.563002 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e315fd95-6387-4f24-a7dd-5779dad9a74b None admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:36:11.568425 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 298/597] 10.222.0.42 () {56 vars in 1126 bytes} [Sun Oct 30 00:36:11 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:36:11.574093 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b9b508-dca9-4ebe-b8ea-f38dcf29eec2 None None] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:36:11.703140 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b9b508-dca9-4ebe-b8ea-f38dcf29eec2 None None] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:36:11.740756 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e315fd95-6387-4f24-a7dd-5779dad9a74b None admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:36:11.742390 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9a404b-614e-4a9a-973a-ea5be3bc8ef5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:36:11.743340 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9a404b-614e-4a9a-973a-ea5be3bc8ef5 None admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:36:11.744106 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9a404b-614e-4a9a-973a-ea5be3bc8ef5 None admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:36:11.745530 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9a404b-614e-4a9a-973a-ea5be3bc8ef5 None admin] PATH_INFO: `/v3/services` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:36:11.746376 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9a404b-614e-4a9a-973a-ea5be3bc8ef5 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=87956) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:36:11.746863 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9a404b-614e-4a9a-973a-ea5be3bc8ef5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:36:11.748567 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9a404b-614e-4a9a-973a-ea5be3bc8ef5 None admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:36:11.765852 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 300/598] 10.222.0.42 () {56 vars in 1126 bytes} [Sun Oct 30 00:36:11 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:36:11.784081 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9a404b-614e-4a9a-973a-ea5be3bc8ef5 None admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:36:11.793885 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=100 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:36:11.830246 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=100 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:36:11.871327 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e315fd95-6387-4f24-a7dd-5779dad9a74b None admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:36:11.910868 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5addc9c7-16da-47cd-a2b6-cdf9ed0539c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:36:11.912636 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5addc9c7-16da-47cd-a2b6-cdf9ed0539c8 None admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:36:11.913128 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5addc9c7-16da-47cd-a2b6-cdf9ed0539c8 None admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:36:11.913701 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5addc9c7-16da-47cd-a2b6-cdf9ed0539c8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:36:11.941199 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5addc9c7-16da-47cd-a2b6-cdf9ed0539c8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 30 00:36:11.946374 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application [None req-5addc9c7-16da-47cd-a2b6-cdf9ed0539c8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 30 00:36:11.946374 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:36:11.946374 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:36:11.946374 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:36:11.946374 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:36:11.946374 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:36:11.946374 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:36:11.946374 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:36:11.946374 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:36:11.946374 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:36:11.946374 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:36:11.946374 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:36:11.946374 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 30 00:36:11.946374 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 30 00:36:11.946374 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 30 00:36:11.946374 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 30 00:36:11.947377 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 30 00:36:11.947377 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 30 00:36:11.947377 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 30 00:36:11.947377 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 30 00:36:11.947377 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:36:11.947377 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:36:11.947377 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:36:11.947377 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:36:11.947377 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:36:11.947377 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:36:11.947377 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:36:11.947377 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application with Lock( Oct 30 00:36:11.947377 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:36:11.947377 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:36:11.947377 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:36:11.947377 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:36:11.948308 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:36:11.948308 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:36:11.948308 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:36:11.948308 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:36:11.948308 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 30 00:36:11.948308 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 30 00:36:11.948308 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 30 00:36:11.948308 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 30 00:36:11.948308 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 30 00:36:11.948308 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 30 00:36:11.948308 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 30 00:36:11.948308 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application Oct 30 00:36:11.952776 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 299/599] 10.222.0.42 () {56 vars in 1096 bytes} [Sun Oct 30 00:36:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 30 00:36:11.953646 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5addc9c7-16da-47cd-a2b6-cdf9ed0539c8 None admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:36:11.975702 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9a404b-614e-4a9a-973a-ea5be3bc8ef5 None admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:36:12.022274 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc332901-3557-4a56-b4b0-e0d384b52574 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:36:12.022936 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc332901-3557-4a56-b4b0-e0d384b52574 None admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:36:12.023221 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc332901-3557-4a56-b4b0-e0d384b52574 None admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:36:12.023501 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc332901-3557-4a56-b4b0-e0d384b52574 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:36:12.034719 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc332901-3557-4a56-b4b0-e0d384b52574 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 30 00:36:12.040646 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application [None req-fc332901-3557-4a56-b4b0-e0d384b52574 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 30 00:36:12.040646 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:36:12.040646 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:36:12.040646 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:36:12.040646 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:36:12.040646 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:36:12.040646 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:36:12.040646 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:36:12.040646 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:36:12.040646 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:36:12.040646 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:36:12.040646 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:36:12.040646 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 30 00:36:12.040646 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 30 00:36:12.040646 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 30 00:36:12.040646 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 30 00:36:12.041575 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 30 00:36:12.041575 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 30 00:36:12.041575 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 30 00:36:12.041575 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 30 00:36:12.041575 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:36:12.041575 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:36:12.041575 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:36:12.041575 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:36:12.041575 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:36:12.041575 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:36:12.041575 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:36:12.041575 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application with Lock( Oct 30 00:36:12.041575 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:36:12.041575 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:36:12.041575 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:36:12.041575 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:36:12.042419 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:36:12.042419 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:36:12.042419 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:36:12.042419 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:36:12.042419 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 30 00:36:12.042419 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 30 00:36:12.042419 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 30 00:36:12.042419 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 30 00:36:12.042419 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 30 00:36:12.042419 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 30 00:36:12.042419 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 30 00:36:12.042419 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application Oct 30 00:36:12.042419 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 301/600] 10.222.0.42 () {56 vars in 1102 bytes} [Sun Oct 30 00:36:11 2022] GET /identity/v3/roles/service => generated 85 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 30 00:36:12.050987 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc332901-3557-4a56-b4b0-e0d384b52574 None admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:36:12.097206 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5addc9c7-16da-47cd-a2b6-cdf9ed0539c8 None admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:36:12.122307 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=100 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:36:12.127449 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=100 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:36:12.143233 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f0344e-c6b3-4fca-a27f-1c2b42d611d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:36:12.144134 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f0344e-c6b3-4fca-a27f-1c2b42d611d6 None admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:36:12.144410 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f0344e-c6b3-4fca-a27f-1c2b42d611d6 None admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:36:12.144682 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f0344e-c6b3-4fca-a27f-1c2b42d611d6 None admin] PATH_INFO: `/v3/roles` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:36:12.145450 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f0344e-c6b3-4fca-a27f-1c2b42d611d6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:36:12.145755 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f0344e-c6b3-4fca-a27f-1c2b42d611d6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:36:12.147251 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f0344e-c6b3-4fca-a27f-1c2b42d611d6 None admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:36:12.157896 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 300/601] 10.222.0.42 () {56 vars in 1099 bytes} [Sun Oct 30 00:36:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:36:12.163709 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f0344e-c6b3-4fca-a27f-1c2b42d611d6 None admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:36:12.181047 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc332901-3557-4a56-b4b0-e0d384b52574 None admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:36:12.249645 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42af0b9-ca0c-49af-ba10-d4bc85764530 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:36:12.250318 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42af0b9-ca0c-49af-ba10-d4bc85764530 None admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:36:12.250601 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42af0b9-ca0c-49af-ba10-d4bc85764530 None admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:36:12.250876 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42af0b9-ca0c-49af-ba10-d4bc85764530 None admin] PATH_INFO: `/v3/roles` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:36:12.251584 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42af0b9-ca0c-49af-ba10-d4bc85764530 None admin] RBAC: Adding query filter params (name=service) {{(pid=87956) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:36:12.251891 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42af0b9-ca0c-49af-ba10-d4bc85764530 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:36:12.253327 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42af0b9-ca0c-49af-ba10-d4bc85764530 None admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:36:12.269211 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 302/602] 10.222.0.42 () {56 vars in 1103 bytes} [Sun Oct 30 00:36:12 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:36:12.272737 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f0344e-c6b3-4fca-a27f-1c2b42d611d6 None admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:36:12.275901 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42af0b9-ca0c-49af-ba10-d4bc85764530 None admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:36:12.340121 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e28a84-aae8-4bae-b27b-80c5477215f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:36:12.340777 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e28a84-aae8-4bae-b27b-80c5477215f8 None admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:36:12.341871 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e28a84-aae8-4bae-b27b-80c5477215f8 None admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:36:12.341871 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e28a84-aae8-4bae-b27b-80c5477215f8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:36:12.355223 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e28a84-aae8-4bae-b27b-80c5477215f8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:36:12.355223 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e28a84-aae8-4bae-b27b-80c5477215f8 None admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:36:12.370688 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application [None req-c5e28a84-aae8-4bae-b27b-80c5477215f8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 30 00:36:12.370688 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:36:12.370688 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:36:12.370688 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:36:12.370688 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:36:12.370688 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:36:12.370688 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:36:12.370688 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:36:12.370688 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:36:12.370688 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:36:12.370688 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:36:12.370688 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:36:12.370688 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 30 00:36:12.370688 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 30 00:36:12.370688 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 30 00:36:12.370688 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 30 00:36:12.371736 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:36:12.371736 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:36:12.371736 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:36:12.371736 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:36:12.371736 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:36:12.371736 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:36:12.371736 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:36:12.371736 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application with Lock( Oct 30 00:36:12.371736 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:36:12.371736 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:36:12.371736 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:36:12.371736 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:36:12.371736 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:36:12.371736 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:36:12.371736 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:36:12.371736 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:36:12.371736 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 30 00:36:12.372635 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 30 00:36:12.372635 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 30 00:36:12.372635 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application Oct 30 00:36:12.372635 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 301/603] 10.222.0.42 () {56 vars in 1108 bytes} [Sun Oct 30 00:36:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:36:12.380727 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e28a84-aae8-4bae-b27b-80c5477215f8 None admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:36:12.459232 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=100 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:36:12.472082 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42af0b9-ca0c-49af-ba10-d4bc85764530 None admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:36:12.536236 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=100 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:36:12.539749 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e28a84-aae8-4bae-b27b-80c5477215f8 None admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:36:12.557302 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6014862-3dbd-4013-a987-543470db2920 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:36:12.557931 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6014862-3dbd-4013-a987-543470db2920 None admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:36:12.558204 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6014862-3dbd-4013-a987-543470db2920 None admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:36:12.558528 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6014862-3dbd-4013-a987-543470db2920 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:36:12.580421 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6014862-3dbd-4013-a987-543470db2920 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:36:12.581474 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb18a94e-8449-4782-ae93-e6bdad7fa4ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:36:12.582091 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb18a94e-8449-4782-ae93-e6bdad7fa4ae None admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:36:12.582366 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb18a94e-8449-4782-ae93-e6bdad7fa4ae None admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:36:12.582628 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb18a94e-8449-4782-ae93-e6bdad7fa4ae None admin] PATH_INFO: `/v3/domains` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:36:12.584581 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6014862-3dbd-4013-a987-543470db2920 None admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:36:12.585066 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb18a94e-8449-4782-ae93-e6bdad7fa4ae None admin] RBAC: Adding query filter params (name=Default) {{(pid=87955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:36:12.585437 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb18a94e-8449-4782-ae93-e6bdad7fa4ae None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:36:12.586797 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb18a94e-8449-4782-ae93-e6bdad7fa4ae None admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:36:12.605801 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 302/604] 10.222.0.42 () {56 vars in 1109 bytes} [Sun Oct 30 00:36:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:36:12.607692 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application [None req-e6014862-3dbd-4013-a987-543470db2920 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 30 00:36:12.607692 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:36:12.607692 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:36:12.607692 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:36:12.607692 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:36:12.607692 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:36:12.607692 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:36:12.607692 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:36:12.607692 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:36:12.607692 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:36:12.607692 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:36:12.607692 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:36:12.607692 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 30 00:36:12.607692 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 30 00:36:12.607692 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 30 00:36:12.607692 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 30 00:36:12.608622 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:36:12.608622 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:36:12.608622 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:36:12.608622 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:36:12.608622 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:36:12.608622 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:36:12.608622 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:36:12.608622 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application with Lock( Oct 30 00:36:12.608622 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:36:12.608622 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:36:12.608622 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:36:12.608622 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:36:12.608622 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:36:12.608622 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:36:12.608622 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:36:12.608622 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:36:12.608622 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 30 00:36:12.609498 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 30 00:36:12.609498 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 30 00:36:12.609498 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application Oct 30 00:36:12.611491 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 303/605] 10.222.0.42 () {56 vars in 1108 bytes} [Sun Oct 30 00:36:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 336 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 30 00:36:12.614406 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb18a94e-8449-4782-ae93-e6bdad7fa4ae None admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:36:12.617493 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6014862-3dbd-4013-a987-543470db2920 None admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:36:12.792369 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb18a94e-8449-4782-ae93-e6bdad7fa4ae None admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:36:12.795511 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=100 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:36:12.829393 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fd958f-4426-4491-8b51-27f3c3a9d7fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:36:12.830059 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fd958f-4426-4491-8b51-27f3c3a9d7fb None admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:36:12.830342 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fd958f-4426-4491-8b51-27f3c3a9d7fb None admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:36:12.830617 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fd958f-4426-4491-8b51-27f3c3a9d7fb None admin] PATH_INFO: `/v3/users/swift` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:36:12.838840 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4fd958f-4426-4491-8b51-27f3c3a9d7fb None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:36:12.840358 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4fd958f-4426-4491-8b51-27f3c3a9d7fb None admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:36:12.853132 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application [None req-a4fd958f-4426-4491-8b51-27f3c3a9d7fb None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 30 00:36:12.853132 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:36:12.853132 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:36:12.853132 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:36:12.853132 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:36:12.853132 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:36:12.853132 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:36:12.853132 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:36:12.853132 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:36:12.853132 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:36:12.853132 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:36:12.853132 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:36:12.853132 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 30 00:36:12.853132 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 30 00:36:12.853132 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 30 00:36:12.853132 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 30 00:36:12.854134 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:36:12.854134 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:36:12.854134 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 30 00:36:12.854134 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 30 00:36:12.854134 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 30 00:36:12.854134 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 30 00:36:12.854134 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:36:12.854134 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:36:12.854134 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:36:12.854134 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:36:12.854134 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:36:12.854134 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application with Lock( Oct 30 00:36:12.854134 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:36:12.854134 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:36:12.854134 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:36:12.854134 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:36:12.854134 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:36:12.854134 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:36:12.855092 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:36:12.855092 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:36:12.855092 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 30 00:36:12.855092 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 30 00:36:12.855092 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 30 00:36:12.855092 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 30 00:36:12.855092 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 30 00:36:12.855092 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 30 00:36:12.855092 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 30 00:36:12.855092 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application Oct 30 00:36:12.855688 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6014862-3dbd-4013-a987-543470db2920 None admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:36:12.855762 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 303/606] 10.222.0.42 () {56 vars in 1096 bytes} [Sun Oct 30 00:36:12 2022] GET /identity/v3/users/swift => generated 83 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:36:12.855872 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b39d453-77ef-4e4f-9b0d-36658a3739b1 None None] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:36:12.856559 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b39d453-77ef-4e4f-9b0d-36658a3739b1 None None] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:36:12.856559 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b39d453-77ef-4e4f-9b0d-36658a3739b1 None None] PATH_INFO: `/` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:36:12.858103 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 304/607] 10.222.0.42 () {54 vars in 927 bytes} [Sun Oct 30 00:36:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:36:12.862928 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b39d453-77ef-4e4f-9b0d-36658a3739b1 None None] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:36:12.891363 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe5fd66-4ebf-4ffa-9145-0e90027757ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:36:12.892472 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe5fd66-4ebf-4ffa-9145-0e90027757ad None admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:36:12.892948 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe5fd66-4ebf-4ffa-9145-0e90027757ad None admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:36:12.893424 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe5fd66-4ebf-4ffa-9145-0e90027757ad None admin] PATH_INFO: `/v3/domains` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:36:12.894320 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe5fd66-4ebf-4ffa-9145-0e90027757ad None admin] RBAC: Adding query filter params (name=Default) {{(pid=87956) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:36:12.894923 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe5fd66-4ebf-4ffa-9145-0e90027757ad None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:36:12.896701 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe5fd66-4ebf-4ffa-9145-0e90027757ad None admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:36:12.910915 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 304/608] 10.222.0.42 () {56 vars in 1109 bytes} [Sun Oct 30 00:36:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 30 00:36:12.912641 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260afbe5-abfd-44ee-8864-ca2dfe58d0dd None None] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:36:12.913130 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260afbe5-abfd-44ee-8864-ca2dfe58d0dd None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:36:12.913649 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260afbe5-abfd-44ee-8864-ca2dfe58d0dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:36:12.932777 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.auth.core [None req-260afbe5-abfd-44ee-8864-ca2dfe58d0dd None None] MFA Rules not processed for user `eb55b6cbca4945abb21b0e49eb745e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=87956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:36:12.934633 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-260afbe5-abfd-44ee-8864-ca2dfe58d0dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:36:12.974225 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=100 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:36:12.984281 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b39d453-77ef-4e4f-9b0d-36658a3739b1 None None] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:36:13.009498 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 305/609] 10.222.0.42 () {58 vars in 1024 bytes} [Sun Oct 30 00:36:12 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 30 00:36:13.011456 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260afbe5-abfd-44ee-8864-ca2dfe58d0dd None None] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:36:13.045862 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adddfccc-8cb7-462d-a717-1330f25701b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:36:13.046469 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adddfccc-8cb7-462d-a717-1330f25701b9 None admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:36:13.046744 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adddfccc-8cb7-462d-a717-1330f25701b9 None admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:36:13.047012 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adddfccc-8cb7-462d-a717-1330f25701b9 None admin] PATH_INFO: `/v3/users` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:36:13.047875 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adddfccc-8cb7-462d-a717-1330f25701b9 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=87955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:36:13.048180 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adddfccc-8cb7-462d-a717-1330f25701b9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:36:13.050554 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adddfccc-8cb7-462d-a717-1330f25701b9 None admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:36:13.086460 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 305/610] 10.222.0.42 () {56 vars in 1135 bytes} [Sun Oct 30 00:36:12 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:36:13.091503 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adddfccc-8cb7-462d-a717-1330f25701b9 None admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:36:13.120873 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=100 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:36:13.163683 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260afbe5-abfd-44ee-8864-ca2dfe58d0dd None None] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:36:13.226402 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74fc058-a959-4211-9845-105f4cfab181 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:36:13.227043 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74fc058-a959-4211-9845-105f4cfab181 None admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:36:13.227348 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74fc058-a959-4211-9845-105f4cfab181 None admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:36:13.227612 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74fc058-a959-4211-9845-105f4cfab181 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:36:13.241287 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74fc058-a959-4211-9845-105f4cfab181 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:36:13.242850 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74fc058-a959-4211-9845-105f4cfab181 None admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:36:13.260905 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application [None req-e74fc058-a959-4211-9845-105f4cfab181 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 30 00:36:13.260905 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:36:13.260905 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:36:13.260905 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:36:13.260905 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:36:13.260905 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:36:13.260905 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:36:13.260905 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:36:13.260905 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:36:13.260905 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:36:13.260905 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:36:13.260905 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:36:13.260905 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 30 00:36:13.260905 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 30 00:36:13.260905 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 30 00:36:13.260905 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 30 00:36:13.261883 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:36:13.261883 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:36:13.261883 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 30 00:36:13.261883 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 30 00:36:13.261883 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 30 00:36:13.261883 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 30 00:36:13.261883 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:36:13.261883 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:36:13.261883 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:36:13.261883 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:36:13.261883 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:36:13.261883 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application with Lock( Oct 30 00:36:13.261883 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:36:13.261883 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:36:13.261883 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:36:13.261883 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:36:13.261883 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:36:13.261883 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:36:13.262812 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:36:13.262812 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:36:13.262812 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 30 00:36:13.262812 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 30 00:36:13.262812 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 30 00:36:13.262812 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 30 00:36:13.262812 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 30 00:36:13.262812 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 30 00:36:13.262812 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 30 00:36:13.262812 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application Oct 30 00:36:13.262812 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 306/611] 10.222.0.42 () {56 vars in 1117 bytes} [Sun Oct 30 00:36:13 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:36:13.272264 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74fc058-a959-4211-9845-105f4cfab181 None admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:36:13.292582 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adddfccc-8cb7-462d-a717-1330f25701b9 None admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:36:13.306640 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=100 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:36:13.364579 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d80eb2-ce91-4ea5-8e73-999f0f2432c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:36:13.365204 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d80eb2-ce91-4ea5-8e73-999f0f2432c2 None admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:36:13.365478 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d80eb2-ce91-4ea5-8e73-999f0f2432c2 None admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:36:13.365753 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d80eb2-ce91-4ea5-8e73-999f0f2432c2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:36:13.394888 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74fc058-a959-4211-9845-105f4cfab181 None admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:36:13.432603 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687b5545-689b-4a87-bbde-e00a3a236b49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:36:13.433026 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687b5545-689b-4a87-bbde-e00a3a236b49 None admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:36:13.433310 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687b5545-689b-4a87-bbde-e00a3a236b49 None admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:36:13.433578 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687b5545-689b-4a87-bbde-e00a3a236b49 None admin] PATH_INFO: `/v3/users` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:36:13.434310 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687b5545-689b-4a87-bbde-e00a3a236b49 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=87956) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:36:13.434612 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687b5545-689b-4a87-bbde-e00a3a236b49 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:36:13.436070 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687b5545-689b-4a87-bbde-e00a3a236b49 None admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:36:13.451874 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d80eb2-ce91-4ea5-8e73-999f0f2432c2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:36:13.453918 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d80eb2-ce91-4ea5-8e73-999f0f2432c2 None admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:36:13.458566 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 307/612] 10.222.0.42 () {56 vars in 1149 bytes} [Sun Oct 30 00:36:13 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:36:13.458566 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687b5545-689b-4a87-bbde-e00a3a236b49 None admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:36:13.482408 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=100 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:36:13.551940 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=100 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:36:13.565816 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687b5545-689b-4a87-bbde-e00a3a236b49 None admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:36:13.589544 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 306/613] 10.222.0.42 () {58 vars in 1282 bytes} [Sun Oct 30 00:36:13 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 498 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Oct 30 00:36:13.591506 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d80eb2-ce91-4ea5-8e73-999f0f2432c2 None admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:36:13.601094 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bb5101-65b8-4a67-af93-0016c3bf2342 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:36:13.601791 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bb5101-65b8-4a67-af93-0016c3bf2342 None admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:36:13.602074 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bb5101-65b8-4a67-af93-0016c3bf2342 None admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:36:13.602734 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bb5101-65b8-4a67-af93-0016c3bf2342 None admin] PATH_INFO: `/v3/services/network` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:36:13.602921 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81bb5101-65b8-4a67-af93-0016c3bf2342 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:36:13.604365 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81bb5101-65b8-4a67-af93-0016c3bf2342 None admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:36:13.613538 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application [None req-81bb5101-65b8-4a67-af93-0016c3bf2342 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Oct 30 00:36:13.613538 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:36:13.613538 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 30 00:36:13.613538 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 30 00:36:13.613538 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 30 00:36:13.613538 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 30 00:36:13.613538 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 30 00:36:13.613538 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 30 00:36:13.613538 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 30 00:36:13.613538 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application Oct 30 00:36:13.613538 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 30 00:36:13.613538 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application Oct 30 00:36:13.613538 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:36:13.613538 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:36:13.613538 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:36:13.613538 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:36:13.613538 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:36:13.614521 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:36:13.614521 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:36:13.614521 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:36:13.614521 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:36:13.614521 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:36:13.614521 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:36:13.614521 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 30 00:36:13.614521 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 30 00:36:13.614521 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 30 00:36:13.614521 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 30 00:36:13.614521 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:36:13.614521 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:36:13.614521 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:36:13.614521 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:36:13.614521 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:36:13.614521 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:36:13.620755 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:36:13.620755 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application with Lock( Oct 30 00:36:13.620755 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:36:13.620755 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:36:13.620755 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:36:13.620755 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:36:13.620755 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:36:13.620755 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:36:13.620755 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:36:13.620755 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:36:13.620755 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 30 00:36:13.620755 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 30 00:36:13.620755 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 30 00:36:13.620755 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application Oct 30 00:36:13.620755 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 308/614] 10.222.0.42 () {56 vars in 1111 bytes} [Sun Oct 30 00:36:13 2022] GET /identity/v3/services/network => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:36:13.621565 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bb5101-65b8-4a67-af93-0016c3bf2342 None admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:36:13.730703 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bb5101-65b8-4a67-af93-0016c3bf2342 None admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:36:13.732770 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d80eb2-ce91-4ea5-8e73-999f0f2432c2 None admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:36:13.752883 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=100 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:36:13.766806 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f58ad7-4032-4d81-b246-89f3ae8730fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:36:13.767505 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f58ad7-4032-4d81-b246-89f3ae8730fc None admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:36:13.767781 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f58ad7-4032-4d81-b246-89f3ae8730fc None admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:36:13.768049 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f58ad7-4032-4d81-b246-89f3ae8730fc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:36:13.775789 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbae105-9c5f-405d-a4a5-e568a8e26e4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:36:13.776800 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbae105-9c5f-405d-a4a5-e568a8e26e4d None admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:36:13.777394 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbae105-9c5f-405d-a4a5-e568a8e26e4d None admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:36:13.777862 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbae105-9c5f-405d-a4a5-e568a8e26e4d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:36:13.779520 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f58ad7-4032-4d81-b246-89f3ae8730fc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:36:13.781081 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f58ad7-4032-4d81-b246-89f3ae8730fc None admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:36:13.796289 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application [None req-86f58ad7-4032-4d81-b246-89f3ae8730fc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 30 00:36:13.796289 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:36:13.796289 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:36:13.796289 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:36:13.796289 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:36:13.796289 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:36:13.796289 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:36:13.796289 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:36:13.796289 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:36:13.796289 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:36:13.796289 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:36:13.796289 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:36:13.796289 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 30 00:36:13.796289 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 30 00:36:13.796289 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 30 00:36:13.796289 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 30 00:36:13.797288 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:36:13.797288 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:36:13.797288 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:36:13.797288 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:36:13.797288 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:36:13.797288 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:36:13.797288 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:36:13.797288 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application with Lock( Oct 30 00:36:13.797288 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:36:13.797288 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:36:13.797288 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:36:13.797288 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:36:13.797288 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:36:13.797288 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:36:13.797288 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:36:13.797288 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:36:13.797288 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 30 00:36:13.798186 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 30 00:36:13.798186 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 30 00:36:13.798186 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application Oct 30 00:36:13.798186 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 309/615] 10.222.0.42 () {56 vars in 1108 bytes} [Sun Oct 30 00:36:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:36:13.798186 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f58ad7-4032-4d81-b246-89f3ae8730fc None admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:36:13.807184 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=100 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:36:13.857177 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbae105-9c5f-405d-a4a5-e568a8e26e4d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:36:13.858753 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbae105-9c5f-405d-a4a5-e568a8e26e4d None admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:36:13.904983 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f58ad7-4032-4d81-b246-89f3ae8730fc None admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:36:13.944437 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3b7040-d3e1-48cd-a52c-00b65201b15f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:36:13.945912 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3b7040-d3e1-48cd-a52c-00b65201b15f None admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:36:13.946413 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3b7040-d3e1-48cd-a52c-00b65201b15f None admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:36:13.946905 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3b7040-d3e1-48cd-a52c-00b65201b15f None admin] PATH_INFO: `/v3/services` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:36:13.947790 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3b7040-d3e1-48cd-a52c-00b65201b15f None admin] RBAC: Adding query filter params (name=network) {{(pid=87956) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:36:13.948302 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3b7040-d3e1-48cd-a52c-00b65201b15f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:36:13.949843 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3b7040-d3e1-48cd-a52c-00b65201b15f None admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:36:13.954963 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 310/616] 10.222.0.42 () {56 vars in 1112 bytes} [Sun Oct 30 00:36:13 2022] GET /identity/v3/services?name=network => generated 124 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:36:13.956334 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e0df09-87f4-4d39-85fc-7ee04bf02987 None None] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:36:13.956614 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e0df09-87f4-4d39-85fc-7ee04bf02987 None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:36:13.956888 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e0df09-87f4-4d39-85fc-7ee04bf02987 None None] PATH_INFO: `/` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:36:13.958219 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 311/617] 10.222.0.42 () {54 vars in 927 bytes} [Sun Oct 30 00:36:13 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:36:13.958836 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e0df09-87f4-4d39-85fc-7ee04bf02987 None None] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:36:13.969889 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 307/618] 10.222.0.42 () {58 vars in 1282 bytes} [Sun Oct 30 00:36:13 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 30 00:36:13.971474 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6f523b-8e6a-4943-a170-8b4995a978f0 None None] REQUEST_METHOD: `POST` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:36:13.971963 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6f523b-8e6a-4943-a170-8b4995a978f0 None None] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:36:13.972449 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6f523b-8e6a-4943-a170-8b4995a978f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:36:13.991371 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.auth.core [None req-5a6f523b-8e6a-4943-a170-8b4995a978f0 None None] MFA Rules not processed for user `eb55b6cbca4945abb21b0e49eb745e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=87955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:36:13.992627 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-5a6f523b-8e6a-4943-a170-8b4995a978f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:36:14.008156 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=100 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:36:14.030523 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=100 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:36:14.075459 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 308/619] 10.222.0.42 () {58 vars in 1024 bytes} [Sun Oct 30 00:36:13 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 30 00:36:14.075459 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6f523b-8e6a-4943-a170-8b4995a978f0 None None] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:36:14.080094 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e0df09-87f4-4d39-85fc-7ee04bf02987 None None] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:36:14.124821 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc83f89a-051a-4175-b655-8d605c1ef371 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:36:14.125465 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc83f89a-051a-4175-b655-8d605c1ef371 None admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:36:14.126200 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc83f89a-051a-4175-b655-8d605c1ef371 None admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:36:14.126486 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc83f89a-051a-4175-b655-8d605c1ef371 None admin] PATH_INFO: `/v3/domains` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:36:14.127157 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc83f89a-051a-4175-b655-8d605c1ef371 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87956) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:36:14.127776 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc83f89a-051a-4175-b655-8d605c1ef371 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:36:14.129459 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc83f89a-051a-4175-b655-8d605c1ef371 None admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:36:14.147370 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 312/620] 10.222.0.42 () {56 vars in 1109 bytes} [Sun Oct 30 00:36:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:36:14.148691 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc83f89a-051a-4175-b655-8d605c1ef371 None admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:36:14.195882 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6f523b-8e6a-4943-a170-8b4995a978f0 None None] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:36:14.234824 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39259085-1954-4ab4-a870-1f169436aec1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:36:14.235511 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39259085-1954-4ab4-a870-1f169436aec1 None admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:36:14.235821 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39259085-1954-4ab4-a870-1f169436aec1 None admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:36:14.236102 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39259085-1954-4ab4-a870-1f169436aec1 None admin] PATH_INFO: `/v3/services` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:36:14.236745 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39259085-1954-4ab4-a870-1f169436aec1 None admin] RBAC: Adding query filter params (type=network) {{(pid=87955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:36:14.237047 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39259085-1954-4ab4-a870-1f169436aec1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:36:14.238879 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39259085-1954-4ab4-a870-1f169436aec1 None admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:36:14.246264 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 309/621] 10.222.0.42 () {56 vars in 1112 bytes} [Sun Oct 30 00:36:14 2022] GET /identity/v3/services?type=network => generated 350 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:36:14.246264 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39259085-1954-4ab4-a870-1f169436aec1 None admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:36:14.262110 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=100 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:36:14.272005 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc83f89a-051a-4175-b655-8d605c1ef371 None admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:36:14.297595 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=100 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:36:14.305528 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a4f65c-3e34-408f-a46f-3fde6fbf1128 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:36:14.306164 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a4f65c-3e34-408f-a46f-3fde6fbf1128 None admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:36:14.306430 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a4f65c-3e34-408f-a46f-3fde6fbf1128 None admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:36:14.306696 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a4f65c-3e34-408f-a46f-3fde6fbf1128 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:36:14.316676 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a4f65c-3e34-408f-a46f-3fde6fbf1128 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:36:14.318101 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a4f65c-3e34-408f-a46f-3fde6fbf1128 None admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:36:14.332722 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application [None req-a3a4f65c-3e34-408f-a46f-3fde6fbf1128 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 30 00:36:14.332722 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:36:14.332722 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:36:14.332722 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:36:14.332722 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:36:14.332722 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:36:14.332722 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:36:14.332722 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:36:14.332722 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:36:14.332722 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:36:14.332722 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:36:14.332722 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:36:14.332722 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 30 00:36:14.332722 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 30 00:36:14.332722 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 30 00:36:14.332722 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 30 00:36:14.333758 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:36:14.333758 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:36:14.333758 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:36:14.333758 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:36:14.333758 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:36:14.333758 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:36:14.333758 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:36:14.333758 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application with Lock( Oct 30 00:36:14.333758 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:36:14.333758 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:36:14.333758 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:36:14.333758 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:36:14.333758 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:36:14.333758 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:36:14.333758 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:36:14.333758 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:36:14.333758 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 30 00:36:14.334767 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 30 00:36:14.334767 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 30 00:36:14.334767 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application Oct 30 00:36:14.338386 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 313/622] 10.222.0.42 () {56 vars in 1108 bytes} [Sun Oct 30 00:36:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:36:14.339300 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a4f65c-3e34-408f-a46f-3fde6fbf1128 None admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:36:14.360822 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39259085-1954-4ab4-a870-1f169436aec1 None admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:36:14.393776 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894d89d9-a326-4133-b72c-fbd0694dc822 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:36:14.394410 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894d89d9-a326-4133-b72c-fbd0694dc822 None admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:36:14.394682 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894d89d9-a326-4133-b72c-fbd0694dc822 None admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:36:14.394949 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894d89d9-a326-4133-b72c-fbd0694dc822 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:36:14.401386 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894d89d9-a326-4133-b72c-fbd0694dc822 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:36:14.402813 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894d89d9-a326-4133-b72c-fbd0694dc822 None admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:36:14.414953 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application [None req-894d89d9-a326-4133-b72c-fbd0694dc822 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 30 00:36:14.414953 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:36:14.414953 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:36:14.414953 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:36:14.414953 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:36:14.414953 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:36:14.414953 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:36:14.414953 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:36:14.414953 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:36:14.414953 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:36:14.414953 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:36:14.414953 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:36:14.414953 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 30 00:36:14.414953 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 30 00:36:14.414953 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 30 00:36:14.416079 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 30 00:36:14.416079 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:36:14.416079 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:36:14.416079 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:36:14.416079 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:36:14.416079 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:36:14.416079 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:36:14.416079 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:36:14.416079 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application with Lock( Oct 30 00:36:14.416079 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:36:14.416079 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:36:14.416079 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:36:14.416079 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:36:14.416079 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:36:14.416079 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:36:14.416079 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:36:14.416079 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:36:14.417187 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 30 00:36:14.417187 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 30 00:36:14.417187 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 30 00:36:14.417187 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 30 00:36:14.417187 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 30 00:36:14.417187 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 30 00:36:14.417187 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 30 00:36:14.417187 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application Oct 30 00:36:14.417187 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 310/623] 10.222.0.42 () {56 vars in 1111 bytes} [Sun Oct 30 00:36:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:36:14.417187 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd658fd7-c437-4607-8b6c-7674bba4f750 None None] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:36:14.417858 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd658fd7-c437-4607-8b6c-7674bba4f750 None None] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:36:14.417858 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd658fd7-c437-4607-8b6c-7674bba4f750 None None] PATH_INFO: `/` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:36:14.419091 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 311/624] 10.222.0.42 () {54 vars in 927 bytes} [Sun Oct 30 00:36:14 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:36:14.419613 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd658fd7-c437-4607-8b6c-7674bba4f750 None None] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:36:14.439961 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a4f65c-3e34-408f-a46f-3fde6fbf1128 None admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:36:14.473570 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313dc9da-743b-4a7c-aced-c1be08fd5f01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:36:14.474180 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313dc9da-743b-4a7c-aced-c1be08fd5f01 None admin] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:36:14.474540 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313dc9da-743b-4a7c-aced-c1be08fd5f01 None admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:36:14.474727 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313dc9da-743b-4a7c-aced-c1be08fd5f01 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:36:14.475424 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313dc9da-743b-4a7c-aced-c1be08fd5f01 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:36:14.476839 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313dc9da-743b-4a7c-aced-c1be08fd5f01 None admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:36:14.488415 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=100 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:36:14.497937 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 314/625] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 30 00:36:14 2022] POST /identity/v3/endpoints => generated 337 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 00:36:14.498872 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313dc9da-743b-4a7c-aced-c1be08fd5f01 None admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:36:14.528413 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd658fd7-c437-4607-8b6c-7674bba4f750 None None] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:36:14.541094 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:36:14.567812 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e79ed6-7176-4de7-869f-ab65edc25e9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:36:14.568675 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e79ed6-7176-4de7-869f-ab65edc25e9d None admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:36:14.568957 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e79ed6-7176-4de7-869f-ab65edc25e9d None admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:36:14.569233 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e79ed6-7176-4de7-869f-ab65edc25e9d None admin] PATH_INFO: `/v3/domains` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:36:14.569925 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e79ed6-7176-4de7-869f-ab65edc25e9d None admin] RBAC: Adding query filter params (name=Default) {{(pid=87955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:36:14.570228 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e79ed6-7176-4de7-869f-ab65edc25e9d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:36:14.571759 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e79ed6-7176-4de7-869f-ab65edc25e9d None admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:36:14.586258 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 312/626] 10.222.0.42 () {56 vars in 1109 bytes} [Sun Oct 30 00:36:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:36:14.587604 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2590b43f-625a-4800-87eb-b5c4a6b0786f None None] REQUEST_METHOD: `POST` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:36:14.587892 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2590b43f-625a-4800-87eb-b5c4a6b0786f None None] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:36:14.588166 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2590b43f-625a-4800-87eb-b5c4a6b0786f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:36:14.608200 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.auth.core [None req-2590b43f-625a-4800-87eb-b5c4a6b0786f None None] MFA Rules not processed for user `eb55b6cbca4945abb21b0e49eb745e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=87955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:36:14.609432 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-2590b43f-625a-4800-87eb-b5c4a6b0786f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:36:14.622232 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313dc9da-743b-4a7c-aced-c1be08fd5f01 None admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:36:14.658487 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63b10b7-f2a8-4859-acdc-eb3f7fee27f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:36:14.659143 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63b10b7-f2a8-4859-acdc-eb3f7fee27f7 None admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:36:14.659452 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63b10b7-f2a8-4859-acdc-eb3f7fee27f7 None admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:36:14.659725 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63b10b7-f2a8-4859-acdc-eb3f7fee27f7 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:36:14.660322 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63b10b7-f2a8-4859-acdc-eb3f7fee27f7 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:36:14.661730 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63b10b7-f2a8-4859-acdc-eb3f7fee27f7 None admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:36:14.671010 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application [None req-c63b10b7-f2a8-4859-acdc-eb3f7fee27f7 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 30 00:36:14.671010 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:36:14.671010 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 30 00:36:14.671010 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 30 00:36:14.671010 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 30 00:36:14.671010 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 30 00:36:14.671010 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 30 00:36:14.671010 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 30 00:36:14.671010 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 30 00:36:14.671010 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application Oct 30 00:36:14.671010 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 30 00:36:14.671010 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application Oct 30 00:36:14.671010 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:36:14.671010 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:36:14.671010 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:36:14.671010 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:36:14.671010 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:36:14.672125 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:36:14.672125 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:36:14.672125 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:36:14.672125 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:36:14.672125 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:36:14.672125 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:36:14.672125 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 30 00:36:14.672125 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 30 00:36:14.672125 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 30 00:36:14.672125 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 30 00:36:14.672125 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:36:14.672125 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:36:14.672125 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:36:14.672125 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:36:14.672125 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:36:14.672125 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:36:14.672984 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:36:14.672984 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application with Lock( Oct 30 00:36:14.672984 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:36:14.672984 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:36:14.672984 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:36:14.672984 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:36:14.672984 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:36:14.672984 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:36:14.672984 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:36:14.672984 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:36:14.672984 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 30 00:36:14.672984 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 30 00:36:14.672984 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 30 00:36:14.672984 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application Oct 30 00:36:14.672984 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 315/627] 10.222.0.42 () {56 vars in 1129 bytes} [Sun Oct 30 00:36:14 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:36:14.673777 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63b10b7-f2a8-4859-acdc-eb3f7fee27f7 None admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:36:14.692623 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 313/628] 10.222.0.42 () {58 vars in 1024 bytes} [Sun Oct 30 00:36:14 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 30 00:36:14.693196 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2590b43f-625a-4800-87eb-b5c4a6b0786f None None] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:36:14.761544 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=100 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:36:14.802097 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=100 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:36:14.804613 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63b10b7-f2a8-4859-acdc-eb3f7fee27f7 None admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:36:14.812825 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2590b43f-625a-4800-87eb-b5c4a6b0786f None None] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:36:14.839598 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8b3363-b7f5-4190-bb93-47c6ca8a783a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:36:14.840343 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8b3363-b7f5-4190-bb93-47c6ca8a783a None admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:36:14.840711 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8b3363-b7f5-4190-bb93-47c6ca8a783a None admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:36:14.841073 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8b3363-b7f5-4190-bb93-47c6ca8a783a None admin] PATH_INFO: `/v3/projects` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:36:14.841852 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8b3363-b7f5-4190-bb93-47c6ca8a783a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87956) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:36:14.842251 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8b3363-b7f5-4190-bb93-47c6ca8a783a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:36:14.843804 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8b3363-b7f5-4190-bb93-47c6ca8a783a None admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:36:14.847943 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086e3296-9adc-4d87-ae0e-05d4b5186eba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:36:14.848577 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086e3296-9adc-4d87-ae0e-05d4b5186eba None admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:36:14.848856 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086e3296-9adc-4d87-ae0e-05d4b5186eba None admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:36:14.849130 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086e3296-9adc-4d87-ae0e-05d4b5186eba None admin] PATH_INFO: `/v3/projects/service` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:36:14.855864 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086e3296-9adc-4d87-ae0e-05d4b5186eba None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:36:14.861503 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 316/629] 10.222.0.42 () {56 vars in 1148 bytes} [Sun Oct 30 00:36:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:36:14.861503 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8b3363-b7f5-4190-bb93-47c6ca8a783a None admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:36:14.861720 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086e3296-9adc-4d87-ae0e-05d4b5186eba None admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:36:14.872887 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application [None req-086e3296-9adc-4d87-ae0e-05d4b5186eba None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 30 00:36:14.872887 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:36:14.872887 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:36:14.872887 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:36:14.872887 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:36:14.872887 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:36:14.872887 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:36:14.872887 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:36:14.872887 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:36:14.872887 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:36:14.872887 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:36:14.872887 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:36:14.872887 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 30 00:36:14.872887 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 30 00:36:14.872887 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 30 00:36:14.873949 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 30 00:36:14.873949 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:36:14.873949 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:36:14.873949 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:36:14.873949 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:36:14.873949 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:36:14.873949 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:36:14.873949 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:36:14.873949 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application with Lock( Oct 30 00:36:14.873949 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:36:14.873949 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:36:14.873949 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:36:14.873949 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:36:14.873949 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:36:14.873949 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:36:14.873949 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:36:14.873949 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:36:14.875043 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 30 00:36:14.875043 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 30 00:36:14.875043 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 30 00:36:14.875043 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 30 00:36:14.875043 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 30 00:36:14.875043 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 30 00:36:14.875043 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 30 00:36:14.875043 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application Oct 30 00:36:14.875713 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 314/630] 10.222.0.42 () {56 vars in 1111 bytes} [Sun Oct 30 00:36:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:36:14.881104 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086e3296-9adc-4d87-ae0e-05d4b5186eba None admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:36:14.965775 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8b3363-b7f5-4190-bb93-47c6ca8a783a None admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:36:14.985670 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086e3296-9adc-4d87-ae0e-05d4b5186eba None admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:36:14.999827 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ed8488-2998-4007-a0fb-5da48ea8704a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:36:15.000700 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ed8488-2998-4007-a0fb-5da48ea8704a None admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:36:15.000700 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ed8488-2998-4007-a0fb-5da48ea8704a None admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:36:15.000953 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ed8488-2998-4007-a0fb-5da48ea8704a None admin] PATH_INFO: `/v3/services` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:36:15.001580 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ed8488-2998-4007-a0fb-5da48ea8704a None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=87956) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:36:15.001882 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ed8488-2998-4007-a0fb-5da48ea8704a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:36:15.002038 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=100 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:36:15.003256 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ed8488-2998-4007-a0fb-5da48ea8704a None admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:36:15.007940 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 317/631] 10.222.0.42 () {56 vars in 1124 bytes} [Sun Oct 30 00:36:14 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:36:15.008748 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ed8488-2998-4007-a0fb-5da48ea8704a None admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:36:15.019857 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c555ed84-b3b2-4a8a-9e7d-9e2823bb1e6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:36:15.020392 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c555ed84-b3b2-4a8a-9e7d-9e2823bb1e6b None admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:36:15.020667 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c555ed84-b3b2-4a8a-9e7d-9e2823bb1e6b None admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:36:15.020936 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c555ed84-b3b2-4a8a-9e7d-9e2823bb1e6b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:36:15.021809 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c555ed84-b3b2-4a8a-9e7d-9e2823bb1e6b None admin] RBAC: Adding query filter params (role.id=6ccaa8c11f29456fb4e4eeccb21616c7, scope.project.id=17d2387fdf794d4eaef07bbcd7b39f2a, user.id=b6d6e884a8104a428e4de6be1cfa467c) {{(pid=87955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:36:15.022118 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c555ed84-b3b2-4a8a-9e7d-9e2823bb1e6b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:36:15.023728 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c555ed84-b3b2-4a8a-9e7d-9e2823bb1e6b None admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:36:15.029761 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 315/632] 10.222.0.42 () {56 vars in 1374 bytes} [Sun Oct 30 00:36:14 2022] GET /identity/v3/role_assignments?user.id=b6d6e884a8104a428e4de6be1cfa467c&scope.project.id=17d2387fdf794d4eaef07bbcd7b39f2a&role.id=6ccaa8c11f29456fb4e4eeccb21616c7 => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:36:15.030504 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c555ed84-b3b2-4a8a-9e7d-9e2823bb1e6b None admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:36:15.042830 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=100 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:36:15.134213 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ed8488-2998-4007-a0fb-5da48ea8704a None admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:36:15.152559 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c555ed84-b3b2-4a8a-9e7d-9e2823bb1e6b None admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:36:15.171759 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed52ba03-f828-4d10-8572-b697fbac5438 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:36:15.172395 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed52ba03-f828-4d10-8572-b697fbac5438 None admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:36:15.172651 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed52ba03-f828-4d10-8572-b697fbac5438 None admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:36:15.172915 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed52ba03-f828-4d10-8572-b697fbac5438 None admin] PATH_INFO: `/v3/projects` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:36:15.173608 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed52ba03-f828-4d10-8572-b697fbac5438 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87956) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:36:15.173903 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed52ba03-f828-4d10-8572-b697fbac5438 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:36:15.175513 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed52ba03-f828-4d10-8572-b697fbac5438 None admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:36:15.191146 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb0c781-71b7-4328-9667-067ee10c5ee0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:36:15.192018 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb0c781-71b7-4328-9667-067ee10c5ee0 None admin] REQUEST_METHOD: `POST` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:36:15.192433 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb0c781-71b7-4328-9667-067ee10c5ee0 None admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:36:15.192847 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb0c781-71b7-4328-9667-067ee10c5ee0 None admin] PATH_INFO: `/v3/services` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:36:15.193667 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 318/633] 10.222.0.42 () {56 vars in 1148 bytes} [Sun Oct 30 00:36:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:36:15.193965 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb0c781-71b7-4328-9667-067ee10c5ee0 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:36:15.194761 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed52ba03-f828-4d10-8572-b697fbac5438 None admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:36:15.195628 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb0c781-71b7-4328-9667-067ee10c5ee0 None admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:36:15.213163 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 316/634] 10.222.0.42 () {60 vars in 1141 bytes} [Sun Oct 30 00:36:15 2022] POST /identity/v3/services => generated 269 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 00:36:15.214136 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb0c781-71b7-4328-9667-067ee10c5ee0 None admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:36:15.273402 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:36:15.340901 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed52ba03-f828-4d10-8572-b697fbac5438 None admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:36:15.349346 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb0c781-71b7-4328-9667-067ee10c5ee0 None admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:36:15.353909 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=100 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:36:15.391616 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e55e99-df8b-4b2a-9ab1-669814a7f3f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:36:15.391960 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8a15e7-ab69-44ef-a316-56fd9feecc52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:36:15.392645 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8a15e7-ab69-44ef-a316-56fd9feecc52 None admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:36:15.392923 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8a15e7-ab69-44ef-a316-56fd9feecc52 None admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:36:15.393192 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8a15e7-ab69-44ef-a316-56fd9feecc52 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:36:15.393428 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e55e99-df8b-4b2a-9ab1-669814a7f3f6 None admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:36:15.393879 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e55e99-df8b-4b2a-9ab1-669814a7f3f6 None admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:36:15.394047 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8a15e7-ab69-44ef-a316-56fd9feecc52 None admin] RBAC: Adding query filter params (role.id=904973500441476eadb9406925a575df, scope.project.id=17d2387fdf794d4eaef07bbcd7b39f2a, user.id=3e7b21b55fb84a6cad507a8954492d48) {{(pid=87955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:36:15.394368 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8a15e7-ab69-44ef-a316-56fd9feecc52 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:36:15.394700 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e55e99-df8b-4b2a-9ab1-669814a7f3f6 None admin] PATH_INFO: `/v3/services` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:36:15.395558 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e55e99-df8b-4b2a-9ab1-669814a7f3f6 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=87956) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:36:15.395912 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8a15e7-ab69-44ef-a316-56fd9feecc52 None admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:36:15.396244 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e55e99-df8b-4b2a-9ab1-669814a7f3f6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:36:15.398333 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e55e99-df8b-4b2a-9ab1-669814a7f3f6 None admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:36:15.403190 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 317/635] 10.222.0.42 () {56 vars in 1374 bytes} [Sun Oct 30 00:36:15 2022] GET /identity/v3/role_assignments?user.id=3e7b21b55fb84a6cad507a8954492d48&scope.project.id=17d2387fdf794d4eaef07bbcd7b39f2a&role.id=904973500441476eadb9406925a575df => generated 608 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:36:15.405368 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 319/636] 10.222.0.42 () {56 vars in 1124 bytes} [Sun Oct 30 00:36:15 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:36:15.411236 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8a15e7-ab69-44ef-a316-56fd9feecc52 None admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:36:15.543339 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8a15e7-ab69-44ef-a316-56fd9feecc52 None admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:36:15.545590 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=100 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:36:15.584401 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79756b9c-09d4-43f5-8b87-2ef3549ff816 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:36:15.585099 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79756b9c-09d4-43f5-8b87-2ef3549ff816 None admin] REQUEST_METHOD: `POST` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:36:15.585384 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79756b9c-09d4-43f5-8b87-2ef3549ff816 None admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:36:15.585654 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79756b9c-09d4-43f5-8b87-2ef3549ff816 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:36:15.586329 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79756b9c-09d4-43f5-8b87-2ef3549ff816 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:36:15.587748 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79756b9c-09d4-43f5-8b87-2ef3549ff816 None admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:36:15.613265 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 318/637] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 30 00:36:15 2022] POST /identity/v3/endpoints => generated 346 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 30 00:36:17.282007 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08d6c2c-aeab-49e8-82ea-c5a4918611c4 None None] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:36:17.282605 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08d6c2c-aeab-49e8-82ea-c5a4918611c4 None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:36:17.282605 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08d6c2c-aeab-49e8-82ea-c5a4918611c4 None None] PATH_INFO: `/` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:36:17.284107 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 320/638] 10.222.0.42 () {54 vars in 927 bytes} [Sun Oct 30 00:36:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:36:17.289707 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f6936a-e2e4-4038-a7d2-3e0c6dab191b None None] REQUEST_METHOD: `POST` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:36:17.290120 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f6936a-e2e4-4038-a7d2-3e0c6dab191b None None] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:36:17.290261 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f6936a-e2e4-4038-a7d2-3e0c6dab191b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:36:17.309411 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.auth.core [None req-e6f6936a-e2e4-4038-a7d2-3e0c6dab191b None None] MFA Rules not processed for user `eb55b6cbca4945abb21b0e49eb745e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=87955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:36:17.310582 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-e6f6936a-e2e4-4038-a7d2-3e0c6dab191b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:36:17.394004 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 319/639] 10.222.0.42 () {58 vars in 1024 bytes} [Sun Oct 30 00:36:17 2022] POST /identity/v3/auth/tokens => generated 1271 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 30 00:36:17.546200 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb04bff-1a11-465e-85e8-058641467072 None None] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:36:17.546530 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb04bff-1a11-465e-85e8-058641467072 None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:36:17.546797 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb04bff-1a11-465e-85e8-058641467072 None None] PATH_INFO: `/` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:36:17.548390 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 321/640] 10.222.0.42 () {54 vars in 927 bytes} [Sun Oct 30 00:36:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:36:17.553952 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9508abfa-a2ed-4b08-bc7d-33e14678cedd None None] REQUEST_METHOD: `POST` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:36:17.554495 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9508abfa-a2ed-4b08-bc7d-33e14678cedd None None] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:36:17.554969 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9508abfa-a2ed-4b08-bc7d-33e14678cedd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:36:17.575829 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.auth.core [None req-9508abfa-a2ed-4b08-bc7d-33e14678cedd None None] MFA Rules not processed for user `eb55b6cbca4945abb21b0e49eb745e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=87955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:36:17.577708 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-9508abfa-a2ed-4b08-bc7d-33e14678cedd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:36:17.616828 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2137d734-b25e-41ec-ac30-f501bc80bccd None None] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:36:17.617552 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2137d734-b25e-41ec-ac30-f501bc80bccd None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:36:17.618025 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2137d734-b25e-41ec-ac30-f501bc80bccd None None] PATH_INFO: `/` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:36:17.619835 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 322/641] 10.222.0.42 () {54 vars in 927 bytes} [Sun Oct 30 00:36:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:36:17.628291 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711faf08-ce9f-4370-9691-e85444888b72 None None] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:36:17.628835 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711faf08-ce9f-4370-9691-e85444888b72 None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:36:17.629308 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711faf08-ce9f-4370-9691-e85444888b72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:36:17.649069 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.auth.core [None req-711faf08-ce9f-4370-9691-e85444888b72 None None] MFA Rules not processed for user `eb55b6cbca4945abb21b0e49eb745e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=87956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:36:17.650589 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-711faf08-ce9f-4370-9691-e85444888b72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:36:17.663226 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 320/642] 10.222.0.42 () {58 vars in 1024 bytes} [Sun Oct 30 00:36:17 2022] POST /identity/v3/auth/tokens => generated 1271 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 30 00:36:17.667762 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9508abfa-a2ed-4b08-bc7d-33e14678cedd None None] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:36:17.683027 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:36:17.737017 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 323/643] 10.222.0.42 () {58 vars in 1024 bytes} [Sun Oct 30 00:36:17 2022] POST /identity/v3/auth/tokens => generated 1271 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 30 00:36:17.784051 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9508abfa-a2ed-4b08-bc7d-33e14678cedd None None] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:36:17.819043 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9700fe-e9c9-4136-9979-335b29129cbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:36:17.819845 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9700fe-e9c9-4136-9979-335b29129cbb None admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:36:17.820120 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9700fe-e9c9-4136-9979-335b29129cbb None admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:36:17.820386 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9700fe-e9c9-4136-9979-335b29129cbb None admin] PATH_INFO: `/v3/services/object-store` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:36:17.821035 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9700fe-e9c9-4136-9979-335b29129cbb None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:36:17.822472 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9700fe-e9c9-4136-9979-335b29129cbb None admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:36:17.832805 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application [None req-ae9700fe-e9c9-4136-9979-335b29129cbb None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 30 00:36:17.832805 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:36:17.832805 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 30 00:36:17.832805 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 30 00:36:17.832805 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 30 00:36:17.832805 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 30 00:36:17.832805 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 30 00:36:17.832805 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 30 00:36:17.832805 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 30 00:36:17.832805 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application Oct 30 00:36:17.832805 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 30 00:36:17.832805 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application Oct 30 00:36:17.832805 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:36:17.832805 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:36:17.832805 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:36:17.832805 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:36:17.832805 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:36:17.834023 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:36:17.834023 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:36:17.834023 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:36:17.834023 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:36:17.834023 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:36:17.834023 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:36:17.834023 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 30 00:36:17.834023 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 30 00:36:17.834023 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 30 00:36:17.834023 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 30 00:36:17.834023 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:36:17.834023 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:36:17.834023 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:36:17.834023 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:36:17.834023 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:36:17.834023 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:36:17.835020 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:36:17.835020 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application with Lock( Oct 30 00:36:17.835020 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:36:17.835020 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:36:17.835020 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:36:17.835020 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:36:17.835020 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:36:17.835020 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:36:17.835020 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:36:17.835020 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:36:17.835020 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 30 00:36:17.835020 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 30 00:36:17.835020 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 30 00:36:17.835020 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application Oct 30 00:36:17.835020 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 321/644] 10.222.0.42 () {56 vars in 1126 bytes} [Sun Oct 30 00:36:17 2022] GET /identity/v3/services/object-store => generated 93 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 30 00:36:17.840746 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711faf08-ce9f-4370-9691-e85444888b72 None None] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:36:17.921638 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=100 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:36:17.939768 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05036621-aeb4-4439-8941-d049392c2db0 None None] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:36:17.940313 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05036621-aeb4-4439-8941-d049392c2db0 None None] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:36:17.940588 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05036621-aeb4-4439-8941-d049392c2db0 None None] PATH_INFO: `/` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:36:17.942168 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 322/645] 10.222.0.42 () {54 vars in 927 bytes} [Sun Oct 30 00:36:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:36:17.943507 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05036621-aeb4-4439-8941-d049392c2db0 None None] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:36:17.945389 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711faf08-ce9f-4370-9691-e85444888b72 None None] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:36:17.981597 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12acfd12-685f-4bb9-8487-73db8d7b033d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:36:17.982227 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12acfd12-685f-4bb9-8487-73db8d7b033d None admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:36:17.982507 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12acfd12-685f-4bb9-8487-73db8d7b033d None admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:36:17.982777 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12acfd12-685f-4bb9-8487-73db8d7b033d None admin] PATH_INFO: `/v3/services` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:36:17.983462 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12acfd12-685f-4bb9-8487-73db8d7b033d None admin] RBAC: Adding query filter params (name=object-store) {{(pid=87956) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:36:17.983769 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12acfd12-685f-4bb9-8487-73db8d7b033d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:36:17.985173 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12acfd12-685f-4bb9-8487-73db8d7b033d None admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:36:17.991514 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 324/646] 10.222.0.42 () {56 vars in 1122 bytes} [Sun Oct 30 00:36:17 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:36:17.991514 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e815e9c-4be3-4bdf-a44b-af83eb508d00 None None] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:36:17.991743 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e815e9c-4be3-4bdf-a44b-af83eb508d00 None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:36:17.991973 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e815e9c-4be3-4bdf-a44b-af83eb508d00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:36:18.010198 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.auth.core [None req-2e815e9c-4be3-4bdf-a44b-af83eb508d00 None None] MFA Rules not processed for user `eb55b6cbca4945abb21b0e49eb745e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=87956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:36:18.011417 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-2e815e9c-4be3-4bdf-a44b-af83eb508d00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:36:18.028508 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=100 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:36:18.055903 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05036621-aeb4-4439-8941-d049392c2db0 None None] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:36:18.078980 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 325/647] 10.222.0.42 () {58 vars in 1024 bytes} [Sun Oct 30 00:36:17 2022] POST /identity/v3/auth/tokens => generated 1271 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 30 00:36:18.079923 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e815e9c-4be3-4bdf-a44b-af83eb508d00 None None] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:36:18.090502 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b891dd58-a2b5-471d-b167-1e1edc1edef3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:36:18.091157 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b891dd58-a2b5-471d-b167-1e1edc1edef3 None admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:36:18.091471 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b891dd58-a2b5-471d-b167-1e1edc1edef3 None admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:36:18.091720 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b891dd58-a2b5-471d-b167-1e1edc1edef3 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:36:18.092301 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b891dd58-a2b5-471d-b167-1e1edc1edef3 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:36:18.093755 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b891dd58-a2b5-471d-b167-1e1edc1edef3 None admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:36:18.103550 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application [None req-b891dd58-a2b5-471d-b167-1e1edc1edef3 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 30 00:36:18.103550 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:36:18.103550 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 30 00:36:18.103550 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 30 00:36:18.103550 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 30 00:36:18.103550 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 30 00:36:18.103550 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 30 00:36:18.103550 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 30 00:36:18.103550 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 30 00:36:18.103550 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application Oct 30 00:36:18.103550 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 30 00:36:18.103550 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application Oct 30 00:36:18.103550 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:36:18.103550 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:36:18.103550 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:36:18.103550 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:36:18.104518 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:36:18.104518 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:36:18.104518 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:36:18.104518 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:36:18.104518 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:36:18.104518 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:36:18.104518 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:36:18.104518 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 30 00:36:18.104518 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 30 00:36:18.104518 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 30 00:36:18.104518 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 30 00:36:18.104518 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:36:18.104518 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:36:18.104518 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:36:18.104518 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:36:18.104518 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:36:18.104518 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:36:18.105500 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:36:18.105500 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application with Lock( Oct 30 00:36:18.105500 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:36:18.105500 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:36:18.105500 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:36:18.105500 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:36:18.105500 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:36:18.105500 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:36:18.105500 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:36:18.105500 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:36:18.105500 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 30 00:36:18.105500 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 30 00:36:18.105500 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 30 00:36:18.105500 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application Oct 30 00:36:18.105500 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 323/648] 10.222.0.42 () {56 vars in 1132 bytes} [Sun Oct 30 00:36:17 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:36:18.106347 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b891dd58-a2b5-471d-b167-1e1edc1edef3 None admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:36:18.158110 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=100 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:36:18.189336 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e815e9c-4be3-4bdf-a44b-af83eb508d00 None None] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:36:18.214054 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b891dd58-a2b5-471d-b167-1e1edc1edef3 None admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:36:18.224365 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db87682-43fe-47e7-b7be-ab9f778d83ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:36:18.225047 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db87682-43fe-47e7-b7be-ab9f778d83ae None admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:36:18.225409 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db87682-43fe-47e7-b7be-ab9f778d83ae None admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:36:18.225766 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db87682-43fe-47e7-b7be-ab9f778d83ae None admin] PATH_INFO: `/v3/services` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:36:18.226472 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db87682-43fe-47e7-b7be-ab9f778d83ae None admin] RBAC: Adding query filter params (type=object-store) {{(pid=87956) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:36:18.226832 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db87682-43fe-47e7-b7be-ab9f778d83ae None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:36:18.228308 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db87682-43fe-47e7-b7be-ab9f778d83ae None admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:36:18.232670 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 326/649] 10.222.0.42 () {56 vars in 1122 bytes} [Sun Oct 30 00:36:18 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:36:18.233434 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db87682-43fe-47e7-b7be-ab9f778d83ae None admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:36:18.260277 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3c5907-c98f-4d1f-8d4b-9255e7677a22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:36:18.261232 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3c5907-c98f-4d1f-8d4b-9255e7677a22 None admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:36:18.261813 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3c5907-c98f-4d1f-8d4b-9255e7677a22 None admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:36:18.262250 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3c5907-c98f-4d1f-8d4b-9255e7677a22 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:36:18.277952 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3c5907-c98f-4d1f-8d4b-9255e7677a22 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 30 00:36:18.283016 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application [None req-0f3c5907-c98f-4d1f-8d4b-9255e7677a22 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 30 00:36:18.283016 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:36:18.283016 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:36:18.283016 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:36:18.283016 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:36:18.283016 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:36:18.283016 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:36:18.283016 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:36:18.283016 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:36:18.283016 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:36:18.283016 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:36:18.283016 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:36:18.283016 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 30 00:36:18.283016 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 30 00:36:18.283016 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 30 00:36:18.283016 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 30 00:36:18.284046 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 30 00:36:18.284046 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 30 00:36:18.284046 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 30 00:36:18.284046 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 30 00:36:18.284046 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:36:18.284046 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:36:18.284046 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:36:18.284046 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:36:18.284046 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:36:18.284046 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:36:18.284046 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:36:18.284046 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application with Lock( Oct 30 00:36:18.284046 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:36:18.284046 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:36:18.284046 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:36:18.284046 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:36:18.284862 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:36:18.284862 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:36:18.284862 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:36:18.284862 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:36:18.284862 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 30 00:36:18.284862 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 30 00:36:18.284862 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 30 00:36:18.284862 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 30 00:36:18.284862 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 30 00:36:18.284862 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 30 00:36:18.284862 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 30 00:36:18.284862 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application Oct 30 00:36:18.284862 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 324/650] 10.222.0.42 () {56 vars in 1120 bytes} [Sun Oct 30 00:36:18 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:36:18.290501 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3c5907-c98f-4d1f-8d4b-9255e7677a22 None admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:36:18.295532 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=100 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:36:18.368596 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db87682-43fe-47e7-b7be-ab9f778d83ae None admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:36:18.404574 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0c071a-1f10-491a-892e-9a88409d5470 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:36:18.405183 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0c071a-1f10-491a-892e-9a88409d5470 None admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:36:18.405463 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0c071a-1f10-491a-892e-9a88409d5470 None admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:36:18.405737 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0c071a-1f10-491a-892e-9a88409d5470 None admin] PATH_INFO: `/v3/services` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:36:18.406375 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0c071a-1f10-491a-892e-9a88409d5470 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=87956) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:36:18.406681 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0c071a-1f10-491a-892e-9a88409d5470 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:36:18.408084 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0c071a-1f10-491a-892e-9a88409d5470 None admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:36:18.410154 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=100 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:36:18.413828 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 327/651] 10.222.0.42 () {56 vars in 1126 bytes} [Sun Oct 30 00:36:18 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:36:18.415088 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0c071a-1f10-491a-892e-9a88409d5470 None admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:36:18.416131 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3c5907-c98f-4d1f-8d4b-9255e7677a22 None admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:36:18.456431 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc594f5-e2f9-46ce-8fb0-84b7ae455e1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:36:18.457772 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc594f5-e2f9-46ce-8fb0-84b7ae455e1a None admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:36:18.458055 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc594f5-e2f9-46ce-8fb0-84b7ae455e1a None admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:36:18.458328 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc594f5-e2f9-46ce-8fb0-84b7ae455e1a None admin] PATH_INFO: `/v3/roles` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:36:18.458998 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc594f5-e2f9-46ce-8fb0-84b7ae455e1a None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=87955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:36:18.459338 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc594f5-e2f9-46ce-8fb0-84b7ae455e1a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:36:18.460777 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc594f5-e2f9-46ce-8fb0-84b7ae455e1a None admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:36:18.473577 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 325/652] 10.222.0.42 () {56 vars in 1115 bytes} [Sun Oct 30 00:36:18 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:36:18.474462 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc594f5-e2f9-46ce-8fb0-84b7ae455e1a None admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:36:18.527298 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0c071a-1f10-491a-892e-9a88409d5470 None admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:36:18.536863 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=100 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:36:18.562594 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fe77e2-9870-465e-a002-dcf7b72e62ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:36:18.563651 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fe77e2-9870-465e-a002-dcf7b72e62ad None admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:36:18.564122 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fe77e2-9870-465e-a002-dcf7b72e62ad None admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:36:18.564579 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fe77e2-9870-465e-a002-dcf7b72e62ad None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:36:18.565370 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86fe77e2-9870-465e-a002-dcf7b72e62ad None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:36:18.567055 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86fe77e2-9870-465e-a002-dcf7b72e62ad None admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:36:18.577331 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application [None req-86fe77e2-9870-465e-a002-dcf7b72e62ad None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 30 00:36:18.577331 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:36:18.577331 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 30 00:36:18.577331 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 30 00:36:18.577331 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 30 00:36:18.577331 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 30 00:36:18.577331 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 30 00:36:18.577331 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 30 00:36:18.577331 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 30 00:36:18.577331 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application Oct 30 00:36:18.577331 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 30 00:36:18.577331 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application Oct 30 00:36:18.577331 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:36:18.577331 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:36:18.577331 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:36:18.577331 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:36:18.577331 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:36:18.578298 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:36:18.578298 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:36:18.578298 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:36:18.578298 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:36:18.578298 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:36:18.578298 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:36:18.578298 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 30 00:36:18.578298 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 30 00:36:18.578298 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 30 00:36:18.578298 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 30 00:36:18.578298 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:36:18.578298 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:36:18.578298 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:36:18.578298 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:36:18.578298 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:36:18.578298 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:36:18.579152 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:36:18.579152 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application with Lock( Oct 30 00:36:18.579152 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:36:18.579152 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:36:18.579152 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:36:18.579152 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:36:18.579152 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:36:18.579152 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:36:18.579152 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:36:18.579152 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:36:18.579152 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 30 00:36:18.579152 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 30 00:36:18.579152 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 30 00:36:18.579152 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application Oct 30 00:36:18.580067 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc594f5-e2f9-46ce-8fb0-84b7ae455e1a None admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:36:18.582055 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 328/653] 10.222.0.42 () {56 vars in 1114 bytes} [Sun Oct 30 00:36:18 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:36:18.582727 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fe77e2-9870-465e-a002-dcf7b72e62ad None admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:36:18.613407 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999cc3c9-53f0-435b-b4b3-751068857472 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:36:18.614014 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999cc3c9-53f0-435b-b4b3-751068857472 None admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:36:18.614290 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999cc3c9-53f0-435b-b4b3-751068857472 None admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:36:18.614609 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999cc3c9-53f0-435b-b4b3-751068857472 None admin] PATH_INFO: `/v3/services` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:36:18.615348 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999cc3c9-53f0-435b-b4b3-751068857472 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=87955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:36:18.615652 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999cc3c9-53f0-435b-b4b3-751068857472 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:36:18.617156 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999cc3c9-53f0-435b-b4b3-751068857472 None admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:36:18.621879 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 326/654] 10.222.0.42 () {56 vars in 1126 bytes} [Sun Oct 30 00:36:18 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:36:18.626809 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999cc3c9-53f0-435b-b4b3-751068857472 None admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:36:18.656044 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=100 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:36:18.695552 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fe77e2-9870-465e-a002-dcf7b72e62ad None admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:36:18.729317 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1314893d-f530-4f82-9d3c-1dabca568d70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:36:18.729522 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999cc3c9-53f0-435b-b4b3-751068857472 None admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:36:18.729874 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1314893d-f530-4f82-9d3c-1dabca568d70 None admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:36:18.730152 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1314893d-f530-4f82-9d3c-1dabca568d70 None admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:36:18.730413 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1314893d-f530-4f82-9d3c-1dabca568d70 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:36:18.741192 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1314893d-f530-4f82-9d3c-1dabca568d70 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:36:18.742634 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1314893d-f530-4f82-9d3c-1dabca568d70 None admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:36:18.756493 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application [None req-1314893d-f530-4f82-9d3c-1dabca568d70 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 30 00:36:18.756493 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:36:18.756493 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:36:18.756493 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:36:18.756493 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:36:18.756493 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:36:18.756493 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:36:18.756493 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:36:18.756493 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:36:18.756493 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:36:18.756493 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:36:18.756493 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:36:18.756493 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 30 00:36:18.756493 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 30 00:36:18.756493 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 30 00:36:18.756493 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 30 00:36:18.757624 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:36:18.757624 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:36:18.757624 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:36:18.757624 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:36:18.757624 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:36:18.757624 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:36:18.757624 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:36:18.757624 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application with Lock( Oct 30 00:36:18.757624 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:36:18.757624 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:36:18.757624 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:36:18.757624 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:36:18.757624 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:36:18.757624 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:36:18.757624 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:36:18.757624 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:36:18.757624 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 30 00:36:18.758531 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 30 00:36:18.758531 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 30 00:36:18.758531 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application Oct 30 00:36:18.758531 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 329/655] 10.222.0.42 () {56 vars in 1108 bytes} [Sun Oct 30 00:36:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:36:18.759621 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=100 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:36:18.763313 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1314893d-f530-4f82-9d3c-1dabca568d70 None admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:36:18.768675 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62ad327-c67b-49ab-bd6c-6e934bce2219 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:36:18.769508 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62ad327-c67b-49ab-bd6c-6e934bce2219 None admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:36:18.769971 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62ad327-c67b-49ab-bd6c-6e934bce2219 None admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:36:18.770421 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62ad327-c67b-49ab-bd6c-6e934bce2219 None admin] PATH_INFO: `/v3/services` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:36:18.771280 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62ad327-c67b-49ab-bd6c-6e934bce2219 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=87955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:36:18.771769 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62ad327-c67b-49ab-bd6c-6e934bce2219 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:36:18.773505 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62ad327-c67b-49ab-bd6c-6e934bce2219 None admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:36:18.779015 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 327/656] 10.222.0.42 () {56 vars in 1114 bytes} [Sun Oct 30 00:36:18 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:36:18.780032 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62ad327-c67b-49ab-bd6c-6e934bce2219 None admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:36:18.872183 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1314893d-f530-4f82-9d3c-1dabca568d70 None admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:36:18.888354 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62ad327-c67b-49ab-bd6c-6e934bce2219 None admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:36:18.889871 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=100 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:36:18.908618 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4efbfb-124e-46e7-8970-91870681a8d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:36:18.909231 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4efbfb-124e-46e7-8970-91870681a8d8 None admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:36:18.909507 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4efbfb-124e-46e7-8970-91870681a8d8 None admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:36:18.909774 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4efbfb-124e-46e7-8970-91870681a8d8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:36:18.910472 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4efbfb-124e-46e7-8970-91870681a8d8 None admin] RBAC: Adding query filter params (interface=public, service_id=21a5175f74e840c18fd6f5f3a983bbeb, region_id=RegionOne) {{(pid=87956) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:36:18.910774 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4efbfb-124e-46e7-8970-91870681a8d8 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:36:18.912174 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4efbfb-124e-46e7-8970-91870681a8d8 None admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:36:18.924133 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 330/657] 10.222.0.42 () {56 vars in 1251 bytes} [Sun Oct 30 00:36:18 2022] GET /identity/v3/endpoints?service_id=21a5175f74e840c18fd6f5f3a983bbeb&interface=public®ion_id=RegionOne => generated 194 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:36:18.924133 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4efbfb-124e-46e7-8970-91870681a8d8 None admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:36:18.929711 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316c88c1-9f01-4de0-bc6a-2a775856cf4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:36:18.930390 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316c88c1-9f01-4de0-bc6a-2a775856cf4b None admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:36:18.930728 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316c88c1-9f01-4de0-bc6a-2a775856cf4b None admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:36:18.931058 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316c88c1-9f01-4de0-bc6a-2a775856cf4b None admin] PATH_INFO: `/v3/domains` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:36:18.931802 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316c88c1-9f01-4de0-bc6a-2a775856cf4b None admin] RBAC: Adding query filter params (name=Default) {{(pid=87955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:36:18.932156 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316c88c1-9f01-4de0-bc6a-2a775856cf4b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:36:18.933583 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316c88c1-9f01-4de0-bc6a-2a775856cf4b None admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:36:18.952341 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 328/658] 10.222.0.42 () {56 vars in 1109 bytes} [Sun Oct 30 00:36:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:36:18.952341 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316c88c1-9f01-4de0-bc6a-2a775856cf4b None admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:36:19.006226 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=100 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:36:19.032414 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4efbfb-124e-46e7-8970-91870681a8d8 None admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:36:19.062169 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316c88c1-9f01-4de0-bc6a-2a775856cf4b None admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:36:19.068672 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44327d21-8bcf-402f-887a-d6e39f9b4ef2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:36:19.068672 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44327d21-8bcf-402f-887a-d6e39f9b4ef2 None admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:36:19.068672 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44327d21-8bcf-402f-887a-d6e39f9b4ef2 None admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:36:19.068672 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44327d21-8bcf-402f-887a-d6e39f9b4ef2 None admin] PATH_INFO: `/v3/services` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:36:19.069037 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44327d21-8bcf-402f-887a-d6e39f9b4ef2 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=87956) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:36:19.069037 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44327d21-8bcf-402f-887a-d6e39f9b4ef2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:36:19.070079 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44327d21-8bcf-402f-887a-d6e39f9b4ef2 None admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:36:19.075068 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 331/659] 10.222.0.42 () {56 vars in 1114 bytes} [Sun Oct 30 00:36:18 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:36:19.075961 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44327d21-8bcf-402f-887a-d6e39f9b4ef2 None admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:36:19.107998 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a10d5d9-ee4c-4606-9e9b-e46305b6fe9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:36:19.108623 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a10d5d9-ee4c-4606-9e9b-e46305b6fe9c None admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:36:19.108898 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a10d5d9-ee4c-4606-9e9b-e46305b6fe9c None admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:36:19.109164 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a10d5d9-ee4c-4606-9e9b-e46305b6fe9c None admin] PATH_INFO: `/v3/services` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:36:19.109927 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a10d5d9-ee4c-4606-9e9b-e46305b6fe9c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:36:19.111553 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a10d5d9-ee4c-4606-9e9b-e46305b6fe9c None admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:36:19.123842 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 329/660] 10.222.0.42 () {56 vars in 1087 bytes} [Sun Oct 30 00:36:18 2022] GET /identity/v3/services => generated 1029 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 00:36:19.150986 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=100 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:36:19.217370 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44327d21-8bcf-402f-887a-d6e39f9b4ef2 None admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:36:19.262626 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb483342-efc5-44bf-89f0-854a1ff091c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:36:19.263218 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb483342-efc5-44bf-89f0-854a1ff091c0 None admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:36:19.263497 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb483342-efc5-44bf-89f0-854a1ff091c0 None admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:36:19.263762 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb483342-efc5-44bf-89f0-854a1ff091c0 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:36:19.272995 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb483342-efc5-44bf-89f0-854a1ff091c0 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:36:19.274470 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb483342-efc5-44bf-89f0-854a1ff091c0 None admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:36:19.287623 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application [None req-eb483342-efc5-44bf-89f0-854a1ff091c0 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 30 00:36:19.287623 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:36:19.287623 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:36:19.287623 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:36:19.287623 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:36:19.287623 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:36:19.287623 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:36:19.287623 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:36:19.287623 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:36:19.287623 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:36:19.287623 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:36:19.287623 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:36:19.287623 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 30 00:36:19.287623 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 30 00:36:19.287623 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 30 00:36:19.287623 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 30 00:36:19.288808 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:36:19.288808 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:36:19.288808 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 30 00:36:19.288808 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 30 00:36:19.288808 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 30 00:36:19.288808 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 30 00:36:19.288808 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:36:19.288808 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:36:19.288808 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:36:19.288808 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:36:19.288808 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:36:19.288808 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application with Lock( Oct 30 00:36:19.288808 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:36:19.288808 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:36:19.288808 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:36:19.288808 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:36:19.288808 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:36:19.288808 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:36:19.289771 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:36:19.289771 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:36:19.289771 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 30 00:36:19.289771 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 30 00:36:19.289771 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 30 00:36:19.289771 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 30 00:36:19.289771 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 30 00:36:19.289771 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 30 00:36:19.289771 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 30 00:36:19.289771 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application Oct 30 00:36:19.289771 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 332/661] 10.222.0.42 () {56 vars in 1117 bytes} [Sun Oct 30 00:36:19 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:36:19.294915 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a10d5d9-ee4c-4606-9e9b-e46305b6fe9c None admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:36:19.406292 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a10d5d9-ee4c-4606-9e9b-e46305b6fe9c None admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:36:19.422715 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=100 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:36:19.446877 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fe4723-708a-4bd8-821b-09a0c3fbea93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:36:19.447512 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fe4723-708a-4bd8-821b-09a0c3fbea93 None admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:36:19.447785 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fe4723-708a-4bd8-821b-09a0c3fbea93 None admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:36:19.448053 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fe4723-708a-4bd8-821b-09a0c3fbea93 None admin] PATH_INFO: `/v3/users` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:36:19.448779 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8fe4723-708a-4bd8-821b-09a0c3fbea93 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=87955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:36:19.449075 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8fe4723-708a-4bd8-821b-09a0c3fbea93 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:36:19.450555 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8fe4723-708a-4bd8-821b-09a0c3fbea93 None admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:36:19.469467 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 330/662] 10.222.0.42 () {56 vars in 1149 bytes} [Sun Oct 30 00:36:19 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:36:19.480344 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb483342-efc5-44bf-89f0-854a1ff091c0 None admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:36:19.586281 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb483342-efc5-44bf-89f0-854a1ff091c0 None admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:36:19.588709 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=100 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:36:19.622417 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabfa0ac-b16a-4e19-9825-6ba669232aab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:36:19.623051 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabfa0ac-b16a-4e19-9825-6ba669232aab None admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:36:19.623358 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabfa0ac-b16a-4e19-9825-6ba669232aab None admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:36:19.623629 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabfa0ac-b16a-4e19-9825-6ba669232aab None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:36:19.636293 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabfa0ac-b16a-4e19-9825-6ba669232aab None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:36:19.637769 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabfa0ac-b16a-4e19-9825-6ba669232aab None admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:36:19.653154 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application [None req-aabfa0ac-b16a-4e19-9825-6ba669232aab None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 30 00:36:19.653154 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:36:19.653154 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:36:19.653154 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:36:19.653154 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:36:19.653154 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:36:19.653154 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:36:19.653154 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:36:19.653154 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:36:19.653154 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:36:19.653154 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:36:19.653154 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:36:19.653154 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 30 00:36:19.653154 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 30 00:36:19.653154 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 30 00:36:19.653154 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 30 00:36:19.654328 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:36:19.654328 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:36:19.654328 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:36:19.654328 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:36:19.654328 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:36:19.654328 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:36:19.654328 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:36:19.654328 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application with Lock( Oct 30 00:36:19.654328 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:36:19.654328 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:36:19.654328 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:36:19.654328 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:36:19.654328 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:36:19.654328 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:36:19.654328 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:36:19.654328 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:36:19.654328 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 30 00:36:19.655543 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 30 00:36:19.655543 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 30 00:36:19.655543 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application Oct 30 00:36:19.655543 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 333/663] 10.222.0.42 () {56 vars in 1108 bytes} [Sun Oct 30 00:36:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:36:19.660067 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fe4723-708a-4bd8-821b-09a0c3fbea93 None admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:36:19.764586 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fe4723-708a-4bd8-821b-09a0c3fbea93 None admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:36:19.798886 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ab6745-9972-463b-86ba-31a63715f021 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:36:19.799761 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ab6745-9972-463b-86ba-31a63715f021 None admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:36:19.800202 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ab6745-9972-463b-86ba-31a63715f021 None admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:36:19.800617 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ab6745-9972-463b-86ba-31a63715f021 None admin] PATH_INFO: `/v3/domains` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:36:19.801415 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ab6745-9972-463b-86ba-31a63715f021 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:36:19.801856 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ab6745-9972-463b-86ba-31a63715f021 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:36:19.803540 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ab6745-9972-463b-86ba-31a63715f021 None admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:36:19.815746 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 331/664] 10.222.0.42 () {56 vars in 1109 bytes} [Sun Oct 30 00:36:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 30 00:36:19.821227 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabfa0ac-b16a-4e19-9825-6ba669232aab None admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:36:19.929747 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabfa0ac-b16a-4e19-9825-6ba669232aab None admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:36:19.965467 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e8bd09-771e-4adb-98ca-9accc5b3570c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:36:19.966426 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e8bd09-771e-4adb-98ca-9accc5b3570c None admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:36:19.966871 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e8bd09-771e-4adb-98ca-9accc5b3570c None admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:36:19.967344 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e8bd09-771e-4adb-98ca-9accc5b3570c None admin] PATH_INFO: `/v3/projects/service` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:36:19.974859 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e8bd09-771e-4adb-98ca-9accc5b3570c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:36:19.976596 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e8bd09-771e-4adb-98ca-9accc5b3570c None admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:36:19.988510 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application [None req-00e8bd09-771e-4adb-98ca-9accc5b3570c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 30 00:36:19.988510 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:36:19.988510 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:36:19.988510 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:36:19.988510 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:36:19.988510 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:36:19.988510 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:36:19.988510 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:36:19.988510 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:36:19.988510 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:36:19.988510 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:36:19.988510 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:36:19.988510 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 30 00:36:19.988510 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 30 00:36:19.988510 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 30 00:36:19.989408 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 30 00:36:19.989408 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:36:19.989408 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:36:19.989408 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:36:19.989408 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:36:19.989408 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:36:19.989408 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:36:19.989408 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:36:19.989408 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application with Lock( Oct 30 00:36:19.989408 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:36:19.989408 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:36:19.989408 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:36:19.989408 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:36:19.989408 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:36:19.989408 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:36:19.989408 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:36:19.989408 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:36:19.990292 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 30 00:36:19.990292 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 30 00:36:19.990292 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 30 00:36:19.990292 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 30 00:36:19.990292 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 30 00:36:19.990292 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 30 00:36:19.990292 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 30 00:36:19.990292 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application Oct 30 00:36:19.992545 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 334/665] 10.222.0.42 () {56 vars in 1111 bytes} [Sun Oct 30 00:36:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:36:20.000340 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ab6745-9972-463b-86ba-31a63715f021 None admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:36:20.036485 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=100 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:36:20.107540 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ab6745-9972-463b-86ba-31a63715f021 None admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:36:20.143133 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7d94ac-47ab-4abd-b5f5-64e48b575490 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:36:20.143766 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7d94ac-47ab-4abd-b5f5-64e48b575490 None admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:36:20.144038 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7d94ac-47ab-4abd-b5f5-64e48b575490 None admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:36:20.144304 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7d94ac-47ab-4abd-b5f5-64e48b575490 None admin] PATH_INFO: `/v3/projects` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:36:20.145000 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7d94ac-47ab-4abd-b5f5-64e48b575490 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:36:20.145299 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7d94ac-47ab-4abd-b5f5-64e48b575490 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:36:20.146731 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7d94ac-47ab-4abd-b5f5-64e48b575490 None admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:36:20.159746 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 332/666] 10.222.0.42 () {56 vars in 1148 bytes} [Sun Oct 30 00:36:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:36:20.165649 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e8bd09-771e-4adb-98ca-9accc5b3570c None admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:36:20.184951 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=100 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:36:20.270855 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e8bd09-771e-4adb-98ca-9accc5b3570c None admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:36:20.304962 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e74eb3d-e7b6-4aae-95a8-f043dcb4fd5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:36:20.305683 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e74eb3d-e7b6-4aae-95a8-f043dcb4fd5c None admin] REQUEST_METHOD: `PUT` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:36:20.305959 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e74eb3d-e7b6-4aae-95a8-f043dcb4fd5c None admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:36:20.306270 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e74eb3d-e7b6-4aae-95a8-f043dcb4fd5c None admin] PATH_INFO: `/v3/projects/17d2387fdf794d4eaef07bbcd7b39f2a/users/3e7b21b55fb84a6cad507a8954492d48/roles/a64bec5660434fb2831dc60bad3c0d2f` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:36:20.308419 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e74eb3d-e7b6-4aae-95a8-f043dcb4fd5c None admin] RBAC: Authorizing `identity:create_grant(project_id=17d2387fdf794d4eaef07bbcd7b39f2a, user_id=3e7b21b55fb84a6cad507a8954492d48, role_id=a64bec5660434fb2831dc60bad3c0d2f)` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:36:20.309843 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e74eb3d-e7b6-4aae-95a8-f043dcb4fd5c None admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:36:20.325442 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 335/667] 10.222.0.42 () {58 vars in 1439 bytes} [Sun Oct 30 00:36:20 2022] PUT /identity/v3/projects/17d2387fdf794d4eaef07bbcd7b39f2a/users/3e7b21b55fb84a6cad507a8954492d48/roles/a64bec5660434fb2831dc60bad3c0d2f => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 00:36:20.471945 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bd7dbe-e701-4050-ab7d-36fb211bc6ab None None] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:36:20.472452 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bd7dbe-e701-4050-ab7d-36fb211bc6ab None None] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:36:20.472452 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bd7dbe-e701-4050-ab7d-36fb211bc6ab None None] PATH_INFO: `/` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:36:20.473986 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 333/668] 10.222.0.42 () {54 vars in 927 bytes} [Sun Oct 30 00:36:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:36:20.479808 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac00d4f-1446-4546-b193-b5035ac2208c None None] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:36:20.480089 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac00d4f-1446-4546-b193-b5035ac2208c None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:36:20.480361 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac00d4f-1446-4546-b193-b5035ac2208c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:36:20.499799 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.auth.core [None req-6ac00d4f-1446-4546-b193-b5035ac2208c None None] MFA Rules not processed for user `eb55b6cbca4945abb21b0e49eb745e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=87956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:36:20.501016 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-6ac00d4f-1446-4546-b193-b5035ac2208c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:36:20.570445 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 336/669] 10.222.0.42 () {58 vars in 1024 bytes} [Sun Oct 30 00:36:20 2022] POST /identity/v3/auth/tokens => generated 1271 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 30 00:36:20.831508 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bd7dbe-e701-4050-ab7d-36fb211bc6ab None None] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:36:20.928175 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=100 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:36:20.936314 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bd7dbe-e701-4050-ab7d-36fb211bc6ab None None] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:36:20.971863 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28f2d4e-3e08-495b-b30c-fb9cd83f5296 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:36:20.972468 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28f2d4e-3e08-495b-b30c-fb9cd83f5296 None admin] REQUEST_METHOD: `POST` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:36:20.972733 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28f2d4e-3e08-495b-b30c-fb9cd83f5296 None admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:36:20.972995 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28f2d4e-3e08-495b-b30c-fb9cd83f5296 None admin] PATH_INFO: `/v3/services` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:36:20.973659 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28f2d4e-3e08-495b-b30c-fb9cd83f5296 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:36:20.975074 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28f2d4e-3e08-495b-b30c-fb9cd83f5296 None admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:36:20.993472 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 334/670] 10.222.0.42 () {60 vars in 1141 bytes} [Sun Oct 30 00:36:20 2022] POST /identity/v3/services => generated 241 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 00:36:21.362378 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10b05dc-519f-478c-983e-fd0c618a4349 None None] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:36:21.362794 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10b05dc-519f-478c-983e-fd0c618a4349 None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:36:21.362969 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10b05dc-519f-478c-983e-fd0c618a4349 None None] PATH_INFO: `/` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:36:21.364579 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 337/671] 10.222.0.42 () {54 vars in 927 bytes} [Sun Oct 30 00:36:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:36:21.370088 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3ef0fa-901a-457f-b8f7-47013e37011d None None] REQUEST_METHOD: `POST` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:36:21.370375 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3ef0fa-901a-457f-b8f7-47013e37011d None None] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:36:21.370650 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3ef0fa-901a-457f-b8f7-47013e37011d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:36:21.388541 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.auth.core [None req-8b3ef0fa-901a-457f-b8f7-47013e37011d None None] MFA Rules not processed for user `eb55b6cbca4945abb21b0e49eb745e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=87955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:36:21.389736 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-8b3ef0fa-901a-457f-b8f7-47013e37011d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:36:21.452676 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53cd69b-84a0-4193-92c0-286193e8ff7b None None] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:36:21.453030 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53cd69b-84a0-4193-92c0-286193e8ff7b None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:36:21.453220 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53cd69b-84a0-4193-92c0-286193e8ff7b None None] PATH_INFO: `/` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:36:21.458606 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 338/672] 10.222.0.42 () {54 vars in 927 bytes} [Sun Oct 30 00:36:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:36:21.460809 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeaed813-ab16-450a-8737-a5f27ea4a76c None None] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:36:21.461091 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeaed813-ab16-450a-8737-a5f27ea4a76c None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:36:21.461365 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeaed813-ab16-450a-8737-a5f27ea4a76c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:36:21.464756 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 335/673] 10.222.0.42 () {58 vars in 1024 bytes} [Sun Oct 30 00:36:21 2022] POST /identity/v3/auth/tokens => generated 1373 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 30 00:36:21.474640 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:36:21.480315 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.auth.core [None req-eeaed813-ab16-450a-8737-a5f27ea4a76c None None] MFA Rules not processed for user `eb55b6cbca4945abb21b0e49eb745e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=87956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:36:21.481509 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-eeaed813-ab16-450a-8737-a5f27ea4a76c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:36:21.559321 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 339/674] 10.222.0.42 () {58 vars in 1024 bytes} [Sun Oct 30 00:36:21 2022] POST /identity/v3/auth/tokens => generated 1373 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 30 00:36:21.754397 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3ef0fa-901a-457f-b8f7-47013e37011d None None] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:36:21.832229 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:36:21.843426 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeaed813-ab16-450a-8737-a5f27ea4a76c None None] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:36:21.862548 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3ef0fa-901a-457f-b8f7-47013e37011d None None] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:36:21.902430 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fdd33c-3969-46fb-8c93-9576d84736c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:36:21.903476 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fdd33c-3969-46fb-8c93-9576d84736c2 None admin] REQUEST_METHOD: `POST` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:36:21.903754 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fdd33c-3969-46fb-8c93-9576d84736c2 None admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:36:21.904024 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fdd33c-3969-46fb-8c93-9576d84736c2 None admin] PATH_INFO: `/v3/services` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:36:21.904697 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73fdd33c-3969-46fb-8c93-9576d84736c2 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:36:21.906845 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73fdd33c-3969-46fb-8c93-9576d84736c2 None admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:36:21.930252 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 336/675] 10.222.0.42 () {60 vars in 1141 bytes} [Sun Oct 30 00:36:21 2022] POST /identity/v3/services => generated 251 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 00:36:21.971129 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeaed813-ab16-450a-8737-a5f27ea4a76c None None] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:36:22.012451 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=100 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:36:22.017964 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d72374-6e87-4ebe-b5ac-77706ee4dc16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:36:22.018628 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d72374-6e87-4ebe-b5ac-77706ee4dc16 None admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:36:22.018946 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d72374-6e87-4ebe-b5ac-77706ee4dc16 None admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:36:22.019240 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d72374-6e87-4ebe-b5ac-77706ee4dc16 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:36:22.020147 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d72374-6e87-4ebe-b5ac-77706ee4dc16 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:36:22.021920 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d72374-6e87-4ebe-b5ac-77706ee4dc16 None admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:36:22.031984 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application [None req-99d72374-6e87-4ebe-b5ac-77706ee4dc16 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 30 00:36:22.031984 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:36:22.031984 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 30 00:36:22.031984 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 30 00:36:22.031984 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 30 00:36:22.031984 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 30 00:36:22.031984 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 30 00:36:22.031984 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 30 00:36:22.031984 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 30 00:36:22.031984 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application Oct 30 00:36:22.031984 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 30 00:36:22.031984 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application Oct 30 00:36:22.031984 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:36:22.031984 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:36:22.031984 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:36:22.031984 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:36:22.034218 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:36:22.034218 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:36:22.034218 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:36:22.034218 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:36:22.034218 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:36:22.034218 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:36:22.034218 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:36:22.034218 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 30 00:36:22.034218 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 30 00:36:22.034218 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 30 00:36:22.034218 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 30 00:36:22.034218 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:36:22.034218 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:36:22.034218 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:36:22.034218 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:36:22.034218 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:36:22.034218 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:36:22.036375 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:36:22.036375 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application with Lock( Oct 30 00:36:22.036375 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:36:22.036375 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:36:22.036375 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:36:22.036375 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:36:22.036375 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:36:22.036375 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:36:22.036375 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:36:22.036375 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:36:22.036375 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 30 00:36:22.036375 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 30 00:36:22.036375 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 30 00:36:22.036375 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application Oct 30 00:36:22.043228 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 340/676] 10.222.0.42 () {56 vars in 1132 bytes} [Sun Oct 30 00:36:21 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 30 00:36:22.043517 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fdd33c-3969-46fb-8c93-9576d84736c2 None admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:36:22.148589 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fdd33c-3969-46fb-8c93-9576d84736c2 None admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:36:22.183129 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f18c2b-757d-4c7a-a20e-6452085c93cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:36:22.183769 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f18c2b-757d-4c7a-a20e-6452085c93cf None admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:36:22.184047 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f18c2b-757d-4c7a-a20e-6452085c93cf None admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:36:22.184313 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f18c2b-757d-4c7a-a20e-6452085c93cf None admin] PATH_INFO: `/v3/services` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:36:22.184949 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f18c2b-757d-4c7a-a20e-6452085c93cf None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=87955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:36:22.185250 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f18c2b-757d-4c7a-a20e-6452085c93cf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:36:22.186605 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f18c2b-757d-4c7a-a20e-6452085c93cf None admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:36:22.195312 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 337/677] 10.222.0.42 () {56 vars in 1126 bytes} [Sun Oct 30 00:36:22 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:36:22.197827 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d72374-6e87-4ebe-b5ac-77706ee4dc16 None admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:36:22.302787 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d72374-6e87-4ebe-b5ac-77706ee4dc16 None admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:36:22.337901 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4e2bfa-7bd9-4101-92ea-0769d93d6f6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:36:22.338514 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4e2bfa-7bd9-4101-92ea-0769d93d6f6d None admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:36:22.338790 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4e2bfa-7bd9-4101-92ea-0769d93d6f6d None admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:36:22.339057 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4e2bfa-7bd9-4101-92ea-0769d93d6f6d None admin] PATH_INFO: `/v3/services` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:36:22.339715 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4e2bfa-7bd9-4101-92ea-0769d93d6f6d None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=87956) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:36:22.340015 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4e2bfa-7bd9-4101-92ea-0769d93d6f6d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:36:22.341372 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4e2bfa-7bd9-4101-92ea-0769d93d6f6d None admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:36:22.351138 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 341/678] 10.222.0.42 () {56 vars in 1126 bytes} [Sun Oct 30 00:36:22 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:36:22.352479 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f18c2b-757d-4c7a-a20e-6452085c93cf None admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:36:22.356410 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:36:22.451999 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f18c2b-757d-4c7a-a20e-6452085c93cf None admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:36:22.497491 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf521625-7d41-4f1b-9969-2bcabd09d13a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:36:22.498208 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf521625-7d41-4f1b-9969-2bcabd09d13a None admin] REQUEST_METHOD: `POST` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:36:22.498490 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf521625-7d41-4f1b-9969-2bcabd09d13a None admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:36:22.498762 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf521625-7d41-4f1b-9969-2bcabd09d13a None admin] PATH_INFO: `/v3/endpoints` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:36:22.499609 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf521625-7d41-4f1b-9969-2bcabd09d13a None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:36:22.501031 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf521625-7d41-4f1b-9969-2bcabd09d13a None admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:36:22.523917 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 338/679] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 30 00:36:22 2022] POST /identity/v3/endpoints => generated 347 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 00:36:22.587629 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9784c9-bf09-44cf-afc2-dd0f5be949bd None None] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:36:22.588598 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9784c9-bf09-44cf-afc2-dd0f5be949bd None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:36:22.589097 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9784c9-bf09-44cf-afc2-dd0f5be949bd None None] PATH_INFO: `/` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:36:22.591173 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 342/680] 10.222.0.42 () {54 vars in 927 bytes} [Sun Oct 30 00:36:22 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:36:22.601414 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0ab86a-7969-464a-9237-33ba9ef9827e None None] REQUEST_METHOD: `POST` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:36:22.602068 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0ab86a-7969-464a-9237-33ba9ef9827e None None] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:36:22.602589 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0ab86a-7969-464a-9237-33ba9ef9827e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:36:22.623402 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.auth.core [None req-3a0ab86a-7969-464a-9237-33ba9ef9827e None None] MFA Rules not processed for user `eb55b6cbca4945abb21b0e49eb745e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=87955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:36:22.625201 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-3a0ab86a-7969-464a-9237-33ba9ef9827e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:36:22.690153 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:36:22.713576 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 339/681] 10.222.0.42 () {58 vars in 1024 bytes} [Sun Oct 30 00:36:22 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 30 00:36:22.976703 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9784c9-bf09-44cf-afc2-dd0f5be949bd None None] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:36:23.039502 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=100 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:36:23.096591 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9784c9-bf09-44cf-afc2-dd0f5be949bd None None] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:36:23.131657 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b270978-3af5-454f-8833-f5362871e0c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:36:23.132298 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b270978-3af5-454f-8833-f5362871e0c0 None admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:36:23.132572 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b270978-3af5-454f-8833-f5362871e0c0 None admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:36:23.132836 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b270978-3af5-454f-8833-f5362871e0c0 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:36:23.143784 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b270978-3af5-454f-8833-f5362871e0c0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 30 00:36:23.148704 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application [None req-4b270978-3af5-454f-8833-f5362871e0c0 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 30 00:36:23.148704 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:36:23.148704 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:36:23.148704 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:36:23.148704 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:36:23.148704 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:36:23.148704 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:36:23.148704 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:36:23.148704 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:36:23.148704 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:36:23.148704 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:36:23.148704 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:36:23.148704 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 30 00:36:23.148704 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 30 00:36:23.148704 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 30 00:36:23.148704 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 30 00:36:23.149628 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 30 00:36:23.149628 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 30 00:36:23.149628 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 30 00:36:23.149628 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 30 00:36:23.149628 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:36:23.149628 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:36:23.149628 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:36:23.149628 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:36:23.149628 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:36:23.149628 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:36:23.149628 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:36:23.149628 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application with Lock( Oct 30 00:36:23.149628 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:36:23.149628 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:36:23.149628 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:36:23.149628 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:36:23.150497 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:36:23.150497 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:36:23.150497 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:36:23.150497 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:36:23.150497 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 30 00:36:23.150497 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 30 00:36:23.150497 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 30 00:36:23.150497 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 30 00:36:23.150497 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 30 00:36:23.150497 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 30 00:36:23.150497 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 30 00:36:23.150497 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application Oct 30 00:36:23.154833 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 343/682] 10.222.0.42 () {56 vars in 1120 bytes} [Sun Oct 30 00:36:22 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:36:23.156200 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0ab86a-7969-464a-9237-33ba9ef9827e None None] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:36:23.176114 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6931760-29bb-40bf-9a69-6d53e16c4c03 None None] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:36:23.176404 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6931760-29bb-40bf-9a69-6d53e16c4c03 None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:36:23.179316 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6931760-29bb-40bf-9a69-6d53e16c4c03 None None] PATH_INFO: `/` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:36:23.179316 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 344/683] 10.222.0.42 () {54 vars in 927 bytes} [Sun Oct 30 00:36:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 30 00:36:23.184436 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b19a903-7d46-4bce-a12c-195930abec02 None None] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:36:23.184714 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b19a903-7d46-4bce-a12c-195930abec02 None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:36:23.184986 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b19a903-7d46-4bce-a12c-195930abec02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:36:23.204617 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.auth.core [None req-5b19a903-7d46-4bce-a12c-195930abec02 None None] MFA Rules not processed for user `eb55b6cbca4945abb21b0e49eb745e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=87956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:36:23.206052 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-5b19a903-7d46-4bce-a12c-195930abec02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:36:23.265063 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0ab86a-7969-464a-9237-33ba9ef9827e None None] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:36:23.283426 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 345/684] 10.222.0.42 () {58 vars in 1024 bytes} [Sun Oct 30 00:36:23 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 30 00:36:23.303056 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b37ac9-68b9-41df-b544-098648988ff3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:36:23.303737 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b37ac9-68b9-41df-b544-098648988ff3 None admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:36:23.304016 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b37ac9-68b9-41df-b544-098648988ff3 None admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:36:23.304286 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b37ac9-68b9-41df-b544-098648988ff3 None admin] PATH_INFO: `/v3/roles` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:36:23.304968 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b37ac9-68b9-41df-b544-098648988ff3 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=87955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:36:23.305271 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b37ac9-68b9-41df-b544-098648988ff3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:36:23.306780 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b37ac9-68b9-41df-b544-098648988ff3 None admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:36:23.315545 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 340/685] 10.222.0.42 () {56 vars in 1115 bytes} [Sun Oct 30 00:36:23 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:36:23.321259 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b19a903-7d46-4bce-a12c-195930abec02 None None] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:36:23.372379 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=100 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:36:23.423827 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b19a903-7d46-4bce-a12c-195930abec02 None None] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:36:23.458793 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcfa8c0-2017-4ebc-80a0-a0cc3a3108ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:36:23.459468 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcfa8c0-2017-4ebc-80a0-a0cc3a3108ac None admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:36:23.459750 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcfa8c0-2017-4ebc-80a0-a0cc3a3108ac None admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:36:23.460018 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcfa8c0-2017-4ebc-80a0-a0cc3a3108ac None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:36:23.470567 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edcfa8c0-2017-4ebc-80a0-a0cc3a3108ac None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:36:23.472025 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edcfa8c0-2017-4ebc-80a0-a0cc3a3108ac None admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:36:23.487420 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application [None req-edcfa8c0-2017-4ebc-80a0-a0cc3a3108ac None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 30 00:36:23.487420 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:36:23.487420 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:36:23.487420 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:36:23.487420 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:36:23.487420 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:36:23.487420 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:36:23.487420 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:36:23.487420 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:36:23.487420 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:36:23.487420 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:36:23.487420 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:36:23.487420 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 30 00:36:23.487420 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 30 00:36:23.487420 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 30 00:36:23.487420 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 30 00:36:23.488422 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:36:23.488422 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:36:23.488422 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:36:23.488422 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:36:23.488422 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:36:23.488422 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:36:23.488422 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:36:23.488422 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application with Lock( Oct 30 00:36:23.488422 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:36:23.488422 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:36:23.488422 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:36:23.488422 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:36:23.488422 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:36:23.488422 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:36:23.488422 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:36:23.488422 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:36:23.488422 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 30 00:36:23.489330 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 30 00:36:23.489330 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 30 00:36:23.489330 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application Oct 30 00:36:23.493726 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 346/686] 10.222.0.42 () {56 vars in 1108 bytes} [Sun Oct 30 00:36:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:36:23.495272 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b37ac9-68b9-41df-b544-098648988ff3 None admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:36:23.546141 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=100 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:36:23.605607 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b37ac9-68b9-41df-b544-098648988ff3 None admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:36:23.606744 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcfa8c0-2017-4ebc-80a0-a0cc3a3108ac None admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:36:23.647616 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34d33e6-03fb-404c-a19a-af134c581768 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:36:23.648553 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34d33e6-03fb-404c-a19a-af134c581768 None admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:36:23.648830 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34d33e6-03fb-404c-a19a-af134c581768 None admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:36:23.649099 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34d33e6-03fb-404c-a19a-af134c581768 None admin] PATH_INFO: `/v3/domains` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:36:23.649760 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34d33e6-03fb-404c-a19a-af134c581768 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:36:23.650056 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34d33e6-03fb-404c-a19a-af134c581768 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:36:23.651490 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34d33e6-03fb-404c-a19a-af134c581768 None admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:36:23.669245 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 341/687] 10.222.0.42 () {56 vars in 1109 bytes} [Sun Oct 30 00:36:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:36:23.671031 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34d33e6-03fb-404c-a19a-af134c581768 None admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:36:23.747503 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcfa8c0-2017-4ebc-80a0-a0cc3a3108ac None admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:36:23.750252 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=100 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:36:23.788375 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34d33e6-03fb-404c-a19a-af134c581768 None admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:36:23.800750 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=100 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:36:23.802049 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba011a9-97e8-45df-aecc-b9eb50c6c86a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:36:23.803629 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba011a9-97e8-45df-aecc-b9eb50c6c86a None admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:36:23.803960 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba011a9-97e8-45df-aecc-b9eb50c6c86a None admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:36:23.804660 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba011a9-97e8-45df-aecc-b9eb50c6c86a None admin] PATH_INFO: `/v3/services/object-store` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:36:23.805936 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba011a9-97e8-45df-aecc-b9eb50c6c86a None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:36:23.807708 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba011a9-97e8-45df-aecc-b9eb50c6c86a None admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:36:23.821361 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application [None req-dba011a9-97e8-45df-aecc-b9eb50c6c86a None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 30 00:36:23.821361 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:36:23.821361 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 30 00:36:23.821361 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 30 00:36:23.821361 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 30 00:36:23.821361 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 30 00:36:23.821361 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 30 00:36:23.821361 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 30 00:36:23.821361 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 30 00:36:23.821361 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application Oct 30 00:36:23.821361 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 30 00:36:23.821361 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application Oct 30 00:36:23.821361 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:36:23.821361 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:36:23.821361 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:36:23.821361 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:36:23.821361 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:36:23.822932 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:36:23.822932 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:36:23.822932 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:36:23.822932 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:36:23.822932 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:36:23.822932 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:36:23.822932 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 30 00:36:23.822932 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 30 00:36:23.822932 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 30 00:36:23.822932 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 30 00:36:23.822932 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:36:23.822932 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:36:23.822932 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:36:23.822932 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:36:23.822932 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:36:23.822932 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:36:23.824380 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:36:23.824380 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application with Lock( Oct 30 00:36:23.824380 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:36:23.824380 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:36:23.824380 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:36:23.824380 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:36:23.824380 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:36:23.824380 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:36:23.824380 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:36:23.824380 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:36:23.824380 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 30 00:36:23.824380 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 30 00:36:23.824380 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 30 00:36:23.824380 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application Oct 30 00:36:23.824380 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 347/688] 10.222.0.42 () {56 vars in 1126 bytes} [Sun Oct 30 00:36:23 2022] GET /identity/v3/services/object-store => generated 93 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:36:23.830638 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba011a9-97e8-45df-aecc-b9eb50c6c86a None admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:36:23.837529 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe0cfe4-99ed-485e-b469-d97c39e8e28c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:36:23.838170 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe0cfe4-99ed-485e-b469-d97c39e8e28c None admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:36:23.838446 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe0cfe4-99ed-485e-b469-d97c39e8e28c None admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:36:23.838712 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe0cfe4-99ed-485e-b469-d97c39e8e28c None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:36:23.846836 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe0cfe4-99ed-485e-b469-d97c39e8e28c None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:36:23.848440 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe0cfe4-99ed-485e-b469-d97c39e8e28c None admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:36:23.862132 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application [None req-fbe0cfe4-99ed-485e-b469-d97c39e8e28c None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 30 00:36:23.862132 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:36:23.862132 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:36:23.862132 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:36:23.862132 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:36:23.862132 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:36:23.862132 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:36:23.862132 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:36:23.862132 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:36:23.862132 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:36:23.862132 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:36:23.862132 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:36:23.862132 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 30 00:36:23.862132 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 30 00:36:23.862132 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 30 00:36:23.862132 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 30 00:36:23.864411 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:36:23.864411 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:36:23.864411 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 30 00:36:23.864411 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 30 00:36:23.864411 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 30 00:36:23.864411 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 30 00:36:23.864411 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:36:23.864411 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:36:23.864411 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:36:23.864411 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:36:23.864411 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:36:23.864411 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application with Lock( Oct 30 00:36:23.864411 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:36:23.864411 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:36:23.864411 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:36:23.864411 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:36:23.864411 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:36:23.864411 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:36:23.866678 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:36:23.866678 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:36:23.866678 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 30 00:36:23.866678 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 30 00:36:23.866678 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 30 00:36:23.866678 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 30 00:36:23.866678 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 30 00:36:23.866678 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 30 00:36:23.866678 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 30 00:36:23.866678 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application Oct 30 00:36:23.867919 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 342/689] 10.222.0.42 () {56 vars in 1117 bytes} [Sun Oct 30 00:36:23 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 30 00:36:23.869686 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe0cfe4-99ed-485e-b469-d97c39e8e28c None admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:36:23.968748 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba011a9-97e8-45df-aecc-b9eb50c6c86a None admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:36:23.998688 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe0cfe4-99ed-485e-b469-d97c39e8e28c None admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:36:24.015081 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4385c6-7a52-42c1-93b9-ee5051570efc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:36:24.016196 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4385c6-7a52-42c1-93b9-ee5051570efc None admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:36:24.016951 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4385c6-7a52-42c1-93b9-ee5051570efc None admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:36:24.017424 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4385c6-7a52-42c1-93b9-ee5051570efc None admin] PATH_INFO: `/v3/services` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:36:24.018252 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4385c6-7a52-42c1-93b9-ee5051570efc None admin] RBAC: Adding query filter params (name=object-store) {{(pid=87956) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:36:24.018762 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4385c6-7a52-42c1-93b9-ee5051570efc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:36:24.021095 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4385c6-7a52-42c1-93b9-ee5051570efc None admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:36:24.033015 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 348/690] 10.222.0.42 () {56 vars in 1122 bytes} [Sun Oct 30 00:36:23 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 30 00:36:24.034469 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4385c6-7a52-42c1-93b9-ee5051570efc None admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:36:24.043957 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c82d38d-0cb0-45a8-adbf-bfecc827103e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:36:24.044914 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c82d38d-0cb0-45a8-adbf-bfecc827103e None admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:36:24.045386 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c82d38d-0cb0-45a8-adbf-bfecc827103e None admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:36:24.046155 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c82d38d-0cb0-45a8-adbf-bfecc827103e None admin] PATH_INFO: `/v3/users` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:36:24.047390 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c82d38d-0cb0-45a8-adbf-bfecc827103e None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=87955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:36:24.050882 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c82d38d-0cb0-45a8-adbf-bfecc827103e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:36:24.052560 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c82d38d-0cb0-45a8-adbf-bfecc827103e None admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:36:24.075026 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=100 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:36:24.083629 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 343/691] 10.222.0.42 () {56 vars in 1149 bytes} [Sun Oct 30 00:36:23 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 30 00:36:24.088433 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c82d38d-0cb0-45a8-adbf-bfecc827103e None admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:36:24.123255 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=100 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:36:24.161734 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4385c6-7a52-42c1-93b9-ee5051570efc None admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:36:24.198574 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1532e775-2575-4547-8adf-aa3bc8b826e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:36:24.199249 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1532e775-2575-4547-8adf-aa3bc8b826e7 None admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:36:24.199517 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1532e775-2575-4547-8adf-aa3bc8b826e7 None admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:36:24.199778 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1532e775-2575-4547-8adf-aa3bc8b826e7 None admin] PATH_INFO: `/v3/services` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:36:24.200432 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1532e775-2575-4547-8adf-aa3bc8b826e7 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=87956) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:36:24.200737 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1532e775-2575-4547-8adf-aa3bc8b826e7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:36:24.202431 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1532e775-2575-4547-8adf-aa3bc8b826e7 None admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:36:24.207648 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 349/692] 10.222.0.42 () {56 vars in 1122 bytes} [Sun Oct 30 00:36:24 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 30 00:36:24.211229 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559265b1-1ca2-45b6-986d-ed2b8819a2cc None None] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:36:24.211229 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559265b1-1ca2-45b6-986d-ed2b8819a2cc None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:36:24.211229 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559265b1-1ca2-45b6-986d-ed2b8819a2cc None None] PATH_INFO: `/` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:36:24.211229 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 350/693] 10.222.0.42 () {54 vars in 927 bytes} [Sun Oct 30 00:36:24 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:36:24.214519 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559265b1-1ca2-45b6-986d-ed2b8819a2cc None None] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:36:24.221483 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c82d38d-0cb0-45a8-adbf-bfecc827103e None admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:36:24.258449 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3de0828-4c78-4eb6-ae81-1c32dc8c131c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:36:24.259054 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3de0828-4c78-4eb6-ae81-1c32dc8c131c None admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:36:24.259373 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3de0828-4c78-4eb6-ae81-1c32dc8c131c None admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:36:24.259642 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3de0828-4c78-4eb6-ae81-1c32dc8c131c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:36:24.306388 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=100 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:36:24.314894 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559265b1-1ca2-45b6-986d-ed2b8819a2cc None None] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:36:24.331019 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3de0828-4c78-4eb6-ae81-1c32dc8c131c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:36:24.332550 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3de0828-4c78-4eb6-ae81-1c32dc8c131c None admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:36:24.349711 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3f99e2-1828-4114-9a3e-9f5a93768f74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:36:24.350401 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3f99e2-1828-4114-9a3e-9f5a93768f74 None admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:36:24.350684 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3f99e2-1828-4114-9a3e-9f5a93768f74 None admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:36:24.350958 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3f99e2-1828-4114-9a3e-9f5a93768f74 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:36:24.351704 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3f99e2-1828-4114-9a3e-9f5a93768f74 None admin] RBAC: Adding query filter params (interface=public, service_id=8749b28654104ca88a0c85117dd2840f, region_id=RegionOne) {{(pid=87956) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:36:24.352007 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3f99e2-1828-4114-9a3e-9f5a93768f74 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:36:24.353417 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3f99e2-1828-4114-9a3e-9f5a93768f74 None admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:36:24.363249 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 351/694] 10.222.0.42 () {56 vars in 1251 bytes} [Sun Oct 30 00:36:24 2022] GET /identity/v3/endpoints?service_id=8749b28654104ca88a0c85117dd2840f&interface=public®ion_id=RegionOne => generated 194 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 30 00:36:24.363249 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb997dc-51bd-43f8-a8ac-f47b1f62cb04 None None] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:36:24.363249 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb997dc-51bd-43f8-a8ac-f47b1f62cb04 None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:36:24.363249 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb997dc-51bd-43f8-a8ac-f47b1f62cb04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:36:24.363944 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=100 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:36:24.379820 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.auth.core [None req-cbb997dc-51bd-43f8-a8ac-f47b1f62cb04 None None] MFA Rules not processed for user `eb55b6cbca4945abb21b0e49eb745e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=87956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:36:24.381046 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-cbb997dc-51bd-43f8-a8ac-f47b1f62cb04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:36:24.441642 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 344/695] 10.222.0.42 () {58 vars in 1282 bytes} [Sun Oct 30 00:36:24 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Oct 30 00:36:24.442737 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3de0828-4c78-4eb6-ae81-1c32dc8c131c None admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:36:24.450763 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 352/696] 10.222.0.42 () {58 vars in 1024 bytes} [Sun Oct 30 00:36:24 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 30 00:36:24.452042 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb997dc-51bd-43f8-a8ac-f47b1f62cb04 None None] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:36:24.556067 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3de0828-4c78-4eb6-ae81-1c32dc8c131c None admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:36:24.572574 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=100 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:36:24.586180 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=100 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:36:24.593732 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb997dc-51bd-43f8-a8ac-f47b1f62cb04 None None] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:36:24.597609 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fb46e4-e70a-4c82-a9a0-6f5b6b4efca5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:36:24.598381 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fb46e4-e70a-4c82-a9a0-6f5b6b4efca5 None admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:36:24.598770 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fb46e4-e70a-4c82-a9a0-6f5b6b4efca5 None admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:36:24.599116 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fb46e4-e70a-4c82-a9a0-6f5b6b4efca5 None admin] PATH_INFO: `/v3/services` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:36:24.599833 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2fb46e4-e70a-4c82-a9a0-6f5b6b4efca5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:36:24.601395 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2fb46e4-e70a-4c82-a9a0-6f5b6b4efca5 None admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:36:24.609536 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 345/697] 10.222.0.42 () {56 vars in 1087 bytes} [Sun Oct 30 00:36:24 2022] GET /identity/v3/services => generated 1497 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 00:36:24.636956 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94171603-7303-44c7-934a-9b640c56c08e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:36:24.637630 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94171603-7303-44c7-934a-9b640c56c08e None admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:36:24.638661 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94171603-7303-44c7-934a-9b640c56c08e None admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:36:24.638661 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94171603-7303-44c7-934a-9b640c56c08e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:36:24.650884 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94171603-7303-44c7-934a-9b640c56c08e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:36:24.652449 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94171603-7303-44c7-934a-9b640c56c08e None admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:36:24.669520 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application [None req-94171603-7303-44c7-934a-9b640c56c08e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 30 00:36:24.669520 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:36:24.669520 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:36:24.669520 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:36:24.669520 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:36:24.669520 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:36:24.669520 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:36:24.669520 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:36:24.669520 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:36:24.669520 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:36:24.669520 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:36:24.669520 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:36:24.669520 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 30 00:36:24.669520 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 30 00:36:24.669520 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 30 00:36:24.669520 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 30 00:36:24.670589 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:36:24.670589 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:36:24.670589 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:36:24.670589 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:36:24.670589 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:36:24.670589 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:36:24.670589 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:36:24.670589 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application with Lock( Oct 30 00:36:24.670589 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:36:24.670589 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:36:24.670589 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:36:24.670589 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:36:24.670589 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:36:24.670589 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:36:24.670589 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:36:24.670589 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:36:24.670589 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 30 00:36:24.671497 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 30 00:36:24.671497 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 30 00:36:24.671497 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application Oct 30 00:36:24.671497 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 353/698] 10.222.0.42 () {56 vars in 1108 bytes} [Sun Oct 30 00:36:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:36:24.677005 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fb46e4-e70a-4c82-a9a0-6f5b6b4efca5 None admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:36:24.766699 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94171603-7303-44c7-934a-9b640c56c08e None admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:36:24.798019 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fb46e4-e70a-4c82-a9a0-6f5b6b4efca5 None admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:36:24.838366 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f70291-c48b-4c66-9af9-06b9f39157c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:36:24.839999 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f70291-c48b-4c66-9af9-06b9f39157c4 None admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:36:24.839999 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f70291-c48b-4c66-9af9-06b9f39157c4 None admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:36:24.839999 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f70291-c48b-4c66-9af9-06b9f39157c4 None admin] PATH_INFO: `/v3/domains` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:36:24.840779 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f70291-c48b-4c66-9af9-06b9f39157c4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:36:24.841249 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f70291-c48b-4c66-9af9-06b9f39157c4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:36:24.842657 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f70291-c48b-4c66-9af9-06b9f39157c4 None admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:36:24.858007 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 346/699] 10.222.0.42 () {56 vars in 1109 bytes} [Sun Oct 30 00:36:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:36:24.865298 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f70291-c48b-4c66-9af9-06b9f39157c4 None admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:36:24.892098 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94171603-7303-44c7-934a-9b640c56c08e None admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:36:24.919979 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=100 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:36:24.928142 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebff0b1-aea3-4f70-9b24-f59aac148757 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:36:24.929165 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebff0b1-aea3-4f70-9b24-f59aac148757 None admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:36:24.929632 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebff0b1-aea3-4f70-9b24-f59aac148757 None admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:36:24.930088 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebff0b1-aea3-4f70-9b24-f59aac148757 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:36:24.930838 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebff0b1-aea3-4f70-9b24-f59aac148757 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:36:24.932471 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebff0b1-aea3-4f70-9b24-f59aac148757 None admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:36:24.941603 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application [None req-6ebff0b1-aea3-4f70-9b24-f59aac148757 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 30 00:36:24.941603 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:36:24.941603 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 30 00:36:24.941603 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 30 00:36:24.941603 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 30 00:36:24.941603 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 30 00:36:24.941603 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 30 00:36:24.941603 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 30 00:36:24.941603 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 30 00:36:24.941603 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application Oct 30 00:36:24.941603 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 30 00:36:24.941603 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application Oct 30 00:36:24.941603 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:36:24.941603 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:36:24.941603 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:36:24.941603 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:36:24.941603 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:36:24.942639 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:36:24.942639 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:36:24.942639 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:36:24.942639 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:36:24.942639 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:36:24.942639 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:36:24.942639 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 30 00:36:24.942639 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 30 00:36:24.942639 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 30 00:36:24.942639 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 30 00:36:24.942639 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:36:24.942639 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:36:24.942639 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:36:24.942639 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:36:24.942639 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:36:24.942639 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:36:24.943519 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:36:24.943519 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application with Lock( Oct 30 00:36:24.943519 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:36:24.943519 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:36:24.943519 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:36:24.943519 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:36:24.943519 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:36:24.943519 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:36:24.943519 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:36:24.943519 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:36:24.943519 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 30 00:36:24.943519 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 30 00:36:24.943519 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 30 00:36:24.943519 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application Oct 30 00:36:24.949737 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 354/700] 10.222.0.42 () {56 vars in 1114 bytes} [Sun Oct 30 00:36:24 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:36:24.949737 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b24623-34e0-4a46-b76a-7f8632a0b302 None None] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:36:24.949737 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b24623-34e0-4a46-b76a-7f8632a0b302 None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:36:24.949737 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b24623-34e0-4a46-b76a-7f8632a0b302 None None] PATH_INFO: `/` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:36:24.951784 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 355/701] 10.222.0.42 () {54 vars in 927 bytes} [Sun Oct 30 00:36:24 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:36:24.952578 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b24623-34e0-4a46-b76a-7f8632a0b302 None None] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:36:24.958278 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=100 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:36:24.982197 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f70291-c48b-4c66-9af9-06b9f39157c4 None admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:36:25.018870 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aaa4fe6-f7a1-41b6-8269-ac9c44848f46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:36:25.019627 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aaa4fe6-f7a1-41b6-8269-ac9c44848f46 None admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:36:25.019905 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aaa4fe6-f7a1-41b6-8269-ac9c44848f46 None admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:36:25.020179 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aaa4fe6-f7a1-41b6-8269-ac9c44848f46 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:36:25.027439 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aaa4fe6-f7a1-41b6-8269-ac9c44848f46 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:36:25.028877 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aaa4fe6-f7a1-41b6-8269-ac9c44848f46 None admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:36:25.040423 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application [None req-3aaa4fe6-f7a1-41b6-8269-ac9c44848f46 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 30 00:36:25.040423 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:36:25.040423 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:36:25.040423 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:36:25.040423 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:36:25.040423 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:36:25.040423 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:36:25.040423 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:36:25.040423 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:36:25.040423 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:36:25.040423 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:36:25.040423 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:36:25.040423 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 30 00:36:25.040423 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 30 00:36:25.040423 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 30 00:36:25.041301 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 30 00:36:25.041301 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:36:25.041301 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:36:25.041301 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:36:25.041301 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:36:25.041301 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:36:25.041301 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:36:25.041301 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:36:25.041301 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application with Lock( Oct 30 00:36:25.041301 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:36:25.041301 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:36:25.041301 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:36:25.041301 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:36:25.041301 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:36:25.041301 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:36:25.041301 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:36:25.041301 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:36:25.042182 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 30 00:36:25.042182 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 30 00:36:25.042182 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 30 00:36:25.042182 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 30 00:36:25.042182 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 30 00:36:25.042182 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 30 00:36:25.042182 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 30 00:36:25.042182 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application Oct 30 00:36:25.046411 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 347/702] 10.222.0.42 () {56 vars in 1111 bytes} [Sun Oct 30 00:36:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:36:25.047544 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8340b6-d342-4f82-8769-38dde86a2b82 None None] REQUEST_METHOD: `POST` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:36:25.050503 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8340b6-d342-4f82-8769-38dde86a2b82 None None] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:36:25.050503 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8340b6-d342-4f82-8769-38dde86a2b82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:36:25.066805 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.auth.core [None req-6c8340b6-d342-4f82-8769-38dde86a2b82 None None] MFA Rules not processed for user `eb55b6cbca4945abb21b0e49eb745e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=87955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:36:25.068203 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-6c8340b6-d342-4f82-8769-38dde86a2b82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:36:25.069473 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b24623-34e0-4a46-b76a-7f8632a0b302 None None] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:36:25.106619 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7b64a8-a233-4387-bf73-ba701b6560d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:36:25.107151 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7b64a8-a233-4387-bf73-ba701b6560d4 None admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:36:25.107459 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7b64a8-a233-4387-bf73-ba701b6560d4 None admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:36:25.107727 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7b64a8-a233-4387-bf73-ba701b6560d4 None admin] PATH_INFO: `/v3/services` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:36:25.108359 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7b64a8-a233-4387-bf73-ba701b6560d4 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=87956) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:36:25.108656 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7b64a8-a233-4387-bf73-ba701b6560d4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:36:25.110011 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7b64a8-a233-4387-bf73-ba701b6560d4 None admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:36:25.115380 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 356/703] 10.222.0.42 () {56 vars in 1114 bytes} [Sun Oct 30 00:36:24 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:36:25.116381 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7b64a8-a233-4387-bf73-ba701b6560d4 None admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:36:25.145612 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 348/704] 10.222.0.42 () {58 vars in 1024 bytes} [Sun Oct 30 00:36:25 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 30 00:36:25.146476 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8340b6-d342-4f82-8769-38dde86a2b82 None None] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:36:25.197146 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=100 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:36:25.200377 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=100 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:36:25.240167 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7b64a8-a233-4387-bf73-ba701b6560d4 None admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:36:25.267404 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8340b6-d342-4f82-8769-38dde86a2b82 None None] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:36:25.285945 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce4dafc-181f-4687-bbea-5d267d8a7876 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:36:25.286627 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce4dafc-181f-4687-bbea-5d267d8a7876 None admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:36:25.286909 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce4dafc-181f-4687-bbea-5d267d8a7876 None admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:36:25.287180 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce4dafc-181f-4687-bbea-5d267d8a7876 None admin] PATH_INFO: `/v3/projects` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:36:25.287938 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce4dafc-181f-4687-bbea-5d267d8a7876 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87956) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:36:25.288241 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce4dafc-181f-4687-bbea-5d267d8a7876 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:36:25.290337 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce4dafc-181f-4687-bbea-5d267d8a7876 None admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:36:25.307234 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 357/705] 10.222.0.42 () {56 vars in 1148 bytes} [Sun Oct 30 00:36:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:36:25.312674 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a63fb3c-2106-473e-b2bc-5e2215ace2b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:36:25.313196 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce4dafc-181f-4687-bbea-5d267d8a7876 None admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:36:25.313411 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a63fb3c-2106-473e-b2bc-5e2215ace2b1 None admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:36:25.313770 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a63fb3c-2106-473e-b2bc-5e2215ace2b1 None admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:36:25.314122 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a63fb3c-2106-473e-b2bc-5e2215ace2b1 None admin] PATH_INFO: `/v3/services` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:36:25.314834 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a63fb3c-2106-473e-b2bc-5e2215ace2b1 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=87955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:36:25.315226 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a63fb3c-2106-473e-b2bc-5e2215ace2b1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:36:25.317061 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a63fb3c-2106-473e-b2bc-5e2215ace2b1 None admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:36:25.323733 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 349/706] 10.222.0.42 () {56 vars in 1114 bytes} [Sun Oct 30 00:36:25 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:36:25.329374 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a63fb3c-2106-473e-b2bc-5e2215ace2b1 None admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:36:25.429486 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a63fb3c-2106-473e-b2bc-5e2215ace2b1 None admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:36:25.430751 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce4dafc-181f-4687-bbea-5d267d8a7876 None admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:36:25.431749 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=100 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:36:25.459366 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=100 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:36:25.467484 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e045ec64-90db-4040-b676-dca586c798bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:36:25.467929 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b3d79c-08fb-4d3f-b703-25dc758af180 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:36:25.468116 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e045ec64-90db-4040-b676-dca586c798bf None admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:36:25.468356 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e045ec64-90db-4040-b676-dca586c798bf None admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:36:25.468517 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b3d79c-08fb-4d3f-b703-25dc758af180 None admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:36:25.468623 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e045ec64-90db-4040-b676-dca586c798bf None admin] PATH_INFO: `/v3/endpoints` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:36:25.468795 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b3d79c-08fb-4d3f-b703-25dc758af180 None admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:36:25.469061 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b3d79c-08fb-4d3f-b703-25dc758af180 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:36:25.469305 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e045ec64-90db-4040-b676-dca586c798bf None admin] RBAC: Adding query filter params (interface=public, service_id=c751debc6097412c82be06d339a78e90, region_id=RegionOne) {{(pid=87955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:36:25.469607 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e045ec64-90db-4040-b676-dca586c798bf None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:36:25.469776 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b3d79c-08fb-4d3f-b703-25dc758af180 None admin] RBAC: Adding query filter params (role.id=a64bec5660434fb2831dc60bad3c0d2f, scope.project.id=17d2387fdf794d4eaef07bbcd7b39f2a, user.id=3e7b21b55fb84a6cad507a8954492d48) {{(pid=87956) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:36:25.470081 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b3d79c-08fb-4d3f-b703-25dc758af180 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:36:25.470964 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e045ec64-90db-4040-b676-dca586c798bf None admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:36:25.471512 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b3d79c-08fb-4d3f-b703-25dc758af180 None admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:36:25.485862 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 358/707] 10.222.0.42 () {56 vars in 1374 bytes} [Sun Oct 30 00:36:25 2022] GET /identity/v3/role_assignments?user.id=3e7b21b55fb84a6cad507a8954492d48&scope.project.id=17d2387fdf794d4eaef07bbcd7b39f2a&role.id=a64bec5660434fb2831dc60bad3c0d2f => generated 608 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:36:25.485862 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b3d79c-08fb-4d3f-b703-25dc758af180 None admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:36:25.486168 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 350/708] 10.222.0.42 () {56 vars in 1251 bytes} [Sun Oct 30 00:36:25 2022] GET /identity/v3/endpoints?service_id=c751debc6097412c82be06d339a78e90&interface=public®ion_id=RegionOne => generated 194 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 30 00:36:25.486168 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e045ec64-90db-4040-b676-dca586c798bf None admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:36:25.618937 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e045ec64-90db-4040-b676-dca586c798bf None admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:36:25.626684 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b3d79c-08fb-4d3f-b703-25dc758af180 None admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:36:25.669888 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc643ae-756d-4f08-b946-8c721f79c9b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:36:25.670647 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc643ae-756d-4f08-b946-8c721f79c9b7 None admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:36:25.671012 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc643ae-756d-4f08-b946-8c721f79c9b7 None admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:36:25.671477 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc643ae-756d-4f08-b946-8c721f79c9b7 None admin] PATH_INFO: `/v3/services` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:36:25.672163 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc643ae-756d-4f08-b946-8c721f79c9b7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:36:25.673624 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc643ae-756d-4f08-b946-8c721f79c9b7 None admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:36:25.681630 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac3bd5e-05e1-4e02-ac76-fe18179f63f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:36:25.682314 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac3bd5e-05e1-4e02-ac76-fe18179f63f9 None admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:36:25.682597 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac3bd5e-05e1-4e02-ac76-fe18179f63f9 None admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:36:25.682868 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac3bd5e-05e1-4e02-ac76-fe18179f63f9 None admin] PATH_INFO: `/v3/services/compute` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:36:25.683493 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac3bd5e-05e1-4e02-ac76-fe18179f63f9 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:36:25.684877 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac3bd5e-05e1-4e02-ac76-fe18179f63f9 None admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:36:25.691610 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 351/709] 10.222.0.42 () {56 vars in 1087 bytes} [Sun Oct 30 00:36:25 2022] GET /identity/v3/services => generated 1497 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 00:36:25.695400 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application [None req-6ac3bd5e-05e1-4e02-ac76-fe18179f63f9 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Oct 30 00:36:25.695400 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:36:25.695400 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 30 00:36:25.695400 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 30 00:36:25.695400 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 30 00:36:25.695400 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 30 00:36:25.695400 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 30 00:36:25.695400 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 30 00:36:25.695400 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 30 00:36:25.695400 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application Oct 30 00:36:25.695400 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 30 00:36:25.695400 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application Oct 30 00:36:25.695400 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:36:25.695400 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:36:25.695400 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:36:25.695400 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:36:25.695400 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:36:25.696573 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:36:25.696573 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:36:25.696573 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:36:25.696573 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:36:25.696573 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:36:25.696573 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:36:25.696573 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 30 00:36:25.696573 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 30 00:36:25.696573 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 30 00:36:25.696573 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 30 00:36:25.696573 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:36:25.696573 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:36:25.696573 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:36:25.696573 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:36:25.696573 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:36:25.696573 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:36:25.697778 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:36:25.697778 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application with Lock( Oct 30 00:36:25.697778 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:36:25.697778 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:36:25.697778 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:36:25.697778 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:36:25.697778 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:36:25.697778 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:36:25.697778 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:36:25.697778 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:36:25.697778 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 30 00:36:25.697778 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 30 00:36:25.697778 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 30 00:36:25.697778 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application Oct 30 00:36:25.697778 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 359/710] 10.222.0.42 () {56 vars in 1111 bytes} [Sun Oct 30 00:36:25 2022] GET /identity/v3/services/compute => generated 88 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:36:25.706094 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc643ae-756d-4f08-b946-8c721f79c9b7 None admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:36:25.741708 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=100 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:36:25.831331 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc643ae-756d-4f08-b946-8c721f79c9b7 None admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:36:25.872510 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56602e83-a356-4281-b099-249b13c775dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:36:25.873550 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56602e83-a356-4281-b099-249b13c775dd None admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:36:25.873857 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56602e83-a356-4281-b099-249b13c775dd None admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:36:25.874156 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56602e83-a356-4281-b099-249b13c775dd None admin] PATH_INFO: `/v3/services` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:36:25.875089 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56602e83-a356-4281-b099-249b13c775dd None admin] RBAC: Adding query filter params (name=compute) {{(pid=87955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:36:25.875475 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56602e83-a356-4281-b099-249b13c775dd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:36:25.877027 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56602e83-a356-4281-b099-249b13c775dd None admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:36:25.883135 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 352/711] 10.222.0.42 () {56 vars in 1112 bytes} [Sun Oct 30 00:36:25 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:36:25.889438 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac3bd5e-05e1-4e02-ac76-fe18179f63f9 None admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:36:25.953634 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=100 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:36:26.003671 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac3bd5e-05e1-4e02-ac76-fe18179f63f9 None admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:36:26.041400 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60dd331c-38e2-4873-8e9d-e29b57687e59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:36:26.042073 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dd331c-38e2-4873-8e9d-e29b57687e59 None admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:36:26.042388 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dd331c-38e2-4873-8e9d-e29b57687e59 None admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:36:26.042688 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dd331c-38e2-4873-8e9d-e29b57687e59 None admin] PATH_INFO: `/v3/services` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:36:26.043416 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60dd331c-38e2-4873-8e9d-e29b57687e59 None admin] RBAC: Adding query filter params (type=compute) {{(pid=87956) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:36:26.043745 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60dd331c-38e2-4873-8e9d-e29b57687e59 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:36:26.045259 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60dd331c-38e2-4873-8e9d-e29b57687e59 None admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:36:26.055723 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 360/712] 10.222.0.42 () {56 vars in 1112 bytes} [Sun Oct 30 00:36:25 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:36:26.797012 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53adb627-3c12-4beb-aee0-b5d9c5d735a5 None None] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:36:26.797534 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53adb627-3c12-4beb-aee0-b5d9c5d735a5 None None] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:36:26.797534 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53adb627-3c12-4beb-aee0-b5d9c5d735a5 None None] PATH_INFO: `/` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:36:26.799173 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 353/713] 10.222.0.42 () {54 vars in 927 bytes} [Sun Oct 30 00:36:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:36:26.805061 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310b2d00-efe0-46de-ad5d-e039c82e51de None None] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:36:26.805480 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310b2d00-efe0-46de-ad5d-e039c82e51de None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:36:26.805720 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310b2d00-efe0-46de-ad5d-e039c82e51de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:36:26.824783 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.auth.core [None req-310b2d00-efe0-46de-ad5d-e039c82e51de None None] MFA Rules not processed for user `eb55b6cbca4945abb21b0e49eb745e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=87956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:36:26.826030 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-310b2d00-efe0-46de-ad5d-e039c82e51de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:36:26.899318 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 361/714] 10.222.0.42 () {58 vars in 1024 bytes} [Sun Oct 30 00:36:26 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 30 00:36:27.152753 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53adb627-3c12-4beb-aee0-b5d9c5d735a5 None None] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:36:27.247473 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=100 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:36:27.258873 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53adb627-3c12-4beb-aee0-b5d9c5d735a5 None None] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:36:27.296273 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d965d6-5add-491b-bc16-f17f48ffa7e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:36:27.296951 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d965d6-5add-491b-bc16-f17f48ffa7e6 None admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:36:27.297255 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d965d6-5add-491b-bc16-f17f48ffa7e6 None admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:36:27.297581 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d965d6-5add-491b-bc16-f17f48ffa7e6 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:36:27.298244 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d965d6-5add-491b-bc16-f17f48ffa7e6 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:36:27.299799 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d965d6-5add-491b-bc16-f17f48ffa7e6 None admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:36:27.309598 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application [None req-62d965d6-5add-491b-bc16-f17f48ffa7e6 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 30 00:36:27.309598 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:36:27.309598 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 30 00:36:27.309598 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 30 00:36:27.309598 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 30 00:36:27.309598 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 30 00:36:27.309598 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 30 00:36:27.309598 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 30 00:36:27.309598 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 30 00:36:27.309598 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application Oct 30 00:36:27.309598 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 30 00:36:27.309598 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application Oct 30 00:36:27.309598 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:36:27.309598 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:36:27.309598 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:36:27.309598 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:36:27.309598 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:36:27.310610 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:36:27.310610 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:36:27.310610 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:36:27.310610 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:36:27.310610 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:36:27.310610 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:36:27.310610 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 30 00:36:27.310610 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 30 00:36:27.310610 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 30 00:36:27.310610 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 30 00:36:27.310610 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:36:27.310610 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:36:27.310610 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:36:27.310610 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:36:27.310610 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:36:27.310610 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:36:27.311487 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:36:27.311487 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application with Lock( Oct 30 00:36:27.311487 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:36:27.311487 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:36:27.311487 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:36:27.311487 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:36:27.311487 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:36:27.311487 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:36:27.311487 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:36:27.311487 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:36:27.311487 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 30 00:36:27.311487 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 30 00:36:27.311487 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 30 00:36:27.311487 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application Oct 30 00:36:27.311487 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 354/715] 10.222.0.42 () {56 vars in 1126 bytes} [Sun Oct 30 00:36:27 2022] GET /identity/v3/services/object-store => generated 93 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:36:27.317294 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310b2d00-efe0-46de-ad5d-e039c82e51de None None] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:36:27.368906 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=100 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:36:27.418504 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310b2d00-efe0-46de-ad5d-e039c82e51de None None] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:36:27.453507 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c9322d-400a-4fbe-9100-6a571ef58761 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:36:27.454133 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c9322d-400a-4fbe-9100-6a571ef58761 None admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:36:27.454407 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c9322d-400a-4fbe-9100-6a571ef58761 None admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:36:27.454679 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c9322d-400a-4fbe-9100-6a571ef58761 None admin] PATH_INFO: `/v3/services` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:36:27.455359 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c9322d-400a-4fbe-9100-6a571ef58761 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=87956) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:36:27.455659 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c9322d-400a-4fbe-9100-6a571ef58761 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:36:27.457085 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c9322d-400a-4fbe-9100-6a571ef58761 None admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:36:27.466448 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 362/716] 10.222.0.42 () {56 vars in 1122 bytes} [Sun Oct 30 00:36:27 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:36:27.468622 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d965d6-5add-491b-bc16-f17f48ffa7e6 None admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:36:27.573021 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d965d6-5add-491b-bc16-f17f48ffa7e6 None admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:36:27.608716 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d10c8f-47f2-4bff-a34e-002182a5138f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:36:27.609388 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d10c8f-47f2-4bff-a34e-002182a5138f None admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:36:27.609694 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d10c8f-47f2-4bff-a34e-002182a5138f None admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:36:27.609998 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d10c8f-47f2-4bff-a34e-002182a5138f None admin] PATH_INFO: `/v3/services` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:36:27.610677 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d10c8f-47f2-4bff-a34e-002182a5138f None admin] RBAC: Adding query filter params (type=object-store) {{(pid=87955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:36:27.610980 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d10c8f-47f2-4bff-a34e-002182a5138f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:36:27.612388 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d10c8f-47f2-4bff-a34e-002182a5138f None admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:36:27.618272 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 355/717] 10.222.0.42 () {56 vars in 1122 bytes} [Sun Oct 30 00:36:27 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:36:27.624684 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c9322d-400a-4fbe-9100-6a571ef58761 None admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:36:27.732029 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c9322d-400a-4fbe-9100-6a571ef58761 None admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:36:27.749209 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=100 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:36:27.770538 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c35440a-9bfb-4e88-ac7e-9480692acc77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:36:27.771626 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c35440a-9bfb-4e88-ac7e-9480692acc77 None admin] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:36:27.772163 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c35440a-9bfb-4e88-ac7e-9480692acc77 None admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:36:27.772623 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c35440a-9bfb-4e88-ac7e-9480692acc77 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:36:27.773555 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c35440a-9bfb-4e88-ac7e-9480692acc77 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:36:27.775157 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c35440a-9bfb-4e88-ac7e-9480692acc77 None admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:36:27.803248 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 363/718] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 30 00:36:27 2022] POST /identity/v3/endpoints => generated 349 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 00:36:27.845683 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a319b428-57e1-4480-8459-3f82210a1509 None None] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:36:27.846696 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a319b428-57e1-4480-8459-3f82210a1509 None None] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:36:27.847231 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a319b428-57e1-4480-8459-3f82210a1509 None None] PATH_INFO: `/` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:36:27.849258 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 356/719] 10.222.0.42 () {54 vars in 927 bytes} [Sun Oct 30 00:36:27 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:36:27.855472 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b986e421-f350-420c-bcef-350b5e208631 None None] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:36:27.856443 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b986e421-f350-420c-bcef-350b5e208631 None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:36:27.856915 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b986e421-f350-420c-bcef-350b5e208631 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:36:27.878753 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.auth.core [None req-b986e421-f350-420c-bcef-350b5e208631 None None] MFA Rules not processed for user `eb55b6cbca4945abb21b0e49eb745e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=87956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:36:27.880391 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-b986e421-f350-420c-bcef-350b5e208631 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:36:27.967054 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 364/720] 10.222.0.42 () {58 vars in 1024 bytes} [Sun Oct 30 00:36:27 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 30 00:36:28.153449 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5798f4b-ed93-448a-9700-923354d28b72 None None] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:36:28.153635 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5798f4b-ed93-448a-9700-923354d28b72 None None] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:36:28.154017 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5798f4b-ed93-448a-9700-923354d28b72 None None] PATH_INFO: `/` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:36:28.155892 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 357/721] 10.222.0.42 () {54 vars in 927 bytes} [Sun Oct 30 00:36:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:36:28.161945 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f614635-76ed-48b3-8dc3-b0ca05363c3c None None] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:36:28.162354 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f614635-76ed-48b3-8dc3-b0ca05363c3c None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:36:28.162703 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f614635-76ed-48b3-8dc3-b0ca05363c3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:36:28.182019 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.auth.core [None req-6f614635-76ed-48b3-8dc3-b0ca05363c3c None None] MFA Rules not processed for user `eb55b6cbca4945abb21b0e49eb745e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=87956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:36:28.183239 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-6f614635-76ed-48b3-8dc3-b0ca05363c3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:36:28.240964 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5798f4b-ed93-448a-9700-923354d28b72 None None] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:36:28.252523 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 365/722] 10.222.0.42 () {58 vars in 1024 bytes} [Sun Oct 30 00:36:28 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 30 00:36:28.267599 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625cd1a7-2e3c-47ca-85c2-f77ea8df1893 None None] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:36:28.268186 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625cd1a7-2e3c-47ca-85c2-f77ea8df1893 None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:36:28.268672 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625cd1a7-2e3c-47ca-85c2-f77ea8df1893 None None] PATH_INFO: `/` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:36:28.270430 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 366/723] 10.222.0.42 () {54 vars in 927 bytes} [Sun Oct 30 00:36:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:36:28.270909 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=100 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:36:28.276221 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f09aa5b-397c-4947-ba11-359d883b2036 None None] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:36:28.276551 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f09aa5b-397c-4947-ba11-359d883b2036 None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:36:28.276819 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f09aa5b-397c-4947-ba11-359d883b2036 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:36:28.299279 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.auth.core [None req-1f09aa5b-397c-4947-ba11-359d883b2036 None None] MFA Rules not processed for user `eb55b6cbca4945abb21b0e49eb745e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=87956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:36:28.300567 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-1f09aa5b-397c-4947-ba11-359d883b2036 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:36:28.327635 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:36:28.374518 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5798f4b-ed93-448a-9700-923354d28b72 None None] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:36:28.395232 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 367/724] 10.222.0.42 () {58 vars in 1024 bytes} [Sun Oct 30 00:36:28 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 30 00:36:28.416593 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d6df57-2c11-46ae-ba1e-7e849c751654 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:36:28.417201 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d6df57-2c11-46ae-ba1e-7e849c751654 None admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:36:28.417471 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d6df57-2c11-46ae-ba1e-7e849c751654 None admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:36:28.417783 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d6df57-2c11-46ae-ba1e-7e849c751654 None admin] PATH_INFO: `/v3/services/image` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:36:28.418359 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d6df57-2c11-46ae-ba1e-7e849c751654 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:36:28.419816 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d6df57-2c11-46ae-ba1e-7e849c751654 None admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:36:28.428843 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application [None req-19d6df57-2c11-46ae-ba1e-7e849c751654 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Oct 30 00:36:28.428843 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:36:28.428843 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 30 00:36:28.428843 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 30 00:36:28.428843 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 30 00:36:28.428843 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 30 00:36:28.428843 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 30 00:36:28.428843 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 30 00:36:28.428843 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 30 00:36:28.428843 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application Oct 30 00:36:28.428843 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 30 00:36:28.428843 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application Oct 30 00:36:28.428843 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:36:28.428843 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:36:28.428843 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:36:28.428843 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:36:28.428843 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:36:28.429821 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:36:28.429821 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:36:28.429821 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:36:28.429821 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:36:28.429821 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:36:28.429821 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:36:28.429821 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 30 00:36:28.429821 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 30 00:36:28.429821 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 30 00:36:28.429821 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 30 00:36:28.429821 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:36:28.429821 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:36:28.429821 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:36:28.429821 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:36:28.429821 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:36:28.429821 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:36:28.430676 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:36:28.430676 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application with Lock( Oct 30 00:36:28.430676 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:36:28.430676 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:36:28.430676 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:36:28.430676 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:36:28.430676 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:36:28.430676 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:36:28.430676 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:36:28.430676 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:36:28.430676 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 30 00:36:28.430676 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 30 00:36:28.430676 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 30 00:36:28.430676 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application Oct 30 00:36:28.430676 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 358/725] 10.222.0.42 () {56 vars in 1105 bytes} [Sun Oct 30 00:36:28 2022] GET /identity/v3/services/image => generated 86 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:36:28.435926 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f09aa5b-397c-4947-ba11-359d883b2036 None None] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:36:28.517671 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d6df57-2c11-46ae-ba1e-7e849c751654 None admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:36:28.536565 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f09aa5b-397c-4947-ba11-359d883b2036 None None] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:36:28.575959 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9680e1-c516-42cc-8aba-b5476182db36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:36:28.577200 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9680e1-c516-42cc-8aba-b5476182db36 None admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:36:28.577475 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9680e1-c516-42cc-8aba-b5476182db36 None admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:36:28.577746 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9680e1-c516-42cc-8aba-b5476182db36 None admin] PATH_INFO: `/v3/services` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:36:28.579015 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9680e1-c516-42cc-8aba-b5476182db36 None admin] RBAC: Adding query filter params (name=image) {{(pid=87956) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:36:28.579349 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9680e1-c516-42cc-8aba-b5476182db36 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:36:28.581270 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9680e1-c516-42cc-8aba-b5476182db36 None admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:36:28.589576 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 368/726] 10.222.0.42 () {56 vars in 1108 bytes} [Sun Oct 30 00:36:28 2022] GET /identity/v3/services?name=image => generated 122 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:36:28.595363 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9680e1-c516-42cc-8aba-b5476182db36 None admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:36:28.612622 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=100 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:36:28.623070 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=100 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:36:28.630217 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d6df57-2c11-46ae-ba1e-7e849c751654 None admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:36:28.669327 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55802204-37d4-4983-811a-cad9830d81ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:36:28.670012 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55802204-37d4-4983-811a-cad9830d81ee None admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:36:28.670409 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55802204-37d4-4983-811a-cad9830d81ee None admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:36:28.670677 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55802204-37d4-4983-811a-cad9830d81ee None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:36:28.671530 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55802204-37d4-4983-811a-cad9830d81ee None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:36:28.673587 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55802204-37d4-4983-811a-cad9830d81ee None admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:36:28.684711 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application [None req-55802204-37d4-4983-811a-cad9830d81ee None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 30 00:36:28.684711 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:36:28.684711 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 30 00:36:28.684711 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 30 00:36:28.684711 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 30 00:36:28.684711 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 30 00:36:28.684711 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 30 00:36:28.684711 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 30 00:36:28.684711 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 30 00:36:28.684711 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application Oct 30 00:36:28.684711 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 30 00:36:28.684711 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application Oct 30 00:36:28.684711 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:36:28.684711 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:36:28.684711 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:36:28.684711 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:36:28.684711 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:36:28.685714 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:36:28.685714 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:36:28.685714 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:36:28.685714 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:36:28.685714 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:36:28.685714 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:36:28.685714 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 30 00:36:28.685714 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 30 00:36:28.685714 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 30 00:36:28.685714 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 30 00:36:28.685714 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:36:28.685714 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:36:28.685714 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:36:28.685714 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:36:28.685714 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:36:28.685714 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:36:28.686552 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:36:28.686552 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application with Lock( Oct 30 00:36:28.686552 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:36:28.686552 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:36:28.686552 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:36:28.686552 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:36:28.686552 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:36:28.686552 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:36:28.686552 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:36:28.686552 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:36:28.686552 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 30 00:36:28.686552 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 30 00:36:28.686552 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 30 00:36:28.686552 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application Oct 30 00:36:28.687328 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 359/727] 10.222.0.42 () {56 vars in 1114 bytes} [Sun Oct 30 00:36:28 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 30 00:36:28.693176 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55802204-37d4-4983-811a-cad9830d81ee None admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:36:28.725998 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9680e1-c516-42cc-8aba-b5476182db36 None admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:36:28.763179 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316fea37-9468-4bc4-92af-80a7f5b9a8b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:36:28.764125 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316fea37-9468-4bc4-92af-80a7f5b9a8b3 None admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:36:28.764646 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316fea37-9468-4bc4-92af-80a7f5b9a8b3 None admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:36:28.765198 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316fea37-9468-4bc4-92af-80a7f5b9a8b3 None admin] PATH_INFO: `/v3/services` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:36:28.765832 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316fea37-9468-4bc4-92af-80a7f5b9a8b3 None admin] RBAC: Adding query filter params (type=image) {{(pid=87956) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:36:28.766155 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316fea37-9468-4bc4-92af-80a7f5b9a8b3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:36:28.767523 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316fea37-9468-4bc4-92af-80a7f5b9a8b3 None admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:36:28.783237 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 369/728] 10.222.0.42 () {56 vars in 1108 bytes} [Sun Oct 30 00:36:28 2022] GET /identity/v3/services?type=image => generated 122 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 30 00:36:28.783237 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316fea37-9468-4bc4-92af-80a7f5b9a8b3 None admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:36:28.811460 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55802204-37d4-4983-811a-cad9830d81ee None admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:36:28.855136 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593546e7-0027-43df-b8eb-d00a8fc236e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:36:28.856203 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593546e7-0027-43df-b8eb-d00a8fc236e0 None admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:36:28.856473 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593546e7-0027-43df-b8eb-d00a8fc236e0 None admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:36:28.856998 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593546e7-0027-43df-b8eb-d00a8fc236e0 None admin] PATH_INFO: `/v3/services` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:36:28.857654 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593546e7-0027-43df-b8eb-d00a8fc236e0 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=87955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:36:28.857988 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593546e7-0027-43df-b8eb-d00a8fc236e0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:36:28.859566 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593546e7-0027-43df-b8eb-d00a8fc236e0 None admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:36:28.866318 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 360/729] 10.222.0.42 () {56 vars in 1114 bytes} [Sun Oct 30 00:36:28 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:36:28.872005 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593546e7-0027-43df-b8eb-d00a8fc236e0 None admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:36:28.894314 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=100 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:36:28.897146 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=100 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:36:28.916024 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316fea37-9468-4bc4-92af-80a7f5b9a8b3 None admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:36:28.955848 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd913a47-1216-4dee-a056-267d599fe4d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:36:28.956992 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd913a47-1216-4dee-a056-267d599fe4d6 None admin] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:36:28.957469 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd913a47-1216-4dee-a056-267d599fe4d6 None admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:36:28.957933 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd913a47-1216-4dee-a056-267d599fe4d6 None admin] PATH_INFO: `/v3/services` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:36:28.958843 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd913a47-1216-4dee-a056-267d599fe4d6 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:36:28.960678 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd913a47-1216-4dee-a056-267d599fe4d6 None admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:36:28.982965 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 370/730] 10.222.0.42 () {60 vars in 1141 bytes} [Sun Oct 30 00:36:28 2022] POST /identity/v3/services => generated 242 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 00:36:29.002928 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593546e7-0027-43df-b8eb-d00a8fc236e0 None admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:36:29.059059 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6096a123-6824-42a1-84c5-810e775f79e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:36:29.059767 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6096a123-6824-42a1-84c5-810e775f79e0 None admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:36:29.060042 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6096a123-6824-42a1-84c5-810e775f79e0 None admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:36:29.060354 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6096a123-6824-42a1-84c5-810e775f79e0 None admin] PATH_INFO: `/v3/services` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:36:29.061013 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6096a123-6824-42a1-84c5-810e775f79e0 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=87955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:36:29.061302 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6096a123-6824-42a1-84c5-810e775f79e0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:36:29.062751 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6096a123-6824-42a1-84c5-810e775f79e0 None admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:36:29.078496 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 361/731] 10.222.0.42 () {56 vars in 1114 bytes} [Sun Oct 30 00:36:28 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 30 00:36:29.084240 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd913a47-1216-4dee-a056-267d599fe4d6 None admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:36:29.198832 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd913a47-1216-4dee-a056-267d599fe4d6 None admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:36:29.234207 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09beaf13-0ba9-4752-904e-df9bdaf3db0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:36:29.234750 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09beaf13-0ba9-4752-904e-df9bdaf3db0a None admin] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:36:29.235026 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09beaf13-0ba9-4752-904e-df9bdaf3db0a None admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:36:29.235322 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09beaf13-0ba9-4752-904e-df9bdaf3db0a None admin] PATH_INFO: `/v3/endpoints` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:36:29.236187 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09beaf13-0ba9-4752-904e-df9bdaf3db0a None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:36:29.237555 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09beaf13-0ba9-4752-904e-df9bdaf3db0a None admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:36:29.254030 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:36:29.263633 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 371/732] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 30 00:36:29 2022] POST /identity/v3/endpoints => generated 346 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 00:36:30.016034 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b55991b-ee63-4e13-be84-6e55667d96ef None None] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:36:30.016561 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b55991b-ee63-4e13-be84-6e55667d96ef None None] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:36:30.016561 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b55991b-ee63-4e13-be84-6e55667d96ef None None] PATH_INFO: `/` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:36:30.018188 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 362/733] 10.222.0.42 () {54 vars in 927 bytes} [Sun Oct 30 00:36:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:36:30.023666 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dec68bc-d42b-417d-bf99-bcf5c8b8f1b0 None None] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:36:30.024132 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dec68bc-d42b-417d-bf99-bcf5c8b8f1b0 None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:36:30.024210 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dec68bc-d42b-417d-bf99-bcf5c8b8f1b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:36:30.042508 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.auth.core [None req-2dec68bc-d42b-417d-bf99-bcf5c8b8f1b0 None None] MFA Rules not processed for user `eb55b6cbca4945abb21b0e49eb745e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=87956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:36:30.043750 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-2dec68bc-d42b-417d-bf99-bcf5c8b8f1b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:36:30.123307 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 372/734] 10.222.0.42 () {58 vars in 1024 bytes} [Sun Oct 30 00:36:30 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 30 00:36:30.383937 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b55991b-ee63-4e13-be84-6e55667d96ef None None] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:36:30.464555 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=100 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:36:30.490656 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b55991b-ee63-4e13-be84-6e55667d96ef None None] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:36:30.525266 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c166927-bcdd-4d91-ba03-4d1b8f67c63e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:36:30.526315 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c166927-bcdd-4d91-ba03-4d1b8f67c63e None admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:36:30.526809 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c166927-bcdd-4d91-ba03-4d1b8f67c63e None admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:36:30.527321 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c166927-bcdd-4d91-ba03-4d1b8f67c63e None admin] PATH_INFO: `/v3/services/object-store` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:36:30.528153 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c166927-bcdd-4d91-ba03-4d1b8f67c63e None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:36:30.529856 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c166927-bcdd-4d91-ba03-4d1b8f67c63e None admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:36:30.539444 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application [None req-3c166927-bcdd-4d91-ba03-4d1b8f67c63e None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 30 00:36:30.539444 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:36:30.539444 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 30 00:36:30.539444 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 30 00:36:30.539444 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 30 00:36:30.539444 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 30 00:36:30.539444 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 30 00:36:30.539444 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 30 00:36:30.539444 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 30 00:36:30.539444 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application Oct 30 00:36:30.539444 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 30 00:36:30.539444 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application Oct 30 00:36:30.539444 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:36:30.539444 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:36:30.539444 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:36:30.539444 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:36:30.539444 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:36:30.540466 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:36:30.540466 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:36:30.540466 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:36:30.540466 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:36:30.540466 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:36:30.540466 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:36:30.540466 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 30 00:36:30.540466 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 30 00:36:30.540466 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 30 00:36:30.540466 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 30 00:36:30.540466 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:36:30.540466 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:36:30.540466 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:36:30.540466 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:36:30.540466 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:36:30.540466 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:36:30.541360 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:36:30.541360 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application with Lock( Oct 30 00:36:30.541360 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:36:30.541360 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:36:30.541360 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:36:30.541360 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:36:30.541360 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:36:30.541360 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:36:30.541360 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:36:30.541360 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:36:30.541360 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 30 00:36:30.541360 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 30 00:36:30.541360 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 30 00:36:30.541360 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application Oct 30 00:36:30.549572 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 363/735] 10.222.0.42 () {56 vars in 1126 bytes} [Sun Oct 30 00:36:30 2022] GET /identity/v3/services/object-store => generated 93 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:36:30.551380 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dec68bc-d42b-417d-bf99-bcf5c8b8f1b0 None None] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:36:30.656992 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dec68bc-d42b-417d-bf99-bcf5c8b8f1b0 None None] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:36:30.682868 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=100 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:36:30.692035 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fb1274-e914-4414-aa9e-59fa48c7e18c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:36:30.692661 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fb1274-e914-4414-aa9e-59fa48c7e18c None admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:36:30.692928 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fb1274-e914-4414-aa9e-59fa48c7e18c None admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:36:30.693195 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fb1274-e914-4414-aa9e-59fa48c7e18c None admin] PATH_INFO: `/v3/services` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:36:30.693885 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fb1274-e914-4414-aa9e-59fa48c7e18c None admin] RBAC: Adding query filter params (name=object-store) {{(pid=87956) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:36:30.694182 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fb1274-e914-4414-aa9e-59fa48c7e18c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:36:30.695654 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fb1274-e914-4414-aa9e-59fa48c7e18c None admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:36:30.700833 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 373/736] 10.222.0.42 () {56 vars in 1122 bytes} [Sun Oct 30 00:36:30 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:36:30.706971 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c166927-bcdd-4d91-ba03-4d1b8f67c63e None admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:36:30.809553 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c166927-bcdd-4d91-ba03-4d1b8f67c63e None admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:36:30.844506 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcee2d24-99d3-47ee-a1c4-94566dad949f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:36:30.845468 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcee2d24-99d3-47ee-a1c4-94566dad949f None admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:36:30.845940 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcee2d24-99d3-47ee-a1c4-94566dad949f None admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:36:30.846425 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcee2d24-99d3-47ee-a1c4-94566dad949f None admin] PATH_INFO: `/v3/services` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:36:30.847294 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcee2d24-99d3-47ee-a1c4-94566dad949f None admin] RBAC: Adding query filter params (type=object-store) {{(pid=87955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:36:30.847786 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcee2d24-99d3-47ee-a1c4-94566dad949f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:36:30.849348 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcee2d24-99d3-47ee-a1c4-94566dad949f None admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:36:30.859301 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 364/737] 10.222.0.42 () {56 vars in 1122 bytes} [Sun Oct 30 00:36:30 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:36:30.861613 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fb1274-e914-4414-aa9e-59fa48c7e18c None admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:36:30.962343 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fb1274-e914-4414-aa9e-59fa48c7e18c None admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:36:30.996912 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84f54d0-7f47-4f6e-87d8-3336bef40c0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:36:30.997928 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84f54d0-7f47-4f6e-87d8-3336bef40c0b None admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:36:30.998423 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84f54d0-7f47-4f6e-87d8-3336bef40c0b None admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:36:30.998904 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84f54d0-7f47-4f6e-87d8-3336bef40c0b None admin] PATH_INFO: `/v3/endpoints` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:36:30.999874 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84f54d0-7f47-4f6e-87d8-3336bef40c0b None admin] RBAC: Adding query filter params (interface=admin, service_id=8749b28654104ca88a0c85117dd2840f, region_id=RegionOne) {{(pid=87956) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:36:31.000389 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84f54d0-7f47-4f6e-87d8-3336bef40c0b None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:36:31.002008 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84f54d0-7f47-4f6e-87d8-3336bef40c0b None admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:36:31.013516 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 374/738] 10.222.0.42 () {56 vars in 1249 bytes} [Sun Oct 30 00:36:30 2022] GET /identity/v3/endpoints?service_id=8749b28654104ca88a0c85117dd2840f&interface=admin®ion_id=RegionOne => generated 193 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:36:31.015459 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcee2d24-99d3-47ee-a1c4-94566dad949f None admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:36:31.019802 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=100 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:36:31.134318 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12442dc8-ecf7-42bd-8e4a-82af4df72727 None None] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:36:31.135332 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12442dc8-ecf7-42bd-8e4a-82af4df72727 None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:36:31.135831 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12442dc8-ecf7-42bd-8e4a-82af4df72727 None None] PATH_INFO: `/` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:36:31.139153 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcee2d24-99d3-47ee-a1c4-94566dad949f None admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:36:31.139526 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 375/739] 10.222.0.42 () {54 vars in 927 bytes} [Sun Oct 30 00:36:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:36:31.144458 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52b0e34-97da-4218-b359-d9fd56ae2085 None None] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:36:31.145071 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52b0e34-97da-4218-b359-d9fd56ae2085 None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:36:31.145559 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52b0e34-97da-4218-b359-d9fd56ae2085 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:36:31.166283 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.auth.core [None req-a52b0e34-97da-4218-b359-d9fd56ae2085 None None] MFA Rules not processed for user `eb55b6cbca4945abb21b0e49eb745e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=87956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:36:31.167545 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-a52b0e34-97da-4218-b359-d9fd56ae2085 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:36:31.177241 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265ebaf4-9eb5-4833-b483-4a04a53fbfb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:36:31.178344 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265ebaf4-9eb5-4833-b483-4a04a53fbfb0 None admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:36:31.178819 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265ebaf4-9eb5-4833-b483-4a04a53fbfb0 None admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:36:31.179466 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265ebaf4-9eb5-4833-b483-4a04a53fbfb0 None admin] PATH_INFO: `/v3/services` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:36:31.180143 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265ebaf4-9eb5-4833-b483-4a04a53fbfb0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:36:31.181570 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265ebaf4-9eb5-4833-b483-4a04a53fbfb0 None admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:36:31.189983 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 365/740] 10.222.0.42 () {56 vars in 1087 bytes} [Sun Oct 30 00:36:31 2022] GET /identity/v3/services => generated 1727 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 00:36:31.224898 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=100 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:36:31.245048 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 376/741] 10.222.0.42 () {58 vars in 1024 bytes} [Sun Oct 30 00:36:31 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 30 00:36:31.258138 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe8c814-3f7b-45eb-8d75-7c8a1d0f6764 None None] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:36:31.258657 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe8c814-3f7b-45eb-8d75-7c8a1d0f6764 None None] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:36:31.259070 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe8c814-3f7b-45eb-8d75-7c8a1d0f6764 None None] PATH_INFO: `/` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:36:31.260997 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 366/742] 10.222.0.42 () {54 vars in 927 bytes} [Sun Oct 30 00:36:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:36:31.266533 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd29f60-acef-43db-b6b6-c8bee5826b48 None None] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:36:31.266816 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd29f60-acef-43db-b6b6-c8bee5826b48 None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:36:31.267087 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd29f60-acef-43db-b6b6-c8bee5826b48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:36:31.290884 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.auth.core [None req-0cd29f60-acef-43db-b6b6-c8bee5826b48 None None] MFA Rules not processed for user `eb55b6cbca4945abb21b0e49eb745e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=87956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:36:31.292138 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-0cd29f60-acef-43db-b6b6-c8bee5826b48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:36:31.363475 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 377/743] 10.222.0.42 () {58 vars in 1024 bytes} [Sun Oct 30 00:36:31 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 30 00:36:31.520884 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe8c814-3f7b-45eb-8d75-7c8a1d0f6764 None None] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:36:31.573464 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c59c30-1a72-4574-90c1-e0bfd59413d4 None None] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:36:31.573819 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c59c30-1a72-4574-90c1-e0bfd59413d4 None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:36:31.574002 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c59c30-1a72-4574-90c1-e0bfd59413d4 None None] PATH_INFO: `/` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:36:31.575654 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 378/744] 10.222.0.42 () {54 vars in 927 bytes} [Sun Oct 30 00:36:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:36:31.584550 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c53868-53db-4fed-9987-8bbe28c94207 None None] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:36:31.584947 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c53868-53db-4fed-9987-8bbe28c94207 None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:36:31.585309 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c53868-53db-4fed-9987-8bbe28c94207 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:36:31.594114 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=100 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:36:31.606813 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.auth.core [None req-29c53868-53db-4fed-9987-8bbe28c94207 None None] MFA Rules not processed for user `eb55b6cbca4945abb21b0e49eb745e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=87956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:36:31.608506 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-29c53868-53db-4fed-9987-8bbe28c94207 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:36:31.631913 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe8c814-3f7b-45eb-8d75-7c8a1d0f6764 None None] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:36:31.666951 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb82e83-0154-4136-b986-7c51b625864f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:36:31.667564 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb82e83-0154-4136-b986-7c51b625864f None admin] REQUEST_METHOD: `POST` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:36:31.667836 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb82e83-0154-4136-b986-7c51b625864f None admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:36:31.668098 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb82e83-0154-4136-b986-7c51b625864f None admin] PATH_INFO: `/v3/services` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:36:31.668734 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb82e83-0154-4136-b986-7c51b625864f None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:36:31.670085 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb82e83-0154-4136-b986-7c51b625864f None admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:36:31.690758 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 379/745] 10.222.0.42 () {58 vars in 1024 bytes} [Sun Oct 30 00:36:31 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 30 00:36:31.690758 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c53868-53db-4fed-9987-8bbe28c94207 None None] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:36:31.691011 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 367/746] 10.222.0.42 () {60 vars in 1141 bytes} [Sun Oct 30 00:36:31 2022] POST /identity/v3/services => generated 242 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 00:36:31.745065 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=100 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:36:31.808966 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c53868-53db-4fed-9987-8bbe28c94207 None None] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:36:31.855862 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73eb0b9-59bf-4566-933c-26ed9e84af78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:36:31.857720 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73eb0b9-59bf-4566-933c-26ed9e84af78 None admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:36:31.858004 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73eb0b9-59bf-4566-933c-26ed9e84af78 None admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:36:31.858321 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73eb0b9-59bf-4566-933c-26ed9e84af78 None admin] PATH_INFO: `/v3/services/compute` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:36:31.858944 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73eb0b9-59bf-4566-933c-26ed9e84af78 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:36:31.860438 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73eb0b9-59bf-4566-933c-26ed9e84af78 None admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:36:31.870984 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application [None req-a73eb0b9-59bf-4566-933c-26ed9e84af78 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Oct 30 00:36:31.870984 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:36:31.870984 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 30 00:36:31.870984 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 30 00:36:31.870984 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 30 00:36:31.870984 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 30 00:36:31.870984 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 30 00:36:31.870984 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 30 00:36:31.870984 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 30 00:36:31.870984 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application Oct 30 00:36:31.870984 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 30 00:36:31.870984 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application Oct 30 00:36:31.870984 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:36:31.870984 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:36:31.870984 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:36:31.870984 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:36:31.870984 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:36:31.872059 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:36:31.872059 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:36:31.872059 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:36:31.872059 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:36:31.872059 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:36:31.872059 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:36:31.872059 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 30 00:36:31.872059 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 30 00:36:31.872059 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 30 00:36:31.872059 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 30 00:36:31.872059 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:36:31.872059 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:36:31.872059 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:36:31.872059 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:36:31.872059 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:36:31.872059 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:36:31.873298 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:36:31.873298 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application with Lock( Oct 30 00:36:31.873298 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:36:31.873298 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:36:31.873298 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:36:31.873298 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:36:31.873298 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:36:31.873298 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:36:31.873298 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:36:31.873298 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:36:31.873298 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 30 00:36:31.873298 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 30 00:36:31.873298 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 30 00:36:31.873298 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application Oct 30 00:36:31.873298 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 380/747] 10.222.0.42 () {56 vars in 1111 bytes} [Sun Oct 30 00:36:31 2022] GET /identity/v3/services/compute => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:36:31.878651 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb82e83-0154-4136-b986-7c51b625864f None admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:36:31.960334 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73eb0b9-59bf-4566-933c-26ed9e84af78 None admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:36:31.989467 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb82e83-0154-4136-b986-7c51b625864f None admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:36:32.018598 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:36:32.030295 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65a820f-097a-44bc-95a9-83b7f1d3aa60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:36:32.031834 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65a820f-097a-44bc-95a9-83b7f1d3aa60 None admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:36:32.032309 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65a820f-097a-44bc-95a9-83b7f1d3aa60 None admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:36:32.032770 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65a820f-097a-44bc-95a9-83b7f1d3aa60 None admin] PATH_INFO: `/v3/services` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:36:32.033631 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65a820f-097a-44bc-95a9-83b7f1d3aa60 None admin] RBAC: Adding query filter params (name=compute) {{(pid=87955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:36:32.034132 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65a820f-097a-44bc-95a9-83b7f1d3aa60 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:36:32.035994 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65a820f-097a-44bc-95a9-83b7f1d3aa60 None admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:36:32.042860 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 368/748] 10.222.0.42 () {56 vars in 1112 bytes} [Sun Oct 30 00:36:31 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:36:32.051684 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65a820f-097a-44bc-95a9-83b7f1d3aa60 None admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:36:32.099956 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73eb0b9-59bf-4566-933c-26ed9e84af78 None admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:36:32.102790 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=100 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:36:32.147320 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb0da2d-125f-40c0-aaf7-eec432f6cb4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:36:32.147959 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb0da2d-125f-40c0-aaf7-eec432f6cb4d None admin] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:36:32.148248 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb0da2d-125f-40c0-aaf7-eec432f6cb4d None admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:36:32.148534 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb0da2d-125f-40c0-aaf7-eec432f6cb4d None admin] PATH_INFO: `/v3/projects` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:36:32.149196 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb0da2d-125f-40c0-aaf7-eec432f6cb4d None admin] RBAC: Authorizing `identity:create_project()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:36:32.151231 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb0da2d-125f-40c0-aaf7-eec432f6cb4d None admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:36:32.154664 dv-cinder-861491-6-smb devstack@keystone.service[87956]: WARNING keystone.server.flask.common [None req-abb0da2d-125f-40c0-aaf7-eec432f6cb4d None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Oct 30 00:36:32.169581 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65a820f-097a-44bc-95a9-83b7f1d3aa60 None admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:36:32.178872 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.sql.core [None req-abb0da2d-125f-40c0-aaf7-eec432f6cb4d None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Oct 30 00:36:32.178872 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 30 00:36:32.178872 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [parameters: {'id': '7c34528e507c4a03a8476518db19a3d2', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Oct 30 00:36:32.178872 dv-cinder-861491-6-smb devstack@keystone.service[87956]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=87956) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 30 00:36:32.186908 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application [None req-abb0da2d-125f-40c0-aaf7-eec432f6cb4d None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 7c34528e507c4a03a8476518db19a3d2.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 7c34528e507c4a03a8476518db19a3d2. Oct 30 00:36:32.186908 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:36:32.186908 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 30 00:36:32.186908 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 30 00:36:32.186908 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 30 00:36:32.186908 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 30 00:36:32.186908 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 30 00:36:32.186908 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application result = self._query(query) Oct 30 00:36:32.186908 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 30 00:36:32.186908 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application conn.query(q) Oct 30 00:36:32.186908 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 30 00:36:32.186908 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 30 00:36:32.186908 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 30 00:36:32.187739 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application result.read() Oct 30 00:36:32.187739 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 30 00:36:32.187739 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 30 00:36:32.187739 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 30 00:36:32.187739 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 30 00:36:32.187739 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 30 00:36:32.187739 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 30 00:36:32.187739 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 30 00:36:32.187739 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 30 00:36:32.187739 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Oct 30 00:36:32.187739 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application Oct 30 00:36:32.187739 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 30 00:36:32.187739 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application Oct 30 00:36:32.187739 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:36:32.187739 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 30 00:36:32.187739 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 30 00:36:32.187739 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Oct 30 00:36:32.187739 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return project_ref.to_dict() Oct 30 00:36:32.188703 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 30 00:36:32.188703 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application next(self.gen) Oct 30 00:36:32.188703 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1068, in _transaction_scope Oct 30 00:36:32.188703 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application yield resource Oct 30 00:36:32.188703 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 30 00:36:32.188703 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application next(self.gen) Oct 30 00:36:32.188703 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 670, in _session Oct 30 00:36:32.188703 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application self.session.rollback() Oct 30 00:36:32.188703 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 30 00:36:32.188703 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application self.force_reraise() Oct 30 00:36:32.188703 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 30 00:36:32.188703 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application raise self.value Oct 30 00:36:32.188703 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 667, in _session Oct 30 00:36:32.188703 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 30 00:36:32.188703 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 695, in _end_session_transaction Oct 30 00:36:32.188703 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application session.commit() Oct 30 00:36:32.188703 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 30 00:36:32.189596 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 30 00:36:32.189596 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 30 00:36:32.189596 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application self._prepare_impl() Oct 30 00:36:32.189596 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 30 00:36:32.189596 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application self.session.flush() Oct 30 00:36:32.189596 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 30 00:36:32.189596 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application self._flush(objects) Oct 30 00:36:32.189596 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 30 00:36:32.189596 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 30 00:36:32.189596 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 30 00:36:32.189596 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application compat.raise_( Oct 30 00:36:32.189596 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 30 00:36:32.189596 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application raise exception Oct 30 00:36:32.189596 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 30 00:36:32.189596 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application flush_context.execute() Oct 30 00:36:32.189596 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 30 00:36:32.189596 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application rec.execute(self) Oct 30 00:36:32.190537 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 30 00:36:32.190537 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 30 00:36:32.190537 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 30 00:36:32.190537 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 30 00:36:32.190537 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Oct 30 00:36:32.190537 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application c = connection._execute_20( Oct 30 00:36:32.190537 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 30 00:36:32.190537 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 30 00:36:32.190537 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 30 00:36:32.190537 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 30 00:36:32.190537 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 30 00:36:32.190537 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 30 00:36:32.190537 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 30 00:36:32.190537 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 30 00:36:32.190537 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 30 00:36:32.191383 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 30 00:36:32.191383 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 30 00:36:32.191383 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application raise exception Oct 30 00:36:32.191383 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 30 00:36:32.191383 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 30 00:36:32.191383 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 30 00:36:32.191383 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 30 00:36:32.191383 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 30 00:36:32.191383 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application result = self._query(query) Oct 30 00:36:32.191383 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 30 00:36:32.191383 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application conn.query(q) Oct 30 00:36:32.191383 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 30 00:36:32.191383 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 30 00:36:32.191383 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 30 00:36:32.191383 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application result.read() Oct 30 00:36:32.191383 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 30 00:36:32.191383 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 30 00:36:32.192260 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 30 00:36:32.192260 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 30 00:36:32.192260 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 30 00:36:32.192260 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 30 00:36:32.192260 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 30 00:36:32.192260 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 30 00:36:32.192260 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Oct 30 00:36:32.192260 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 30 00:36:32.192260 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application [parameters: {'id': '7c34528e507c4a03a8476518db19a3d2', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Oct 30 00:36:32.192260 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 30 00:36:32.192260 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application Oct 30 00:36:32.192260 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 30 00:36:32.192260 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application Oct 30 00:36:32.192260 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:36:32.192260 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Oct 30 00:36:32.193033 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Oct 30 00:36:32.193033 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 30 00:36:32.193033 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 30 00:36:32.193033 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Oct 30 00:36:32.193033 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application Oct 30 00:36:32.193033 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 30 00:36:32.193033 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application Oct 30 00:36:32.193033 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:36:32.193033 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:36:32.193033 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:36:32.193033 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:36:32.193033 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:36:32.193033 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:36:32.193033 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:36:32.193033 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:36:32.193033 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:36:32.193033 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:36:32.194136 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:36:32.194136 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Oct 30 00:36:32.194136 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Oct 30 00:36:32.194136 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:36:32.194136 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:36:32.194136 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Oct 30 00:36:32.194136 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application raise exception.Conflict( Oct 30 00:36:32.194136 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 7c34528e507c4a03a8476518db19a3d2. Oct 30 00:36:32.194136 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application Oct 30 00:36:32.203435 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 381/749] 10.222.0.42 () {60 vars in 1140 bytes} [Sun Oct 30 00:36:31 2022] POST /identity/v3/projects => generated 262 bytes in 239 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:36:32.205509 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb0da2d-125f-40c0-aaf7-eec432f6cb4d None admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:36:32.208121 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a515fb2-97be-4390-bb96-c4257aa0a1da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:36:32.209227 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a515fb2-97be-4390-bb96-c4257aa0a1da None admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:36:32.209552 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a515fb2-97be-4390-bb96-c4257aa0a1da None admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:36:32.209833 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a515fb2-97be-4390-bb96-c4257aa0a1da None admin] PATH_INFO: `/v3/services` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:36:32.210475 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a515fb2-97be-4390-bb96-c4257aa0a1da None admin] RBAC: Adding query filter params (type=compute) {{(pid=87955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:36:32.211753 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a515fb2-97be-4390-bb96-c4257aa0a1da None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:36:32.213217 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a515fb2-97be-4390-bb96-c4257aa0a1da None admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:36:32.222418 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 369/750] 10.222.0.42 () {56 vars in 1112 bytes} [Sun Oct 30 00:36:32 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:36:32.225946 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a515fb2-97be-4390-bb96-c4257aa0a1da None admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:36:32.285755 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=100 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:36:32.333164 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb0da2d-125f-40c0-aaf7-eec432f6cb4d None admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:36:32.346886 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a515fb2-97be-4390-bb96-c4257aa0a1da None admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:36:32.370556 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5300cfc-1384-4bea-8605-b7210e1abed6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:36:32.371385 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5300cfc-1384-4bea-8605-b7210e1abed6 None admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:36:32.371756 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5300cfc-1384-4bea-8605-b7210e1abed6 None admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:36:32.372153 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5300cfc-1384-4bea-8605-b7210e1abed6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:36:32.379661 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5300cfc-1384-4bea-8605-b7210e1abed6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:36:32.381770 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5300cfc-1384-4bea-8605-b7210e1abed6 None admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:36:32.390516 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c788c5-05e6-4b6d-95a3-08407e404bc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:36:32.391363 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c788c5-05e6-4b6d-95a3-08407e404bc8 None admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:36:32.391786 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c788c5-05e6-4b6d-95a3-08407e404bc8 None admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:36:32.392201 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c788c5-05e6-4b6d-95a3-08407e404bc8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:36:32.393076 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c788c5-05e6-4b6d-95a3-08407e404bc8 None admin] RBAC: Adding query filter params (interface=public, service_id=007a84c31b4b42de85c3b5341b7731b1, region_id=RegionOne) {{(pid=87955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:36:32.393524 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c788c5-05e6-4b6d-95a3-08407e404bc8 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:36:32.394420 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application [None req-e5300cfc-1384-4bea-8605-b7210e1abed6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 30 00:36:32.394420 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:36:32.394420 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:36:32.394420 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:36:32.394420 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:36:32.394420 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:36:32.394420 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:36:32.394420 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:36:32.394420 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:36:32.394420 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:36:32.394420 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:36:32.394420 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:36:32.394420 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 30 00:36:32.394420 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 30 00:36:32.394420 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 30 00:36:32.395462 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 30 00:36:32.395462 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:36:32.395462 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:36:32.395462 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:36:32.395462 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:36:32.395462 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:36:32.395462 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:36:32.395462 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:36:32.395462 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application with Lock( Oct 30 00:36:32.395462 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:36:32.395462 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:36:32.395462 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:36:32.395462 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:36:32.395462 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:36:32.395462 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:36:32.395462 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:36:32.395462 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:36:32.396615 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 30 00:36:32.396615 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 30 00:36:32.396615 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 30 00:36:32.396615 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 30 00:36:32.396615 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 30 00:36:32.396615 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 30 00:36:32.396615 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 30 00:36:32.396615 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application Oct 30 00:36:32.397865 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c788c5-05e6-4b6d-95a3-08407e404bc8 None admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:36:32.403084 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 382/751] 10.222.0.42 () {56 vars in 1111 bytes} [Sun Oct 30 00:36:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:36:32.404089 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 370/752] 10.222.0.42 () {56 vars in 1251 bytes} [Sun Oct 30 00:36:32 2022] GET /identity/v3/endpoints?service_id=007a84c31b4b42de85c3b5341b7731b1&interface=public®ion_id=RegionOne => generated 194 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:36:32.407291 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5300cfc-1384-4bea-8605-b7210e1abed6 None admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:36:32.409745 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c788c5-05e6-4b6d-95a3-08407e404bc8 None admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:36:32.432507 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:36:32.521173 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5300cfc-1384-4bea-8605-b7210e1abed6 None admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:36:32.542578 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c788c5-05e6-4b6d-95a3-08407e404bc8 None admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:36:32.558497 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5d5d9d-f037-4463-9eb3-00bcc8905479 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:36:32.559824 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5d5d9d-f037-4463-9eb3-00bcc8905479 None admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:36:32.560300 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5d5d9d-f037-4463-9eb3-00bcc8905479 None admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:36:32.560834 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5d5d9d-f037-4463-9eb3-00bcc8905479 None admin] PATH_INFO: `/v3/projects` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:36:32.561687 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5d5d9d-f037-4463-9eb3-00bcc8905479 None admin] RBAC: Adding query filter params (name=service) {{(pid=87956) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:36:32.564325 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5d5d9d-f037-4463-9eb3-00bcc8905479 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:36:32.564325 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5d5d9d-f037-4463-9eb3-00bcc8905479 None admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:36:32.566225 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=100 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:36:32.582890 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d64329e-d813-4bc1-b4b6-d9f293340221 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:36:32.583737 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d64329e-d813-4bc1-b4b6-d9f293340221 None admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:36:32.584177 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d64329e-d813-4bc1-b4b6-d9f293340221 None admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:36:32.584460 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d64329e-d813-4bc1-b4b6-d9f293340221 None admin] PATH_INFO: `/v3/services` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:36:32.585072 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d64329e-d813-4bc1-b4b6-d9f293340221 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:36:32.586443 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d64329e-d813-4bc1-b4b6-d9f293340221 None admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:36:32.594051 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 383/753] 10.222.0.42 () {56 vars in 1112 bytes} [Sun Oct 30 00:36:32 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 30 00:36:32.599732 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 371/754] 10.222.0.42 () {56 vars in 1087 bytes} [Sun Oct 30 00:36:32 2022] GET /identity/v3/services => generated 1957 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 30 00:36:33.438244 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fdffc7-00d4-46cb-acc3-a10e7e6b5874 None None] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:36:33.439286 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fdffc7-00d4-46cb-acc3-a10e7e6b5874 None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:36:33.439770 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fdffc7-00d4-46cb-acc3-a10e7e6b5874 None None] PATH_INFO: `/` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:36:33.441628 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 384/755] 10.222.0.42 () {54 vars in 927 bytes} [Sun Oct 30 00:36:33 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:36:33.447163 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b085f4ff-3989-4e13-bfa2-a2a113185a11 None None] REQUEST_METHOD: `POST` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:36:33.447605 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b085f4ff-3989-4e13-bfa2-a2a113185a11 None None] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:36:33.447778 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b085f4ff-3989-4e13-bfa2-a2a113185a11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:36:33.466678 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.auth.core [None req-b085f4ff-3989-4e13-bfa2-a2a113185a11 None None] MFA Rules not processed for user `eb55b6cbca4945abb21b0e49eb745e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=87955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:36:33.467926 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-b085f4ff-3989-4e13-bfa2-a2a113185a11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:36:33.536555 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 372/756] 10.222.0.42 () {58 vars in 1024 bytes} [Sun Oct 30 00:36:33 2022] POST /identity/v3/auth/tokens => generated 1666 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 30 00:36:33.808917 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fdffc7-00d4-46cb-acc3-a10e7e6b5874 None None] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:36:33.898828 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=100 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:36:33.916349 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757baa27-62d3-4e40-a0a3-ed92a54ec4c1 None None] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:36:33.916756 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757baa27-62d3-4e40-a0a3-ed92a54ec4c1 None None] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:36:33.916923 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757baa27-62d3-4e40-a0a3-ed92a54ec4c1 None None] PATH_INFO: `/` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:36:33.918653 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 373/757] 10.222.0.42 () {54 vars in 927 bytes} [Sun Oct 30 00:36:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 30 00:36:33.923711 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f88245-091b-4c16-83ad-21271d7585ae None None] REQUEST_METHOD: `POST` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:36:33.923994 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f88245-091b-4c16-83ad-21271d7585ae None None] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:36:33.924198 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fdffc7-00d4-46cb-acc3-a10e7e6b5874 None None] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:36:33.924319 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f88245-091b-4c16-83ad-21271d7585ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:36:33.946044 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.auth.core [None req-32f88245-091b-4c16-83ad-21271d7585ae None None] MFA Rules not processed for user `eb55b6cbca4945abb21b0e49eb745e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=87955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:36:33.947091 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-32f88245-091b-4c16-83ad-21271d7585ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:36:33.967305 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3961a256-abf9-41e6-bd14-e9c43bea843d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:36:33.968534 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3961a256-abf9-41e6-bd14-e9c43bea843d None admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:36:33.968993 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3961a256-abf9-41e6-bd14-e9c43bea843d None admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:36:33.969452 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3961a256-abf9-41e6-bd14-e9c43bea843d None admin] PATH_INFO: `/v3/services/object-store` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:36:33.970211 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3961a256-abf9-41e6-bd14-e9c43bea843d None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:36:33.972568 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3961a256-abf9-41e6-bd14-e9c43bea843d None admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:36:33.984005 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application [None req-3961a256-abf9-41e6-bd14-e9c43bea843d None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 30 00:36:33.984005 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:36:33.984005 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 30 00:36:33.984005 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 30 00:36:33.984005 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 30 00:36:33.984005 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 30 00:36:33.984005 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 30 00:36:33.984005 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 30 00:36:33.984005 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 30 00:36:33.984005 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application Oct 30 00:36:33.984005 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 30 00:36:33.984005 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application Oct 30 00:36:33.984005 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:36:33.984005 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:36:33.984005 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:36:33.984005 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:36:33.984005 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:36:33.985044 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:36:33.985044 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:36:33.985044 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:36:33.985044 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:36:33.985044 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:36:33.985044 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:36:33.985044 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 30 00:36:33.985044 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 30 00:36:33.985044 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 30 00:36:33.985044 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 30 00:36:33.985044 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:36:33.985044 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:36:33.985044 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:36:33.985044 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:36:33.985044 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:36:33.985044 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:36:33.985904 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:36:33.985904 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application with Lock( Oct 30 00:36:33.985904 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:36:33.985904 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:36:33.985904 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:36:33.985904 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:36:33.985904 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:36:33.985904 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:36:33.985904 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:36:33.985904 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:36:33.985904 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 30 00:36:33.985904 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 30 00:36:33.985904 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 30 00:36:33.985904 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application Oct 30 00:36:33.989259 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 385/758] 10.222.0.42 () {56 vars in 1126 bytes} [Sun Oct 30 00:36:33 2022] GET /identity/v3/services/object-store => generated 93 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:36:33.998847 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3961a256-abf9-41e6-bd14-e9c43bea843d None admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:36:34.027298 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 374/759] 10.222.0.42 () {58 vars in 1024 bytes} [Sun Oct 30 00:36:33 2022] POST /identity/v3/auth/tokens => generated 1666 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 30 00:36:34.117001 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3961a256-abf9-41e6-bd14-e9c43bea843d None admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:36:34.151674 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc321384-0729-4b52-b45d-0084204abf90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:36:34.152285 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc321384-0729-4b52-b45d-0084204abf90 None admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:36:34.152564 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc321384-0729-4b52-b45d-0084204abf90 None admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:36:34.152837 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc321384-0729-4b52-b45d-0084204abf90 None admin] PATH_INFO: `/v3/services` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:36:34.153522 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc321384-0729-4b52-b45d-0084204abf90 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=87956) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:36:34.153827 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc321384-0729-4b52-b45d-0084204abf90 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:36:34.155261 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc321384-0729-4b52-b45d-0084204abf90 None admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:36:34.160555 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 386/760] 10.222.0.42 () {56 vars in 1122 bytes} [Sun Oct 30 00:36:33 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:36:34.166459 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f88245-091b-4c16-83ad-21271d7585ae None None] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:36:34.213698 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=100 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:36:34.270187 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f88245-091b-4c16-83ad-21271d7585ae None None] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:36:34.306785 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6ce61e-d9eb-4b54-b151-a0c38f13e84f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:36:34.307430 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6ce61e-d9eb-4b54-b151-a0c38f13e84f None admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:36:34.307705 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6ce61e-d9eb-4b54-b151-a0c38f13e84f None admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:36:34.307971 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6ce61e-d9eb-4b54-b151-a0c38f13e84f None admin] PATH_INFO: `/v3/services` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:36:34.308604 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6ce61e-d9eb-4b54-b151-a0c38f13e84f None admin] RBAC: Adding query filter params (type=object-store) {{(pid=87955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:36:34.308901 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6ce61e-d9eb-4b54-b151-a0c38f13e84f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:36:34.310330 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6ce61e-d9eb-4b54-b151-a0c38f13e84f None admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:36:34.315751 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 375/761] 10.222.0.42 () {56 vars in 1122 bytes} [Sun Oct 30 00:36:34 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:36:34.321388 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc321384-0729-4b52-b45d-0084204abf90 None admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:36:34.322933 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6ce61e-d9eb-4b54-b151-a0c38f13e84f None admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:36:34.334535 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=100 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:36:34.436656 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc321384-0729-4b52-b45d-0084204abf90 None admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:36:34.437303 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6ce61e-d9eb-4b54-b151-a0c38f13e84f None admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:36:34.448502 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=100 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:36:34.479582 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab4a3e5-24de-4eb4-91b0-9e217700f3c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:36:34.480217 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab4a3e5-24de-4eb4-91b0-9e217700f3c8 None admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:36:34.480477 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c578235d-816a-419b-9e29-318a9734f590 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:36:34.480987 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab4a3e5-24de-4eb4-91b0-9e217700f3c8 None admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:36:34.480987 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab4a3e5-24de-4eb4-91b0-9e217700f3c8 None admin] PATH_INFO: `/v3/services/image` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:36:34.481302 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c578235d-816a-419b-9e29-318a9734f590 None admin] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:36:34.481446 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c578235d-816a-419b-9e29-318a9734f590 None admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:36:34.481613 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab4a3e5-24de-4eb4-91b0-9e217700f3c8 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:36:34.481754 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c578235d-816a-419b-9e29-318a9734f590 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:36:34.482263 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c578235d-816a-419b-9e29-318a9734f590 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:36:34.482734 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab4a3e5-24de-4eb4-91b0-9e217700f3c8 None admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:36:34.483831 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c578235d-816a-419b-9e29-318a9734f590 None admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:36:34.493001 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application [None req-7ab4a3e5-24de-4eb4-91b0-9e217700f3c8 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Oct 30 00:36:34.493001 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:36:34.493001 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 30 00:36:34.493001 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 30 00:36:34.493001 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 30 00:36:34.493001 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 30 00:36:34.493001 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 30 00:36:34.493001 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 30 00:36:34.493001 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 30 00:36:34.493001 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application Oct 30 00:36:34.493001 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 30 00:36:34.493001 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application Oct 30 00:36:34.493001 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:36:34.493001 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:36:34.493001 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:36:34.493001 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:36:34.493001 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:36:34.494063 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:36:34.494063 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:36:34.494063 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:36:34.494063 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:36:34.494063 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:36:34.494063 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:36:34.494063 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 30 00:36:34.494063 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 30 00:36:34.494063 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 30 00:36:34.494063 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 30 00:36:34.494063 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:36:34.494063 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:36:34.494063 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:36:34.494063 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:36:34.494063 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:36:34.494063 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:36:34.494880 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:36:34.494880 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application with Lock( Oct 30 00:36:34.494880 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:36:34.494880 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:36:34.494880 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:36:34.494880 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:36:34.494880 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:36:34.494880 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:36:34.494880 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:36:34.494880 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:36:34.494880 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 30 00:36:34.494880 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 30 00:36:34.494880 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 30 00:36:34.494880 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application Oct 30 00:36:34.499271 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 376/762] 10.222.0.42 () {56 vars in 1105 bytes} [Sun Oct 30 00:36:34 2022] GET /identity/v3/services/image => generated 86 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:36:34.500673 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab4a3e5-24de-4eb4-91b0-9e217700f3c8 None admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:36:34.519681 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 387/763] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 30 00:36:34 2022] POST /identity/v3/endpoints => generated 325 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 00:36:34.619996 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab4a3e5-24de-4eb4-91b0-9e217700f3c8 None admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:36:34.662839 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e40c7f-a25a-4448-98bf-c4bcdc93bfa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:36:34.663475 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e40c7f-a25a-4448-98bf-c4bcdc93bfa5 None admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:36:34.663748 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e40c7f-a25a-4448-98bf-c4bcdc93bfa5 None admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:36:34.664015 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e40c7f-a25a-4448-98bf-c4bcdc93bfa5 None admin] PATH_INFO: `/v3/services` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:36:34.664658 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e40c7f-a25a-4448-98bf-c4bcdc93bfa5 None admin] RBAC: Adding query filter params (name=image) {{(pid=87955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:36:34.664954 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e40c7f-a25a-4448-98bf-c4bcdc93bfa5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:36:34.666332 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e40c7f-a25a-4448-98bf-c4bcdc93bfa5 None admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:36:34.672441 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 377/764] 10.222.0.42 () {56 vars in 1108 bytes} [Sun Oct 30 00:36:34 2022] GET /identity/v3/services?name=image => generated 122 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:36:34.678348 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c578235d-816a-419b-9e29-318a9734f590 None admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:36:34.761894 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:36:34.803611 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c578235d-816a-419b-9e29-318a9734f590 None admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:36:34.838193 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9869bb5-36fd-4e72-95b3-3b1a7e804ebd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:36:34.838800 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9869bb5-36fd-4e72-95b3-3b1a7e804ebd None admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:36:34.839074 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9869bb5-36fd-4e72-95b3-3b1a7e804ebd None admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:36:34.839373 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9869bb5-36fd-4e72-95b3-3b1a7e804ebd None admin] PATH_INFO: `/v3/services` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:36:34.840005 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9869bb5-36fd-4e72-95b3-3b1a7e804ebd None admin] RBAC: Adding query filter params (type=image) {{(pid=87956) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:36:34.840299 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9869bb5-36fd-4e72-95b3-3b1a7e804ebd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:36:34.841648 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9869bb5-36fd-4e72-95b3-3b1a7e804ebd None admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:36:34.847139 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 388/765] 10.222.0.42 () {56 vars in 1108 bytes} [Sun Oct 30 00:36:34 2022] GET /identity/v3/services?type=image => generated 350 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:36:34.853286 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e40c7f-a25a-4448-98bf-c4bcdc93bfa5 None admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:36:34.862621 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94049667-ea59-4df0-8228-74f7f742dde9 None None] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:36:34.862911 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94049667-ea59-4df0-8228-74f7f742dde9 None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:36:34.863171 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94049667-ea59-4df0-8228-74f7f742dde9 None None] PATH_INFO: `/` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:36:34.864793 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 389/766] 10.222.0.42 () {54 vars in 927 bytes} [Sun Oct 30 00:36:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:36:34.869910 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a336d3b-c34f-431d-b3f4-8b819b60738e None None] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:36:34.870250 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a336d3b-c34f-431d-b3f4-8b819b60738e None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:36:34.870471 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a336d3b-c34f-431d-b3f4-8b819b60738e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:36:34.888923 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.auth.core [None req-8a336d3b-c34f-431d-b3f4-8b819b60738e None None] MFA Rules not processed for user `eb55b6cbca4945abb21b0e49eb745e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=87956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:36:34.889565 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=100 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:36:34.890689 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-8a336d3b-c34f-431d-b3f4-8b819b60738e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:36:34.961898 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 390/767] 10.222.0.42 () {58 vars in 1024 bytes} [Sun Oct 30 00:36:34 2022] POST /identity/v3/auth/tokens => generated 1813 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 30 00:36:34.962819 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e40c7f-a25a-4448-98bf-c4bcdc93bfa5 None admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:36:34.964801 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea198330-d85a-4988-96d8-0072364d0054 None None] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:36:34.966151 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea198330-d85a-4988-96d8-0072364d0054 None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:36:34.966669 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea198330-d85a-4988-96d8-0072364d0054 None None] PATH_INFO: `/` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:36:34.972723 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 391/768] 10.222.0.42 () {54 vars in 927 bytes} [Sun Oct 30 00:36:34 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:36:34.973615 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b5bc80-98ee-42fe-b973-7ed6a30477cf None None] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:36:34.973885 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b5bc80-98ee-42fe-b973-7ed6a30477cf None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:36:34.974147 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b5bc80-98ee-42fe-b973-7ed6a30477cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:36:34.992050 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.auth.core [None req-f9b5bc80-98ee-42fe-b973-7ed6a30477cf None None] MFA Rules not processed for user `eb55b6cbca4945abb21b0e49eb745e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=87956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:36:34.993231 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-f9b5bc80-98ee-42fe-b973-7ed6a30477cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:36:35.007548 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ba80a8-110a-42c7-a31b-36432e90483c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:36:35.008545 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ba80a8-110a-42c7-a31b-36432e90483c None admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:36:35.009058 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ba80a8-110a-42c7-a31b-36432e90483c None admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:36:35.009519 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ba80a8-110a-42c7-a31b-36432e90483c None admin] PATH_INFO: `/v3/endpoints` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:36:35.010716 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ba80a8-110a-42c7-a31b-36432e90483c None admin] RBAC: Adding query filter params (interface=public, service_id=bc8a55fed1b94aca9bb8cb3d7bdfb469, region_id=RegionOne) {{(pid=87955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:36:35.011666 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ba80a8-110a-42c7-a31b-36432e90483c None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:36:35.013232 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ba80a8-110a-42c7-a31b-36432e90483c None admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:36:35.020149 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 378/769] 10.222.0.42 () {56 vars in 1251 bytes} [Sun Oct 30 00:36:34 2022] GET /identity/v3/endpoints?service_id=bc8a55fed1b94aca9bb8cb3d7bdfb469&interface=public®ion_id=RegionOne => generated 194 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 30 00:36:35.025707 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ba80a8-110a-42c7-a31b-36432e90483c None admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:36:35.064850 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=100 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:36:35.080018 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 392/770] 10.222.0.42 () {58 vars in 1024 bytes} [Sun Oct 30 00:36:34 2022] POST /identity/v3/auth/tokens => generated 1813 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 30 00:36:35.149276 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=100 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:36:35.155843 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ba80a8-110a-42c7-a31b-36432e90483c None admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:36:35.189180 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ee6bc2-51a2-46c1-a61f-7d3a44598d4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:36:35.189783 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ee6bc2-51a2-46c1-a61f-7d3a44598d4e None admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:36:35.190054 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ee6bc2-51a2-46c1-a61f-7d3a44598d4e None admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:36:35.190317 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ee6bc2-51a2-46c1-a61f-7d3a44598d4e None admin] PATH_INFO: `/v3/services` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:36:35.190914 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ee6bc2-51a2-46c1-a61f-7d3a44598d4e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:36:35.192357 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ee6bc2-51a2-46c1-a61f-7d3a44598d4e None admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:36:35.199330 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 379/771] 10.222.0.42 () {56 vars in 1087 bytes} [Sun Oct 30 00:36:35 2022] GET /identity/v3/services => generated 1957 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 30 00:36:35.224230 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b5bc80-98ee-42fe-b973-7ed6a30477cf None None] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:36:35.335028 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b5bc80-98ee-42fe-b973-7ed6a30477cf None None] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:36:35.352002 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ee6bc2-51a2-46c1-a61f-7d3a44598d4e None admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:36:35.373636 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1880fe4-4059-4baa-9234-50e384fb4148 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:36:35.374283 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1880fe4-4059-4baa-9234-50e384fb4148 None admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:36:35.374555 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1880fe4-4059-4baa-9234-50e384fb4148 None admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:36:35.374885 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1880fe4-4059-4baa-9234-50e384fb4148 None admin] PATH_INFO: `/v3/services/compute` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:36:35.375531 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1880fe4-4059-4baa-9234-50e384fb4148 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:36:35.377018 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1880fe4-4059-4baa-9234-50e384fb4148 None admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:36:35.389190 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application [None req-b1880fe4-4059-4baa-9234-50e384fb4148 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Oct 30 00:36:35.389190 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:36:35.389190 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 30 00:36:35.389190 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 30 00:36:35.389190 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 30 00:36:35.389190 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 30 00:36:35.389190 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 30 00:36:35.389190 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 30 00:36:35.389190 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 30 00:36:35.389190 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application Oct 30 00:36:35.389190 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 30 00:36:35.389190 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application Oct 30 00:36:35.389190 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:36:35.389190 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:36:35.389190 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:36:35.389190 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:36:35.389190 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:36:35.390255 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:36:35.390255 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:36:35.390255 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:36:35.390255 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:36:35.390255 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:36:35.390255 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:36:35.390255 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 30 00:36:35.390255 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 30 00:36:35.390255 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 30 00:36:35.390255 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 30 00:36:35.390255 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:36:35.390255 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:36:35.390255 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:36:35.390255 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:36:35.390255 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:36:35.390255 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:36:35.391091 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:36:35.391091 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application with Lock( Oct 30 00:36:35.391091 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:36:35.391091 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:36:35.391091 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:36:35.391091 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:36:35.391091 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:36:35.391091 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:36:35.391091 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:36:35.391091 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:36:35.391091 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 30 00:36:35.391091 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 30 00:36:35.391091 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 30 00:36:35.391091 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application Oct 30 00:36:35.391091 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 393/772] 10.222.0.42 () {56 vars in 1111 bytes} [Sun Oct 30 00:36:35 2022] GET /identity/v3/services/compute => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:36:35.396539 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1880fe4-4059-4baa-9234-50e384fb4148 None admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:36:35.471153 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=100 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:36:35.485013 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ee6bc2-51a2-46c1-a61f-7d3a44598d4e None admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:36:35.519239 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1880fe4-4059-4baa-9234-50e384fb4148 None admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:36:35.521354 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc14a0d1-610d-43ca-a5f7-a94de57e4d39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:36:35.522066 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc14a0d1-610d-43ca-a5f7-a94de57e4d39 None admin] REQUEST_METHOD: `POST` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:36:35.522347 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc14a0d1-610d-43ca-a5f7-a94de57e4d39 None admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:36:35.522655 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc14a0d1-610d-43ca-a5f7-a94de57e4d39 None admin] PATH_INFO: `/v3/users` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:36:35.523352 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc14a0d1-610d-43ca-a5f7-a94de57e4d39 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:36:35.524768 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc14a0d1-610d-43ca-a5f7-a94de57e4d39 None admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:36:35.527346 dv-cinder-861491-6-smb devstack@keystone.service[87955]: WARNING keystone.server.flask.common [None req-bc14a0d1-610d-43ca-a5f7-a94de57e4d39 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Oct 30 00:36:35.542043 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.sql.core [None req-bc14a0d1-610d-43ca-a5f7-a94de57e4d39 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Oct 30 00:36:35.542043 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Oct 30 00:36:35.542043 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [parameters: {'user_id': '5721d77db2954ac39ea941c7114ae8a3', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Oct 30 00:36:35.542043 dv-cinder-861491-6-smb devstack@keystone.service[87955]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=87955) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 30 00:36:35.552012 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application [None req-bc14a0d1-610d-43ca-a5f7-a94de57e4d39 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Oct 30 00:36:35.552012 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:36:35.552012 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 30 00:36:35.552012 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 30 00:36:35.552012 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 30 00:36:35.552012 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 30 00:36:35.552012 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 30 00:36:35.552012 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application result = self._query(query) Oct 30 00:36:35.552012 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 30 00:36:35.552012 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application conn.query(q) Oct 30 00:36:35.552012 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 30 00:36:35.552012 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 30 00:36:35.552012 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 30 00:36:35.552012 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application result.read() Oct 30 00:36:35.552012 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 30 00:36:35.553164 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 30 00:36:35.553164 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 30 00:36:35.553164 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 30 00:36:35.553164 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 30 00:36:35.553164 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 30 00:36:35.553164 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 30 00:36:35.553164 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 30 00:36:35.553164 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Oct 30 00:36:35.553164 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application Oct 30 00:36:35.553164 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 30 00:36:35.553164 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application Oct 30 00:36:35.553164 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:36:35.553164 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 30 00:36:35.553164 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 30 00:36:35.553164 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Oct 30 00:36:35.553164 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Oct 30 00:36:35.553164 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 30 00:36:35.553164 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application next(self.gen) Oct 30 00:36:35.554716 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1068, in _transaction_scope Oct 30 00:36:35.554716 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application yield resource Oct 30 00:36:35.554716 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 30 00:36:35.554716 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application next(self.gen) Oct 30 00:36:35.554716 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 670, in _session Oct 30 00:36:35.554716 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application self.session.rollback() Oct 30 00:36:35.554716 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 30 00:36:35.554716 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application self.force_reraise() Oct 30 00:36:35.554716 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 30 00:36:35.554716 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application raise self.value Oct 30 00:36:35.554716 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 667, in _session Oct 30 00:36:35.554716 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 30 00:36:35.554716 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 695, in _end_session_transaction Oct 30 00:36:35.554716 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application session.commit() Oct 30 00:36:35.554716 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 30 00:36:35.554716 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 30 00:36:35.554716 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 30 00:36:35.555766 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application self._prepare_impl() Oct 30 00:36:35.555766 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 30 00:36:35.555766 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application self.session.flush() Oct 30 00:36:35.555766 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 30 00:36:35.555766 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application self._flush(objects) Oct 30 00:36:35.555766 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 30 00:36:35.555766 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 30 00:36:35.555766 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 30 00:36:35.555766 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application compat.raise_( Oct 30 00:36:35.555766 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 30 00:36:35.555766 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application raise exception Oct 30 00:36:35.555766 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 30 00:36:35.555766 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application flush_context.execute() Oct 30 00:36:35.555766 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 30 00:36:35.555766 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application rec.execute(self) Oct 30 00:36:35.555766 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 30 00:36:35.555766 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 30 00:36:35.556669 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 30 00:36:35.556669 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 30 00:36:35.556669 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Oct 30 00:36:35.556669 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application result = connection._execute_20( Oct 30 00:36:35.556669 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 30 00:36:35.556669 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 30 00:36:35.556669 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 30 00:36:35.556669 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 30 00:36:35.556669 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 30 00:36:35.556669 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 30 00:36:35.556669 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 30 00:36:35.556669 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 30 00:36:35.556669 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 30 00:36:35.556669 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 30 00:36:35.556669 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 30 00:36:35.556669 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application raise exception Oct 30 00:36:35.557478 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 30 00:36:35.557478 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 30 00:36:35.557478 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 30 00:36:35.557478 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 30 00:36:35.557478 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 30 00:36:35.557478 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application result = self._query(query) Oct 30 00:36:35.557478 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 30 00:36:35.557478 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application conn.query(q) Oct 30 00:36:35.557478 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 30 00:36:35.557478 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 30 00:36:35.557478 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 30 00:36:35.557478 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application result.read() Oct 30 00:36:35.557478 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 30 00:36:35.557478 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 30 00:36:35.557478 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 30 00:36:35.557478 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 30 00:36:35.558292 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 30 00:36:35.558292 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 30 00:36:35.558292 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 30 00:36:35.558292 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 30 00:36:35.558292 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Oct 30 00:36:35.558292 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Oct 30 00:36:35.558292 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application [parameters: {'user_id': '5721d77db2954ac39ea941c7114ae8a3', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Oct 30 00:36:35.558292 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 30 00:36:35.558292 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application Oct 30 00:36:35.558292 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 30 00:36:35.558292 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application Oct 30 00:36:35.558292 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:36:35.558292 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:36:35.558292 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:36:35.558292 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:36:35.559091 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:36:35.559091 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:36:35.559091 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:36:35.559091 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:36:35.559091 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:36:35.559091 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:36:35.559091 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:36:35.559091 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Oct 30 00:36:35.559091 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Oct 30 00:36:35.559091 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:36:35.559091 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:36:35.559091 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 30 00:36:35.559091 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 30 00:36:35.559091 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 30 00:36:35.559091 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 30 00:36:35.559091 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Oct 30 00:36:35.559091 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Oct 30 00:36:35.560022 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Oct 30 00:36:35.560022 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Oct 30 00:36:35.560022 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 30 00:36:35.560022 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 30 00:36:35.560022 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Oct 30 00:36:35.560022 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application Oct 30 00:36:35.560022 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 380/773] 10.222.0.42 () {60 vars in 1131 bytes} [Sun Oct 30 00:36:35 2022] POST /identity/v3/users => generated 160 bytes in 202 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Oct 30 00:36:35.560409 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027df9e5-aaf6-4a6e-8e49-2b96c8555f1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:36:35.560409 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027df9e5-aaf6-4a6e-8e49-2b96c8555f1f None admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:36:35.560409 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027df9e5-aaf6-4a6e-8e49-2b96c8555f1f None admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:36:35.560409 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027df9e5-aaf6-4a6e-8e49-2b96c8555f1f None admin] PATH_INFO: `/v3/services` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:36:35.560666 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027df9e5-aaf6-4a6e-8e49-2b96c8555f1f None admin] RBAC: Adding query filter params (name=compute) {{(pid=87956) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:36:35.560740 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc14a0d1-610d-43ca-a5f7-a94de57e4d39 None admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:36:35.560809 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027df9e5-aaf6-4a6e-8e49-2b96c8555f1f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:36:35.571228 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027df9e5-aaf6-4a6e-8e49-2b96c8555f1f None admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:36:35.571228 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 394/774] 10.222.0.42 () {56 vars in 1112 bytes} [Sun Oct 30 00:36:35 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 30 00:36:35.577890 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027df9e5-aaf6-4a6e-8e49-2b96c8555f1f None admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:36:35.596025 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:36:35.690054 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc14a0d1-610d-43ca-a5f7-a94de57e4d39 None admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:36:35.694633 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027df9e5-aaf6-4a6e-8e49-2b96c8555f1f None admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:36:35.716949 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=100 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:36:35.733237 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297a485e-2f3d-4f73-a9f8-48512a5930b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:36:35.733805 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297a485e-2f3d-4f73-a9f8-48512a5930b5 None admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:36:35.734100 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297a485e-2f3d-4f73-a9f8-48512a5930b5 None admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:36:35.734370 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297a485e-2f3d-4f73-a9f8-48512a5930b5 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:36:35.738168 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a03599f-fe0a-4895-b491-95a07e16961c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:36:35.738782 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a03599f-fe0a-4895-b491-95a07e16961c None admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:36:35.739053 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a03599f-fe0a-4895-b491-95a07e16961c None admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:36:35.739348 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a03599f-fe0a-4895-b491-95a07e16961c None admin] PATH_INFO: `/v3/services` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:36:35.739980 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a03599f-fe0a-4895-b491-95a07e16961c None admin] RBAC: Adding query filter params (type=compute) {{(pid=87956) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:36:35.740336 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a03599f-fe0a-4895-b491-95a07e16961c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:36:35.741709 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a03599f-fe0a-4895-b491-95a07e16961c None admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:36:35.755239 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 395/775] 10.222.0.42 () {56 vars in 1112 bytes} [Sun Oct 30 00:36:35 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 30 00:36:35.756397 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297a485e-2f3d-4f73-a9f8-48512a5930b5 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:36:35.758145 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297a485e-2f3d-4f73-a9f8-48512a5930b5 None admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:36:35.760599 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a03599f-fe0a-4895-b491-95a07e16961c None admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:36:35.770672 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application [None req-297a485e-2f3d-4f73-a9f8-48512a5930b5 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Oct 30 00:36:35.770672 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:36:35.770672 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:36:35.770672 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:36:35.770672 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:36:35.770672 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:36:35.770672 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:36:35.770672 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:36:35.770672 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:36:35.770672 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:36:35.770672 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:36:35.770672 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:36:35.770672 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 30 00:36:35.770672 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 30 00:36:35.770672 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 30 00:36:35.770672 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 30 00:36:35.771800 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:36:35.771800 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:36:35.771800 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 30 00:36:35.771800 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 30 00:36:35.771800 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 30 00:36:35.771800 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 30 00:36:35.771800 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:36:35.771800 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:36:35.771800 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:36:35.771800 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:36:35.771800 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:36:35.771800 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application with Lock( Oct 30 00:36:35.771800 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:36:35.771800 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:36:35.771800 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:36:35.771800 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:36:35.771800 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:36:35.771800 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:36:35.772758 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:36:35.772758 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:36:35.772758 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 30 00:36:35.772758 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 30 00:36:35.772758 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 30 00:36:35.772758 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 30 00:36:35.772758 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 30 00:36:35.772758 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 30 00:36:35.772758 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Oct 30 00:36:35.772758 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application Oct 30 00:36:35.776993 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 381/776] 10.222.0.42 () {56 vars in 1099 bytes} [Sun Oct 30 00:36:35 2022] GET /identity/v3/users/cinder => generated 84 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:36:35.777893 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297a485e-2f3d-4f73-a9f8-48512a5930b5 None admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:36:35.875704 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=100 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:36:35.896702 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297a485e-2f3d-4f73-a9f8-48512a5930b5 None admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:36:35.897080 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a03599f-fe0a-4895-b491-95a07e16961c None admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:36:35.936286 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ff7eba-301e-4fa5-bf12-361c4b8a6733 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:36:35.936906 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ff7eba-301e-4fa5-bf12-361c4b8a6733 None admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:36:35.937173 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ff7eba-301e-4fa5-bf12-361c4b8a6733 None admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:36:35.937487 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ff7eba-301e-4fa5-bf12-361c4b8a6733 None admin] PATH_INFO: `/v3/users` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:36:35.938134 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ff7eba-301e-4fa5-bf12-361c4b8a6733 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=87955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:36:35.938427 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ff7eba-301e-4fa5-bf12-361c4b8a6733 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:36:35.939871 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ff7eba-301e-4fa5-bf12-361c4b8a6733 None admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:36:35.944484 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243f005b-acdf-411e-b4e1-bc1b0bd642b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:36:35.945314 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243f005b-acdf-411e-b4e1-bc1b0bd642b2 None admin] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:36:35.945764 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243f005b-acdf-411e-b4e1-bc1b0bd642b2 None admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:36:35.946226 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243f005b-acdf-411e-b4e1-bc1b0bd642b2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:36:35.947084 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243f005b-acdf-411e-b4e1-bc1b0bd642b2 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:36:35.948618 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243f005b-acdf-411e-b4e1-bc1b0bd642b2 None admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:36:35.977242 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 396/777] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 30 00:36:35 2022] POST /identity/v3/endpoints => generated 334 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 00:36:35.984334 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 382/778] 10.222.0.42 () {56 vars in 1101 bytes} [Sun Oct 30 00:36:35 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:36:36.857782 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b440901-5378-427a-9ea5-4aa9fb560e7e None None] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:36:36.858329 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b440901-5378-427a-9ea5-4aa9fb560e7e None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:36:36.858329 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b440901-5378-427a-9ea5-4aa9fb560e7e None None] PATH_INFO: `/` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:36:36.859800 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 397/779] 10.222.0.42 () {54 vars in 927 bytes} [Sun Oct 30 00:36:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:36:36.865557 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10873bf-062f-4e84-a968-eeb883798aa4 None None] REQUEST_METHOD: `POST` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:36:36.866012 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10873bf-062f-4e84-a968-eeb883798aa4 None None] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:36:36.866098 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10873bf-062f-4e84-a968-eeb883798aa4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:36:36.885544 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.auth.core [None req-f10873bf-062f-4e84-a968-eeb883798aa4 None None] MFA Rules not processed for user `eb55b6cbca4945abb21b0e49eb745e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=87955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:36:36.887096 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-f10873bf-062f-4e84-a968-eeb883798aa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:36:36.969898 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 383/780] 10.222.0.42 () {58 vars in 1024 bytes} [Sun Oct 30 00:36:36 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 30 00:36:37.247526 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b440901-5378-427a-9ea5-4aa9fb560e7e None None] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:36:37.295502 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:36:37.364127 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b440901-5378-427a-9ea5-4aa9fb560e7e None None] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:36:37.398260 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd18b2e-ac49-4332-8e50-fd2366514071 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:36:37.398890 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd18b2e-ac49-4332-8e50-fd2366514071 None admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:36:37.399166 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd18b2e-ac49-4332-8e50-fd2366514071 None admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:36:37.399474 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd18b2e-ac49-4332-8e50-fd2366514071 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:36:37.400585 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd18b2e-ac49-4332-8e50-fd2366514071 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:36:37.402145 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd18b2e-ac49-4332-8e50-fd2366514071 None admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:36:37.403926 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 398/781] 10.222.0.42 () {56 vars in 1108 bytes} [Sun Oct 30 00:36:37 2022] GET /identity/v3/domains/default => generated 199 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:36:37.409624 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10873bf-062f-4e84-a968-eeb883798aa4 None None] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:36:37.448425 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b33f0c7-1f1f-4509-8d29-ff0944caf5ef None None] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:36:37.448729 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b33f0c7-1f1f-4509-8d29-ff0944caf5ef None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:36:37.448958 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b33f0c7-1f1f-4509-8d29-ff0944caf5ef None None] PATH_INFO: `/` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:36:37.450428 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 399/782] 10.222.0.42 () {54 vars in 927 bytes} [Sun Oct 30 00:36:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 30 00:36:37.455542 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4293f09a-e6bc-42c6-b448-f34ace47858c None None] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:36:37.455817 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4293f09a-e6bc-42c6-b448-f34ace47858c None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:36:37.456084 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4293f09a-e6bc-42c6-b448-f34ace47858c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:36:37.474753 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=100 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:36:37.476277 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.auth.core [None req-4293f09a-e6bc-42c6-b448-f34ace47858c None None] MFA Rules not processed for user `eb55b6cbca4945abb21b0e49eb745e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=87956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:36:37.478209 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-4293f09a-e6bc-42c6-b448-f34ace47858c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:36:37.511137 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10873bf-062f-4e84-a968-eeb883798aa4 None None] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:36:37.547290 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 400/783] 10.222.0.42 () {58 vars in 1024 bytes} [Sun Oct 30 00:36:37 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 30 00:36:37.548214 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fdda75-da63-426a-9f34-45c6ccf1b272 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:36:37.549067 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fdda75-da63-426a-9f34-45c6ccf1b272 None admin] REQUEST_METHOD: `POST` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:36:37.549521 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fdda75-da63-426a-9f34-45c6ccf1b272 None admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:36:37.550009 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fdda75-da63-426a-9f34-45c6ccf1b272 None admin] PATH_INFO: `/v3/projects` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:36:37.550833 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fdda75-da63-426a-9f34-45c6ccf1b272 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:36:37.552459 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fdda75-da63-426a-9f34-45c6ccf1b272 None admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:36:37.579830 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 384/784] 10.222.0.42 () {60 vars in 1141 bytes} [Sun Oct 30 00:36:37 2022] POST /identity/v3/projects => generated 311 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 00:36:37.818307 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4293f09a-e6bc-42c6-b448-f34ace47858c None None] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:36:37.859411 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=100 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:36:37.932004 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4293f09a-e6bc-42c6-b448-f34ace47858c None None] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:36:37.967744 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065a069e-93a5-47fe-b1b2-5a3f526c32e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:36:37.968389 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065a069e-93a5-47fe-b1b2-5a3f526c32e4 None admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:36:37.968663 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065a069e-93a5-47fe-b1b2-5a3f526c32e4 None admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:36:37.968928 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065a069e-93a5-47fe-b1b2-5a3f526c32e4 None admin] PATH_INFO: `/v3/services/image` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:36:37.969508 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065a069e-93a5-47fe-b1b2-5a3f526c32e4 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:36:37.970869 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065a069e-93a5-47fe-b1b2-5a3f526c32e4 None admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:36:37.979941 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application [None req-065a069e-93a5-47fe-b1b2-5a3f526c32e4 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Oct 30 00:36:37.979941 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:36:37.979941 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 30 00:36:37.979941 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 30 00:36:37.979941 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 30 00:36:37.979941 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 30 00:36:37.979941 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 30 00:36:37.979941 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 30 00:36:37.979941 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 30 00:36:37.979941 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application Oct 30 00:36:37.979941 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 30 00:36:37.979941 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application Oct 30 00:36:37.979941 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:36:37.979941 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:36:37.979941 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:36:37.979941 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:36:37.979941 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:36:37.980909 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:36:37.980909 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:36:37.980909 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:36:37.980909 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:36:37.980909 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:36:37.980909 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:36:37.980909 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 30 00:36:37.980909 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 30 00:36:37.980909 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 30 00:36:37.980909 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 30 00:36:37.980909 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:36:37.980909 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:36:37.980909 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:36:37.980909 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:36:37.980909 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:36:37.980909 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:36:37.982121 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:36:37.982121 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application with Lock( Oct 30 00:36:37.982121 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:36:37.982121 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:36:37.982121 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:36:37.982121 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:36:37.982121 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:36:37.982121 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:36:37.982121 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:36:37.982121 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:36:37.982121 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 30 00:36:37.982121 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 30 00:36:37.982121 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 30 00:36:37.982121 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application Oct 30 00:36:37.983389 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 401/785] 10.222.0.42 () {56 vars in 1105 bytes} [Sun Oct 30 00:36:37 2022] GET /identity/v3/services/image => generated 86 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:36:37.987223 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fdda75-da63-426a-9f34-45c6ccf1b272 None admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:36:38.097424 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fdda75-da63-426a-9f34-45c6ccf1b272 None admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:36:38.117992 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:36:38.139730 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ca92be-6eed-4307-bbc6-6b3913b5c777 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:36:38.140717 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ca92be-6eed-4307-bbc6-6b3913b5c777 None admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:36:38.141243 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ca92be-6eed-4307-bbc6-6b3913b5c777 None admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:36:38.141737 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ca92be-6eed-4307-bbc6-6b3913b5c777 None admin] PATH_INFO: `/v3/services` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:36:38.142570 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ca92be-6eed-4307-bbc6-6b3913b5c777 None admin] RBAC: Adding query filter params (name=image) {{(pid=87955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:36:38.143159 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ca92be-6eed-4307-bbc6-6b3913b5c777 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:36:38.144753 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ca92be-6eed-4307-bbc6-6b3913b5c777 None admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:36:38.150836 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 385/786] 10.222.0.42 () {56 vars in 1108 bytes} [Sun Oct 30 00:36:37 2022] GET /identity/v3/services?name=image => generated 122 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:36:38.156820 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065a069e-93a5-47fe-b1b2-5a3f526c32e4 None admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:36:38.223849 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dc73b8-0548-4f61-9471-101f0fa4cc94 None None] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:36:38.224081 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dc73b8-0548-4f61-9471-101f0fa4cc94 None None] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:36:38.224386 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dc73b8-0548-4f61-9471-101f0fa4cc94 None None] PATH_INFO: `/` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:36:38.226072 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 386/787] 10.222.0.42 () {54 vars in 927 bytes} [Sun Oct 30 00:36:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 30 00:36:38.230750 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54903b40-166b-4c07-bdf6-d2c9d1261a78 None None] REQUEST_METHOD: `POST` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:36:38.231009 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54903b40-166b-4c07-bdf6-d2c9d1261a78 None None] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:36:38.231345 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54903b40-166b-4c07-bdf6-d2c9d1261a78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:36:38.249242 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.auth.core [None req-54903b40-166b-4c07-bdf6-d2c9d1261a78 None None] MFA Rules not processed for user `eb55b6cbca4945abb21b0e49eb745e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=87955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:36:38.250441 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-54903b40-166b-4c07-bdf6-d2c9d1261a78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:36:38.267127 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065a069e-93a5-47fe-b1b2-5a3f526c32e4 None admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:36:38.268839 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=100 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:36:38.304303 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71d31a0-5e0a-4a4d-adfe-e5468d74fdab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:36:38.304919 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71d31a0-5e0a-4a4d-adfe-e5468d74fdab None admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:36:38.305194 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71d31a0-5e0a-4a4d-adfe-e5468d74fdab None admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:36:38.305463 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71d31a0-5e0a-4a4d-adfe-e5468d74fdab None admin] PATH_INFO: `/v3/services` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:36:38.306096 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71d31a0-5e0a-4a4d-adfe-e5468d74fdab None admin] RBAC: Adding query filter params (type=image) {{(pid=87956) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:36:38.306395 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71d31a0-5e0a-4a4d-adfe-e5468d74fdab None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:36:38.307793 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71d31a0-5e0a-4a4d-adfe-e5468d74fdab None admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:36:38.312915 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 402/788] 10.222.0.42 () {56 vars in 1108 bytes} [Sun Oct 30 00:36:38 2022] GET /identity/v3/services?type=image => generated 350 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:36:38.318614 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71d31a0-5e0a-4a4d-adfe-e5468d74fdab None admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:36:38.330955 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 387/789] 10.222.0.42 () {58 vars in 1024 bytes} [Sun Oct 30 00:36:38 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 30 00:36:38.420131 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71d31a0-5e0a-4a4d-adfe-e5468d74fdab None admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:36:38.455050 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6eb64a4-7049-4d04-8f9f-550288f7639b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:36:38.455678 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6eb64a4-7049-4d04-8f9f-550288f7639b None admin] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:36:38.455951 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6eb64a4-7049-4d04-8f9f-550288f7639b None admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:36:38.456216 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6eb64a4-7049-4d04-8f9f-550288f7639b None admin] PATH_INFO: `/v3/endpoints` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:36:38.456871 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6eb64a4-7049-4d04-8f9f-550288f7639b None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:36:38.458240 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6eb64a4-7049-4d04-8f9f-550288f7639b None admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:36:38.487248 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 403/790] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 30 00:36:38 2022] POST /identity/v3/endpoints => generated 327 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 30 00:36:38.599533 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54903b40-166b-4c07-bdf6-d2c9d1261a78 None None] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:36:38.703826 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54903b40-166b-4c07-bdf6-d2c9d1261a78 None None] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:36:38.717437 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=100 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:36:38.746240 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68eab75a-1463-4d38-86f2-4a83204f9dd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:36:38.746870 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68eab75a-1463-4d38-86f2-4a83204f9dd5 None admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:36:38.747143 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68eab75a-1463-4d38-86f2-4a83204f9dd5 None admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:36:38.747439 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68eab75a-1463-4d38-86f2-4a83204f9dd5 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:36:38.757809 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68eab75a-1463-4d38-86f2-4a83204f9dd5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 30 00:36:38.762690 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application [None req-68eab75a-1463-4d38-86f2-4a83204f9dd5 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 30 00:36:38.762690 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:36:38.762690 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:36:38.762690 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:36:38.762690 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:36:38.762690 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:36:38.762690 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:36:38.762690 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:36:38.762690 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:36:38.762690 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:36:38.762690 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:36:38.762690 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:36:38.762690 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 30 00:36:38.762690 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 30 00:36:38.762690 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 30 00:36:38.762690 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 30 00:36:38.763628 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 30 00:36:38.763628 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 30 00:36:38.763628 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 30 00:36:38.763628 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 30 00:36:38.763628 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:36:38.763628 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:36:38.763628 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:36:38.763628 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:36:38.763628 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:36:38.763628 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:36:38.763628 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:36:38.763628 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application with Lock( Oct 30 00:36:38.763628 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:36:38.763628 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:36:38.763628 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:36:38.763628 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:36:38.764462 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:36:38.764462 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:36:38.764462 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:36:38.764462 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:36:38.764462 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 30 00:36:38.764462 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 30 00:36:38.764462 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 30 00:36:38.764462 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 30 00:36:38.764462 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 30 00:36:38.764462 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 30 00:36:38.764462 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 30 00:36:38.764462 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application Oct 30 00:36:38.767291 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 388/791] 10.222.0.42 () {56 vars in 1120 bytes} [Sun Oct 30 00:36:38 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:36:38.770152 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6eb64a4-7049-4d04-8f9f-550288f7639b None admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:36:38.796059 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:36:38.879430 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6eb64a4-7049-4d04-8f9f-550288f7639b None admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:36:38.913546 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de5958f-9da4-4494-a141-a4f6a6e2c170 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:36:38.914161 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de5958f-9da4-4494-a141-a4f6a6e2c170 None admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:36:38.914433 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de5958f-9da4-4494-a141-a4f6a6e2c170 None admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:36:38.914695 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de5958f-9da4-4494-a141-a4f6a6e2c170 None admin] PATH_INFO: `/v3/roles` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:36:38.915383 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de5958f-9da4-4494-a141-a4f6a6e2c170 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=87956) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:36:38.915681 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de5958f-9da4-4494-a141-a4f6a6e2c170 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:36:38.917036 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de5958f-9da4-4494-a141-a4f6a6e2c170 None admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:36:38.930362 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 404/792] 10.222.0.42 () {56 vars in 1115 bytes} [Sun Oct 30 00:36:38 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:36:38.932061 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68eab75a-1463-4d38-86f2-4a83204f9dd5 None admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:36:39.040799 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68eab75a-1463-4d38-86f2-4a83204f9dd5 None admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:36:39.082606 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5dc14e-5547-41a0-8809-9fbf8e066bf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:36:39.083265 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5dc14e-5547-41a0-8809-9fbf8e066bf2 None admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:36:39.083542 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5dc14e-5547-41a0-8809-9fbf8e066bf2 None admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:36:39.083809 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5dc14e-5547-41a0-8809-9fbf8e066bf2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:36:39.093975 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5dc14e-5547-41a0-8809-9fbf8e066bf2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:36:39.095463 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5dc14e-5547-41a0-8809-9fbf8e066bf2 None admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:36:39.109922 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application [None req-db5dc14e-5547-41a0-8809-9fbf8e066bf2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 30 00:36:39.109922 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:36:39.109922 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:36:39.109922 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:36:39.109922 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:36:39.109922 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:36:39.109922 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:36:39.109922 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:36:39.109922 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:36:39.109922 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:36:39.109922 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:36:39.109922 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:36:39.109922 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 30 00:36:39.109922 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 30 00:36:39.109922 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 30 00:36:39.109922 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 30 00:36:39.110853 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:36:39.110853 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:36:39.110853 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:36:39.110853 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:36:39.110853 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:36:39.110853 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:36:39.110853 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:36:39.110853 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application with Lock( Oct 30 00:36:39.110853 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:36:39.110853 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:36:39.110853 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:36:39.110853 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:36:39.110853 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:36:39.110853 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:36:39.110853 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:36:39.110853 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:36:39.110853 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 30 00:36:39.116797 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 30 00:36:39.116797 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 30 00:36:39.116797 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application Oct 30 00:36:39.116797 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 389/793] 10.222.0.42 () {56 vars in 1108 bytes} [Sun Oct 30 00:36:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:36:39.118464 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de5958f-9da4-4494-a141-a4f6a6e2c170 None admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:36:39.204781 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=100 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:36:39.221771 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de5958f-9da4-4494-a141-a4f6a6e2c170 None admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:36:39.257104 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdf6f69-27b0-4628-b0e6-2a3e0a8ad850 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:36:39.257710 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdf6f69-27b0-4628-b0e6-2a3e0a8ad850 None admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:36:39.257997 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdf6f69-27b0-4628-b0e6-2a3e0a8ad850 None admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:36:39.258277 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdf6f69-27b0-4628-b0e6-2a3e0a8ad850 None admin] PATH_INFO: `/v3/domains` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:36:39.258911 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcdf6f69-27b0-4628-b0e6-2a3e0a8ad850 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87956) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:36:39.259195 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcdf6f69-27b0-4628-b0e6-2a3e0a8ad850 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:36:39.260587 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcdf6f69-27b0-4628-b0e6-2a3e0a8ad850 None admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:36:39.272309 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 405/794] 10.222.0.42 () {56 vars in 1109 bytes} [Sun Oct 30 00:36:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:36:39.277869 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5dc14e-5547-41a0-8809-9fbf8e066bf2 None admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:36:39.300289 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=100 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:36:39.380577 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5dc14e-5547-41a0-8809-9fbf8e066bf2 None admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:36:39.414893 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cd8524-c3d8-4d75-a1c4-fc0cfb8d5fbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:36:39.415566 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cd8524-c3d8-4d75-a1c4-fc0cfb8d5fbd None admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:36:39.415844 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cd8524-c3d8-4d75-a1c4-fc0cfb8d5fbd None admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:36:39.416111 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cd8524-c3d8-4d75-a1c4-fc0cfb8d5fbd None admin] PATH_INFO: `/v3/users/nova` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:36:39.423774 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69cd8524-c3d8-4d75-a1c4-fc0cfb8d5fbd None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:36:39.425202 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69cd8524-c3d8-4d75-a1c4-fc0cfb8d5fbd None admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:36:39.436396 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application [None req-69cd8524-c3d8-4d75-a1c4-fc0cfb8d5fbd None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 30 00:36:39.436396 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:36:39.436396 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:36:39.436396 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:36:39.436396 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:36:39.436396 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:36:39.436396 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:36:39.436396 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:36:39.436396 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:36:39.436396 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:36:39.436396 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:36:39.436396 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:36:39.436396 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 30 00:36:39.436396 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 30 00:36:39.436396 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 30 00:36:39.436396 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 30 00:36:39.437374 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:36:39.437374 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:36:39.437374 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 30 00:36:39.437374 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 30 00:36:39.437374 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 30 00:36:39.437374 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 30 00:36:39.437374 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:36:39.437374 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:36:39.437374 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:36:39.437374 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:36:39.437374 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:36:39.437374 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application with Lock( Oct 30 00:36:39.437374 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:36:39.437374 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:36:39.437374 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:36:39.437374 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:36:39.437374 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:36:39.437374 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:36:39.438304 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:36:39.438304 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:36:39.438304 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 30 00:36:39.438304 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 30 00:36:39.438304 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 30 00:36:39.438304 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 30 00:36:39.438304 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 30 00:36:39.438304 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 30 00:36:39.438304 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 30 00:36:39.438304 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application Oct 30 00:36:39.439774 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 390/795] 10.222.0.42 () {56 vars in 1093 bytes} [Sun Oct 30 00:36:39 2022] GET /identity/v3/users/nova => generated 82 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:36:39.443458 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdf6f69-27b0-4628-b0e6-2a3e0a8ad850 None admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:36:39.551115 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdf6f69-27b0-4628-b0e6-2a3e0a8ad850 None admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:36:39.586151 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b77b505-b78f-4cf1-bbf0-21ec6e00c0c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:36:39.586766 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b77b505-b78f-4cf1-bbf0-21ec6e00c0c8 None admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:36:39.587043 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b77b505-b78f-4cf1-bbf0-21ec6e00c0c8 None admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:36:39.587342 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b77b505-b78f-4cf1-bbf0-21ec6e00c0c8 None admin] PATH_INFO: `/v3/users` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:36:39.588073 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b77b505-b78f-4cf1-bbf0-21ec6e00c0c8 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=87956) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:36:39.588379 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b77b505-b78f-4cf1-bbf0-21ec6e00c0c8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:36:39.589805 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b77b505-b78f-4cf1-bbf0-21ec6e00c0c8 None admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:36:39.608327 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 406/796] 10.222.0.42 () {56 vars in 1133 bytes} [Sun Oct 30 00:36:39 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:36:39.614160 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cd8524-c3d8-4d75-a1c4-fc0cfb8d5fbd None admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:36:39.706196 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=100 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:36:39.726481 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cd8524-c3d8-4d75-a1c4-fc0cfb8d5fbd None admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:36:39.759820 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6892a831-b2e4-43cc-aa01-ebaccee9da31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:36:39.760455 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6892a831-b2e4-43cc-aa01-ebaccee9da31 None admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:36:39.760731 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6892a831-b2e4-43cc-aa01-ebaccee9da31 None admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:36:39.761001 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6892a831-b2e4-43cc-aa01-ebaccee9da31 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:36:39.771595 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6892a831-b2e4-43cc-aa01-ebaccee9da31 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:36:39.773054 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6892a831-b2e4-43cc-aa01-ebaccee9da31 None admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:36:39.780752 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80d1fd1-d1fd-4452-979e-31d3bb7d583b None None] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:36:39.780981 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80d1fd1-d1fd-4452-979e-31d3bb7d583b None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:36:39.781215 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80d1fd1-d1fd-4452-979e-31d3bb7d583b None None] PATH_INFO: `/` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:36:39.782813 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 407/797] 10.222.0.42 () {54 vars in 927 bytes} [Sun Oct 30 00:36:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:36:39.787794 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c27ccca-30a6-47b3-8cb1-de862021cbc7 None None] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:36:39.788073 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c27ccca-30a6-47b3-8cb1-de862021cbc7 None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:36:39.788175 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application [None req-6892a831-b2e4-43cc-aa01-ebaccee9da31 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 30 00:36:39.788175 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:36:39.788175 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:36:39.788175 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:36:39.788175 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:36:39.788175 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:36:39.788175 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:36:39.788175 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:36:39.788175 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:36:39.788175 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:36:39.788175 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:36:39.788175 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:36:39.788175 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 30 00:36:39.788175 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 30 00:36:39.788175 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 30 00:36:39.788175 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 30 00:36:39.789041 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:36:39.789041 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:36:39.789041 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:36:39.789041 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:36:39.789041 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:36:39.789041 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:36:39.789041 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:36:39.789041 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application with Lock( Oct 30 00:36:39.789041 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:36:39.789041 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:36:39.789041 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:36:39.789041 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:36:39.789041 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:36:39.789041 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:36:39.789041 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:36:39.789041 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:36:39.789041 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 30 00:36:39.789920 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 30 00:36:39.789920 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 30 00:36:39.789920 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application Oct 30 00:36:39.790088 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c27ccca-30a6-47b3-8cb1-de862021cbc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:36:39.793948 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 391/798] 10.222.0.42 () {56 vars in 1108 bytes} [Sun Oct 30 00:36:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:36:39.794745 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=100 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:36:39.795184 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6892a831-b2e4-43cc-aa01-ebaccee9da31 None admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:36:39.810760 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.auth.core [None req-4c27ccca-30a6-47b3-8cb1-de862021cbc7 None None] MFA Rules not processed for user `eb55b6cbca4945abb21b0e49eb745e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=87956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:36:39.811912 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-4c27ccca-30a6-47b3-8cb1-de862021cbc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:36:39.885645 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 408/799] 10.222.0.42 () {58 vars in 1024 bytes} [Sun Oct 30 00:36:39 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 30 00:36:39.896029 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6892a831-b2e4-43cc-aa01-ebaccee9da31 None admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:36:39.929151 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=100 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:36:39.935140 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e82e2cf-943f-4ded-824c-9732df4a90cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:36:39.935857 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e82e2cf-943f-4ded-824c-9732df4a90cd None admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:36:39.936130 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e82e2cf-943f-4ded-824c-9732df4a90cd None admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:36:39.936397 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e82e2cf-943f-4ded-824c-9732df4a90cd None admin] PATH_INFO: `/v3/domains` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:36:39.937039 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e82e2cf-943f-4ded-824c-9732df4a90cd None admin] RBAC: Adding query filter params (name=Default) {{(pid=87955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:36:39.937332 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e82e2cf-943f-4ded-824c-9732df4a90cd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:36:39.938705 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e82e2cf-943f-4ded-824c-9732df4a90cd None admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:36:39.956153 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 392/800] 10.222.0.42 () {56 vars in 1109 bytes} [Sun Oct 30 00:36:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 30 00:36:39.957548 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c27ccca-30a6-47b3-8cb1-de862021cbc7 None None] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:36:40.061976 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c27ccca-30a6-47b3-8cb1-de862021cbc7 None None] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:36:40.094669 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=100 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:36:40.100743 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b001cf67-8c29-4426-a58f-b2ed6b89ad86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:36:40.101379 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b001cf67-8c29-4426-a58f-b2ed6b89ad86 None admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:36:40.101648 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b001cf67-8c29-4426-a58f-b2ed6b89ad86 None admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:36:40.101912 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b001cf67-8c29-4426-a58f-b2ed6b89ad86 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:36:40.108875 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b001cf67-8c29-4426-a58f-b2ed6b89ad86 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:36:40.110309 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b001cf67-8c29-4426-a58f-b2ed6b89ad86 None admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:36:40.121838 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application [None req-b001cf67-8c29-4426-a58f-b2ed6b89ad86 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 30 00:36:40.121838 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:36:40.121838 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:36:40.121838 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:36:40.121838 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:36:40.121838 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:36:40.121838 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:36:40.121838 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:36:40.121838 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:36:40.121838 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:36:40.121838 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:36:40.121838 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:36:40.121838 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 30 00:36:40.121838 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 30 00:36:40.121838 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 30 00:36:40.122714 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 30 00:36:40.122714 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:36:40.122714 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:36:40.122714 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:36:40.122714 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:36:40.122714 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:36:40.122714 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:36:40.122714 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:36:40.122714 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application with Lock( Oct 30 00:36:40.122714 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:36:40.122714 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:36:40.122714 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:36:40.122714 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:36:40.122714 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:36:40.122714 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:36:40.122714 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:36:40.122714 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:36:40.128222 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 30 00:36:40.128222 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 30 00:36:40.128222 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 30 00:36:40.128222 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 30 00:36:40.128222 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 30 00:36:40.128222 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 30 00:36:40.128222 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 30 00:36:40.128222 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application Oct 30 00:36:40.128222 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 409/801] 10.222.0.42 () {56 vars in 1111 bytes} [Sun Oct 30 00:36:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 30 00:36:40.130417 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e82e2cf-943f-4ded-824c-9732df4a90cd None admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:36:40.150350 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b001cf67-8c29-4426-a58f-b2ed6b89ad86 None admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:36:40.232168 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e82e2cf-943f-4ded-824c-9732df4a90cd None admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:36:40.264778 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b001cf67-8c29-4426-a58f-b2ed6b89ad86 None admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:36:40.269290 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f84969c-6719-47f4-965a-e28ea5419495 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:36:40.269925 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f84969c-6719-47f4-965a-e28ea5419495 None admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:36:40.270202 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f84969c-6719-47f4-965a-e28ea5419495 None admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:36:40.270470 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f84969c-6719-47f4-965a-e28ea5419495 None admin] PATH_INFO: `/v3/projects` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:36:40.271157 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f84969c-6719-47f4-965a-e28ea5419495 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:36:40.271642 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f84969c-6719-47f4-965a-e28ea5419495 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:36:40.273475 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f84969c-6719-47f4-965a-e28ea5419495 None admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:36:40.286887 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 393/802] 10.222.0.42 () {56 vars in 1148 bytes} [Sun Oct 30 00:36:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 30 00:36:40.292594 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f84969c-6719-47f4-965a-e28ea5419495 None admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:36:40.299900 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65296e7a-0221-4552-ba7e-3e4355e346dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:36:40.300536 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65296e7a-0221-4552-ba7e-3e4355e346dc None admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:36:40.300808 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65296e7a-0221-4552-ba7e-3e4355e346dc None admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:36:40.301069 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65296e7a-0221-4552-ba7e-3e4355e346dc None admin] PATH_INFO: `/v3/domains/default` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:36:40.302634 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65296e7a-0221-4552-ba7e-3e4355e346dc None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:36:40.304452 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65296e7a-0221-4552-ba7e-3e4355e346dc None admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:36:40.307365 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 410/803] 10.222.0.42 () {56 vars in 1108 bytes} [Sun Oct 30 00:36:40 2022] GET /identity/v3/domains/default => generated 199 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:36:40.311538 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65296e7a-0221-4552-ba7e-3e4355e346dc None admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:36:40.346668 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=100 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:36:40.374216 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=100 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:36:40.394933 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f84969c-6719-47f4-965a-e28ea5419495 None admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:36:40.416850 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65296e7a-0221-4552-ba7e-3e4355e346dc None admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:36:40.428728 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31363cab-f991-4ded-864f-08f3f9a461c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:36:40.429384 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31363cab-f991-4ded-864f-08f3f9a461c7 None admin] REQUEST_METHOD: `PUT` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:36:40.429662 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31363cab-f991-4ded-864f-08f3f9a461c7 None admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:36:40.429929 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31363cab-f991-4ded-864f-08f3f9a461c7 None admin] PATH_INFO: `/v3/projects/17d2387fdf794d4eaef07bbcd7b39f2a/users/fde877b6ddc74f4a87baf21471eb31d2/roles/a64bec5660434fb2831dc60bad3c0d2f` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:36:40.432114 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31363cab-f991-4ded-864f-08f3f9a461c7 None admin] RBAC: Authorizing `identity:create_grant(project_id=17d2387fdf794d4eaef07bbcd7b39f2a, user_id=fde877b6ddc74f4a87baf21471eb31d2, role_id=a64bec5660434fb2831dc60bad3c0d2f)` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:36:40.433534 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31363cab-f991-4ded-864f-08f3f9a461c7 None admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:36:40.448169 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 394/804] 10.222.0.42 () {58 vars in 1439 bytes} [Sun Oct 30 00:36:40 2022] PUT /identity/v3/projects/17d2387fdf794d4eaef07bbcd7b39f2a/users/fde877b6ddc74f4a87baf21471eb31d2/roles/a64bec5660434fb2831dc60bad3c0d2f => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 00:36:40.455888 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cd8d62-06f5-4027-bcca-531e2af17b16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:36:40.456522 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cd8d62-06f5-4027-bcca-531e2af17b16 None admin] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:36:40.456798 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cd8d62-06f5-4027-bcca-531e2af17b16 None admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:36:40.457065 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cd8d62-06f5-4027-bcca-531e2af17b16 None admin] PATH_INFO: `/v3/users` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:36:40.457743 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78cd8d62-06f5-4027-bcca-531e2af17b16 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:36:40.459281 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78cd8d62-06f5-4027-bcca-531e2af17b16 None admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:36:40.484933 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 411/805] 10.222.0.42 () {60 vars in 1132 bytes} [Sun Oct 30 00:36:40 2022] POST /identity/v3/users => generated 285 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 00:36:40.665146 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89747608-587d-42aa-938b-8ac9ab5b9c4b None None] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:36:40.665331 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89747608-587d-42aa-938b-8ac9ab5b9c4b None None] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:36:40.665597 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89747608-587d-42aa-938b-8ac9ab5b9c4b None None] PATH_INFO: `/` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:36:40.667128 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 395/806] 10.222.0.42 () {54 vars in 927 bytes} [Sun Oct 30 00:36:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:36:40.672718 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082d5d79-ea95-4a3c-9357-0ce39e26088a None None] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:36:40.672974 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082d5d79-ea95-4a3c-9357-0ce39e26088a None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:36:40.673272 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082d5d79-ea95-4a3c-9357-0ce39e26088a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:36:40.692195 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.auth.core [None req-082d5d79-ea95-4a3c-9357-0ce39e26088a None None] MFA Rules not processed for user `eb55b6cbca4945abb21b0e49eb745e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=87956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:36:40.693462 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-082d5d79-ea95-4a3c-9357-0ce39e26088a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:36:40.762456 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 412/807] 10.222.0.42 () {58 vars in 1024 bytes} [Sun Oct 30 00:36:40 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 30 00:36:41.026440 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89747608-587d-42aa-938b-8ac9ab5b9c4b None None] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:36:41.132878 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89747608-587d-42aa-938b-8ac9ab5b9c4b None None] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:36:41.145624 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:36:41.169114 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7898d63a-5cce-4f11-ade8-7ba6e40566c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:36:41.169719 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7898d63a-5cce-4f11-ade8-7ba6e40566c2 None admin] REQUEST_METHOD: `POST` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:36:41.169988 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7898d63a-5cce-4f11-ade8-7ba6e40566c2 None admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:36:41.170258 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7898d63a-5cce-4f11-ade8-7ba6e40566c2 None admin] PATH_INFO: `/v3/domains` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:36:41.170931 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7898d63a-5cce-4f11-ade8-7ba6e40566c2 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:36:41.172311 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7898d63a-5cce-4f11-ade8-7ba6e40566c2 None admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:36:41.180781 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.sql.core [None req-7898d63a-5cce-4f11-ade8-7ba6e40566c2 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Oct 30 00:36:41.180781 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 30 00:36:41.180781 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [parameters: {'id': '028fab4029e643e79caf1c5806e7c89a', 'name': 'Default', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] Oct 30 00:36:41.180781 dv-cinder-861491-6-smb devstack@keystone.service[87955]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=87955) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 30 00:36:41.188629 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application [None req-7898d63a-5cce-4f11-ade8-7ba6e40566c2 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default. Oct 30 00:36:41.188629 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:36:41.188629 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 30 00:36:41.188629 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 30 00:36:41.188629 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 30 00:36:41.188629 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 30 00:36:41.188629 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 30 00:36:41.188629 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application result = self._query(query) Oct 30 00:36:41.188629 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 30 00:36:41.188629 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application conn.query(q) Oct 30 00:36:41.188629 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 30 00:36:41.188629 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 30 00:36:41.188629 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 30 00:36:41.188629 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application result.read() Oct 30 00:36:41.189461 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 30 00:36:41.189461 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 30 00:36:41.189461 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 30 00:36:41.189461 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 30 00:36:41.189461 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 30 00:36:41.189461 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 30 00:36:41.189461 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 30 00:36:41.189461 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 30 00:36:41.189461 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Oct 30 00:36:41.189461 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application Oct 30 00:36:41.189461 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 30 00:36:41.189461 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application Oct 30 00:36:41.189461 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:36:41.189461 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 30 00:36:41.189461 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 30 00:36:41.189461 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Oct 30 00:36:41.189461 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return project_ref.to_dict() Oct 30 00:36:41.189461 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 30 00:36:41.190450 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application next(self.gen) Oct 30 00:36:41.190450 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1068, in _transaction_scope Oct 30 00:36:41.190450 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application yield resource Oct 30 00:36:41.190450 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 30 00:36:41.190450 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application next(self.gen) Oct 30 00:36:41.190450 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 670, in _session Oct 30 00:36:41.190450 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application self.session.rollback() Oct 30 00:36:41.190450 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 30 00:36:41.190450 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application self.force_reraise() Oct 30 00:36:41.190450 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 30 00:36:41.190450 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application raise self.value Oct 30 00:36:41.190450 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 667, in _session Oct 30 00:36:41.190450 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 30 00:36:41.190450 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 695, in _end_session_transaction Oct 30 00:36:41.190450 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application session.commit() Oct 30 00:36:41.190450 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 30 00:36:41.190450 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 30 00:36:41.191478 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 30 00:36:41.191478 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application self._prepare_impl() Oct 30 00:36:41.191478 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 30 00:36:41.191478 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application self.session.flush() Oct 30 00:36:41.191478 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 30 00:36:41.191478 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application self._flush(objects) Oct 30 00:36:41.191478 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 30 00:36:41.191478 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 30 00:36:41.191478 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 30 00:36:41.191478 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application compat.raise_( Oct 30 00:36:41.191478 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 30 00:36:41.191478 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application raise exception Oct 30 00:36:41.191478 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 30 00:36:41.191478 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application flush_context.execute() Oct 30 00:36:41.191478 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 30 00:36:41.191478 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application rec.execute(self) Oct 30 00:36:41.191478 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 30 00:36:41.192385 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 30 00:36:41.192385 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 30 00:36:41.192385 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 30 00:36:41.192385 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Oct 30 00:36:41.192385 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application c = connection._execute_20( Oct 30 00:36:41.192385 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 30 00:36:41.192385 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 30 00:36:41.192385 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 30 00:36:41.192385 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 30 00:36:41.192385 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 30 00:36:41.192385 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 30 00:36:41.192385 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 30 00:36:41.192385 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 30 00:36:41.192385 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 30 00:36:41.192385 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 30 00:36:41.193157 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 30 00:36:41.193157 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application raise exception Oct 30 00:36:41.193157 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 30 00:36:41.193157 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 30 00:36:41.193157 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 30 00:36:41.193157 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 30 00:36:41.193157 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 30 00:36:41.193157 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application result = self._query(query) Oct 30 00:36:41.193157 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 30 00:36:41.193157 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application conn.query(q) Oct 30 00:36:41.193157 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 30 00:36:41.193157 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 30 00:36:41.193157 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 30 00:36:41.193157 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application result.read() Oct 30 00:36:41.193157 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 30 00:36:41.193157 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 30 00:36:41.193157 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 30 00:36:41.194070 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 30 00:36:41.194070 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 30 00:36:41.194070 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 30 00:36:41.194070 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 30 00:36:41.194070 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 30 00:36:41.194070 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Oct 30 00:36:41.194070 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 30 00:36:41.194070 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application [parameters: {'id': '028fab4029e643e79caf1c5806e7c89a', 'name': 'Default', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] Oct 30 00:36:41.194070 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 30 00:36:41.194070 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application Oct 30 00:36:41.194070 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 30 00:36:41.194070 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application Oct 30 00:36:41.194070 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:36:41.194070 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Oct 30 00:36:41.194070 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Oct 30 00:36:41.194850 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 30 00:36:41.194850 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 30 00:36:41.194850 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name Default. Oct 30 00:36:41.194850 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application Oct 30 00:36:41.194850 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 30 00:36:41.194850 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application Oct 30 00:36:41.194850 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:36:41.194850 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:36:41.194850 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:36:41.194850 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:36:41.194850 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:36:41.194850 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:36:41.194850 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:36:41.194850 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:36:41.194850 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:36:41.194850 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:36:41.194850 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:36:41.197700 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 128, in post Oct 30 00:36:41.197700 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_domain( Oct 30 00:36:41.197700 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:36:41.197700 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:36:41.197700 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 765, in create_domain Oct 30 00:36:41.197700 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application is_domain_project = self.create_project( Oct 30 00:36:41.197700 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:36:41.197700 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:36:41.197700 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Oct 30 00:36:41.197700 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application raise exception.Conflict( Oct 30 00:36:41.197700 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default. Oct 30 00:36:41.197700 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application Oct 30 00:36:41.197700 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 396/808] 10.222.0.42 () {60 vars in 1137 bytes} [Sun Oct 30 00:36:41 2022] POST /identity/v3/domains => generated 190 bytes in 164 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:36:41.199345 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082d5d79-ea95-4a3c-9357-0ce39e26088a None None] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:36:41.244891 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:36:41.301195 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082d5d79-ea95-4a3c-9357-0ce39e26088a None None] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:36:41.336590 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe2eb3e-3deb-467c-b844-8b6305c6e4e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:36:41.337228 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe2eb3e-3deb-467c-b844-8b6305c6e4e0 None admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:36:41.337504 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe2eb3e-3deb-467c-b844-8b6305c6e4e0 None admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:36:41.337772 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe2eb3e-3deb-467c-b844-8b6305c6e4e0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:36:41.349048 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe2eb3e-3deb-467c-b844-8b6305c6e4e0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:36:41.350568 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe2eb3e-3deb-467c-b844-8b6305c6e4e0 None admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:36:41.366961 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application [None req-4fe2eb3e-3deb-467c-b844-8b6305c6e4e0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 30 00:36:41.366961 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:36:41.366961 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:36:41.366961 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:36:41.366961 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:36:41.366961 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:36:41.366961 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:36:41.366961 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:36:41.366961 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:36:41.366961 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:36:41.366961 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:36:41.366961 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:36:41.366961 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 30 00:36:41.366961 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 30 00:36:41.366961 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 30 00:36:41.366961 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 30 00:36:41.368010 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:36:41.368010 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:36:41.368010 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:36:41.368010 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:36:41.368010 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:36:41.368010 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:36:41.368010 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:36:41.368010 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application with Lock( Oct 30 00:36:41.368010 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:36:41.368010 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:36:41.368010 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:36:41.368010 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:36:41.368010 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:36:41.368010 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:36:41.368010 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:36:41.368010 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:36:41.368010 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 30 00:36:41.368887 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 30 00:36:41.368887 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 30 00:36:41.368887 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application Oct 30 00:36:41.371573 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 413/809] 10.222.0.42 () {56 vars in 1108 bytes} [Sun Oct 30 00:36:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:36:41.374228 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7898d63a-5cce-4f11-ade8-7ba6e40566c2 None admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:36:41.479640 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7898d63a-5cce-4f11-ade8-7ba6e40566c2 None admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:36:41.515606 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f976dc-a340-4ff5-b640-bdcf92044868 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:36:41.516458 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f976dc-a340-4ff5-b640-bdcf92044868 None admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:36:41.516736 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f976dc-a340-4ff5-b640-bdcf92044868 None admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:36:41.517006 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f976dc-a340-4ff5-b640-bdcf92044868 None admin] PATH_INFO: `/v3/domains` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:36:41.517651 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f976dc-a340-4ff5-b640-bdcf92044868 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:36:41.517950 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f976dc-a340-4ff5-b640-bdcf92044868 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:36:41.519346 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f976dc-a340-4ff5-b640-bdcf92044868 None admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:36:41.531481 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 397/810] 10.222.0.42 () {56 vars in 1109 bytes} [Sun Oct 30 00:36:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:36:42.618187 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6633bd38-d0a8-4f0d-b56a-38d98478c4e0 None None] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:36:42.618770 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6633bd38-d0a8-4f0d-b56a-38d98478c4e0 None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:36:42.618770 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6633bd38-d0a8-4f0d-b56a-38d98478c4e0 None None] PATH_INFO: `/` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:36:42.620089 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 414/811] 10.222.0.42 () {54 vars in 927 bytes} [Sun Oct 30 00:36:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:36:42.625399 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774500b5-bb46-4911-84cd-8c8864c5b16b None None] REQUEST_METHOD: `POST` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:36:42.625808 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774500b5-bb46-4911-84cd-8c8864c5b16b None None] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:36:42.626073 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774500b5-bb46-4911-84cd-8c8864c5b16b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:36:42.632251 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2530b9-320d-4fa5-9e2e-55b4bf51efc3 None None] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:36:42.632525 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2530b9-320d-4fa5-9e2e-55b4bf51efc3 None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:36:42.632810 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2530b9-320d-4fa5-9e2e-55b4bf51efc3 None None] PATH_INFO: `/` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:36:42.634204 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 415/812] 10.222.0.42 () {54 vars in 927 bytes} [Sun Oct 30 00:36:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:36:42.639183 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc823a1b-6618-4170-bb3e-a472d47a92d7 None None] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:36:42.639488 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc823a1b-6618-4170-bb3e-a472d47a92d7 None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:36:42.639757 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc823a1b-6618-4170-bb3e-a472d47a92d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:36:42.645632 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.auth.core [None req-774500b5-bb46-4911-84cd-8c8864c5b16b None None] MFA Rules not processed for user `eb55b6cbca4945abb21b0e49eb745e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=87955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:36:42.646832 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-774500b5-bb46-4911-84cd-8c8864c5b16b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:36:42.657771 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.auth.core [None req-fc823a1b-6618-4170-bb3e-a472d47a92d7 None None] MFA Rules not processed for user `eb55b6cbca4945abb21b0e49eb745e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=87956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:36:42.658920 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-fc823a1b-6618-4170-bb3e-a472d47a92d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:36:42.678203 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:36:42.718603 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 398/813] 10.222.0.42 () {58 vars in 1024 bytes} [Sun Oct 30 00:36:42 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 30 00:36:42.727862 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 416/814] 10.222.0.42 () {58 vars in 1024 bytes} [Sun Oct 30 00:36:42 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 30 00:36:42.980623 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774500b5-bb46-4911-84cd-8c8864c5b16b None None] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:36:42.985215 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc823a1b-6618-4170-bb3e-a472d47a92d7 None None] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:36:43.013578 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=100 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:36:43.084388 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774500b5-bb46-4911-84cd-8c8864c5b16b None None] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:36:43.087403 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc823a1b-6618-4170-bb3e-a472d47a92d7 None None] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:36:43.117628 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0beb66f0-4e22-4cca-a80f-b9bd0f6f7263 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:36:43.118251 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0beb66f0-4e22-4cca-a80f-b9bd0f6f7263 None admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:36:43.118526 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0beb66f0-4e22-4cca-a80f-b9bd0f6f7263 None admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:36:43.118792 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0beb66f0-4e22-4cca-a80f-b9bd0f6f7263 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:36:43.120476 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9892887d-3fbc-4461-8fb6-45044982624a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:36:43.121095 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9892887d-3fbc-4461-8fb6-45044982624a None admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:36:43.121371 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9892887d-3fbc-4461-8fb6-45044982624a None admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:36:43.121656 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9892887d-3fbc-4461-8fb6-45044982624a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:36:43.128557 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0beb66f0-4e22-4cca-a80f-b9bd0f6f7263 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 30 00:36:43.131880 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9892887d-3fbc-4461-8fb6-45044982624a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 30 00:36:43.133293 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application [None req-0beb66f0-4e22-4cca-a80f-b9bd0f6f7263 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 30 00:36:43.133293 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:36:43.133293 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:36:43.133293 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:36:43.133293 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:36:43.133293 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:36:43.133293 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:36:43.133293 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:36:43.133293 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:36:43.133293 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:36:43.133293 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:36:43.133293 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:36:43.133293 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 30 00:36:43.133293 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 30 00:36:43.133293 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 30 00:36:43.133293 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 30 00:36:43.134404 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 30 00:36:43.134404 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 30 00:36:43.134404 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 30 00:36:43.134404 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 30 00:36:43.134404 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:36:43.134404 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:36:43.134404 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:36:43.134404 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:36:43.134404 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:36:43.134404 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:36:43.134404 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:36:43.134404 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application with Lock( Oct 30 00:36:43.134404 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:36:43.134404 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:36:43.134404 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:36:43.134404 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:36:43.135326 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:36:43.135326 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:36:43.135326 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:36:43.135326 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:36:43.135326 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 30 00:36:43.135326 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 30 00:36:43.135326 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 30 00:36:43.135326 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 30 00:36:43.135326 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 30 00:36:43.135326 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 30 00:36:43.135326 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 30 00:36:43.135326 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application Oct 30 00:36:43.135326 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 399/815] 10.222.0.42 () {56 vars in 1120 bytes} [Sun Oct 30 00:36:42 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:36:43.136692 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application [None req-9892887d-3fbc-4461-8fb6-45044982624a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 30 00:36:43.136692 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:36:43.136692 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:36:43.136692 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:36:43.136692 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:36:43.136692 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:36:43.136692 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:36:43.136692 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:36:43.136692 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:36:43.136692 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:36:43.136692 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:36:43.136692 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:36:43.136692 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 30 00:36:43.136692 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 30 00:36:43.136692 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 30 00:36:43.136692 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 30 00:36:43.137804 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 30 00:36:43.137804 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 30 00:36:43.137804 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 30 00:36:43.137804 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 30 00:36:43.137804 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:36:43.137804 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:36:43.137804 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:36:43.137804 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:36:43.137804 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:36:43.137804 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:36:43.137804 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:36:43.137804 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application with Lock( Oct 30 00:36:43.137804 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:36:43.137804 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:36:43.137804 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:36:43.137804 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:36:43.138938 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:36:43.138938 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:36:43.138938 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:36:43.138938 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:36:43.138938 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 30 00:36:43.138938 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 30 00:36:43.138938 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 30 00:36:43.138938 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 30 00:36:43.138938 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 30 00:36:43.138938 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 30 00:36:43.138938 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 30 00:36:43.138938 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application Oct 30 00:36:43.138938 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 417/816] 10.222.0.42 () {56 vars in 1096 bytes} [Sun Oct 30 00:36:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:36:43.143536 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0beb66f0-4e22-4cca-a80f-b9bd0f6f7263 None admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:36:43.143778 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9892887d-3fbc-4461-8fb6-45044982624a None admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:36:43.170522 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=100 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:36:43.229943 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=100 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:36:43.242981 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9892887d-3fbc-4461-8fb6-45044982624a None admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:36:43.243141 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0beb66f0-4e22-4cca-a80f-b9bd0f6f7263 None admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:36:43.277739 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbeee612-e62d-41cd-b27e-33b6131a9799 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:36:43.278334 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbeee612-e62d-41cd-b27e-33b6131a9799 None admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:36:43.278603 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbeee612-e62d-41cd-b27e-33b6131a9799 None admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:36:43.278862 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbeee612-e62d-41cd-b27e-33b6131a9799 None admin] PATH_INFO: `/v3/roles` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:36:43.279061 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a1aef8-4664-4c5b-b7b1-faa5d644e951 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:36:43.279553 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbeee612-e62d-41cd-b27e-33b6131a9799 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=87956) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:36:43.279695 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a1aef8-4664-4c5b-b7b1-faa5d644e951 None admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:36:43.279851 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbeee612-e62d-41cd-b27e-33b6131a9799 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:36:43.279952 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a1aef8-4664-4c5b-b7b1-faa5d644e951 None admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:36:43.280237 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a1aef8-4664-4c5b-b7b1-faa5d644e951 None admin] PATH_INFO: `/v3/roles` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:36:43.280923 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a1aef8-4664-4c5b-b7b1-faa5d644e951 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:36:43.281223 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a1aef8-4664-4c5b-b7b1-faa5d644e951 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:36:43.281321 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbeee612-e62d-41cd-b27e-33b6131a9799 None admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:36:43.282575 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a1aef8-4664-4c5b-b7b1-faa5d644e951 None admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:36:43.289177 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 418/817] 10.222.0.42 () {56 vars in 1115 bytes} [Sun Oct 30 00:36:43 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 30 00:36:43.296783 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 400/818] 10.222.0.42 () {56 vars in 1099 bytes} [Sun Oct 30 00:36:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:36:43.296941 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbeee612-e62d-41cd-b27e-33b6131a9799 None admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:36:43.297600 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a1aef8-4664-4c5b-b7b1-faa5d644e951 None admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:36:43.384311 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=100 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:36:43.391555 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbeee612-e62d-41cd-b27e-33b6131a9799 None admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:36:43.396996 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a1aef8-4664-4c5b-b7b1-faa5d644e951 None admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:36:43.425665 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c047a8-07f7-43e9-a984-d2c8ee3d6121 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:36:43.426308 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c047a8-07f7-43e9-a984-d2c8ee3d6121 None admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:36:43.426577 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c047a8-07f7-43e9-a984-d2c8ee3d6121 None admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:36:43.426839 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c047a8-07f7-43e9-a984-d2c8ee3d6121 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:36:43.429920 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588775ad-5e10-41ea-ac4d-8d84bb1ebaa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:36:43.430543 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588775ad-5e10-41ea-ac4d-8d84bb1ebaa1 None admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:36:43.430817 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588775ad-5e10-41ea-ac4d-8d84bb1ebaa1 None admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:36:43.431086 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588775ad-5e10-41ea-ac4d-8d84bb1ebaa1 None admin] PATH_INFO: `/v3/users/24c4c1e0e91641eaae927853c58db195` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:36:43.436930 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c047a8-07f7-43e9-a984-d2c8ee3d6121 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:36:43.438381 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c047a8-07f7-43e9-a984-d2c8ee3d6121 None admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:36:43.444449 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588775ad-5e10-41ea-ac4d-8d84bb1ebaa1 None admin] RBAC: Authorizing `identity:get_user(user_id=24c4c1e0e91641eaae927853c58db195)` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:36:43.445864 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588775ad-5e10-41ea-ac4d-8d84bb1ebaa1 None admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:36:43.447550 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 401/819] 10.222.0.42 () {56 vars in 1177 bytes} [Sun Oct 30 00:36:43 2022] GET /identity/v3/users/24c4c1e0e91641eaae927853c58db195 => generated 285 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 30 00:36:43.452429 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application [None req-61c047a8-07f7-43e9-a984-d2c8ee3d6121 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 30 00:36:43.452429 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:36:43.452429 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:36:43.452429 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:36:43.452429 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:36:43.452429 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:36:43.452429 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:36:43.452429 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:36:43.452429 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:36:43.452429 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:36:43.452429 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:36:43.452429 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:36:43.452429 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 30 00:36:43.452429 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 30 00:36:43.452429 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 30 00:36:43.452429 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 30 00:36:43.453374 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:36:43.453374 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:36:43.453374 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:36:43.453374 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:36:43.453374 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:36:43.453374 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:36:43.453374 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:36:43.453374 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application with Lock( Oct 30 00:36:43.453374 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:36:43.453374 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:36:43.453374 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:36:43.453374 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:36:43.453374 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:36:43.453374 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:36:43.453374 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:36:43.453374 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:36:43.453374 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 30 00:36:43.454299 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 30 00:36:43.454299 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 30 00:36:43.454299 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application Oct 30 00:36:43.454299 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 419/820] 10.222.0.42 () {56 vars in 1108 bytes} [Sun Oct 30 00:36:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:36:43.454690 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588775ad-5e10-41ea-ac4d-8d84bb1ebaa1 None admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:36:43.458896 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c047a8-07f7-43e9-a984-d2c8ee3d6121 None admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:36:43.461549 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=100 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:36:43.550151 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588775ad-5e10-41ea-ac4d-8d84bb1ebaa1 None admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:36:43.556517 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c047a8-07f7-43e9-a984-d2c8ee3d6121 None admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:36:43.587176 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344e42f9-d694-473f-b770-5702d6527efd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:36:43.587817 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344e42f9-d694-473f-b770-5702d6527efd None admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:36:43.588095 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344e42f9-d694-473f-b770-5702d6527efd None admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:36:43.588367 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344e42f9-d694-473f-b770-5702d6527efd None admin] PATH_INFO: `/v3/projects/5787f7e89a5648b9853887e36521e9f4` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:36:43.589477 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344e42f9-d694-473f-b770-5702d6527efd None admin] RBAC: Authorizing `identity:get_project(project_id=5787f7e89a5648b9853887e36521e9f4)` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:36:43.590217 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e4f40b-6f36-4dd1-a4ba-28390819de99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:36:43.590825 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e4f40b-6f36-4dd1-a4ba-28390819de99 None admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:36:43.591021 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344e42f9-d694-473f-b770-5702d6527efd None admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:36:43.591111 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e4f40b-6f36-4dd1-a4ba-28390819de99 None admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:36:43.591395 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e4f40b-6f36-4dd1-a4ba-28390819de99 None admin] PATH_INFO: `/v3/domains` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:36:43.592035 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e4f40b-6f36-4dd1-a4ba-28390819de99 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87956) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:36:43.592336 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e4f40b-6f36-4dd1-a4ba-28390819de99 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:36:43.592699 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 402/821] 10.222.0.42 () {56 vars in 1186 bytes} [Sun Oct 30 00:36:43 2022] GET /identity/v3/projects/5787f7e89a5648b9853887e36521e9f4 => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:36:43.593693 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e4f40b-6f36-4dd1-a4ba-28390819de99 None admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:36:43.598655 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344e42f9-d694-473f-b770-5702d6527efd None admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:36:43.610315 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 420/822] 10.222.0.42 () {56 vars in 1109 bytes} [Sun Oct 30 00:36:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:36:43.611405 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e4f40b-6f36-4dd1-a4ba-28390819de99 None admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:36:43.613928 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=100 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:36:43.697554 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=100 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:36:43.715604 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344e42f9-d694-473f-b770-5702d6527efd None admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:36:43.739338 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e4f40b-6f36-4dd1-a4ba-28390819de99 None admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:36:43.751425 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747f93c6-afd1-4030-a2b3-2296ad7b3764 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:36:43.752083 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747f93c6-afd1-4030-a2b3-2296ad7b3764 None admin] REQUEST_METHOD: `PUT` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:36:43.752361 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747f93c6-afd1-4030-a2b3-2296ad7b3764 None admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:36:43.752615 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747f93c6-afd1-4030-a2b3-2296ad7b3764 None admin] PATH_INFO: `/v3/projects/5787f7e89a5648b9853887e36521e9f4/users/24c4c1e0e91641eaae927853c58db195/roles/6ccaa8c11f29456fb4e4eeccb21616c7` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:36:43.754545 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747f93c6-afd1-4030-a2b3-2296ad7b3764 None admin] RBAC: Authorizing `identity:create_grant(project_id=5787f7e89a5648b9853887e36521e9f4, user_id=24c4c1e0e91641eaae927853c58db195, role_id=6ccaa8c11f29456fb4e4eeccb21616c7)` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:36:43.756167 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747f93c6-afd1-4030-a2b3-2296ad7b3764 None admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:36:43.769769 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 403/823] 10.222.0.42 () {58 vars in 1439 bytes} [Sun Oct 30 00:36:43 2022] PUT /identity/v3/projects/5787f7e89a5648b9853887e36521e9f4/users/24c4c1e0e91641eaae927853c58db195/roles/6ccaa8c11f29456fb4e4eeccb21616c7 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 00:36:43.774358 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca40198-eef2-4680-aae6-c972acd28b90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:36:43.775004 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca40198-eef2-4680-aae6-c972acd28b90 None admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:36:43.775316 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca40198-eef2-4680-aae6-c972acd28b90 None admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:36:43.775588 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca40198-eef2-4680-aae6-c972acd28b90 None admin] PATH_INFO: `/v3/users/nova` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:36:43.783839 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca40198-eef2-4680-aae6-c972acd28b90 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:36:43.785325 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca40198-eef2-4680-aae6-c972acd28b90 None admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:36:43.798870 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application [None req-1ca40198-eef2-4680-aae6-c972acd28b90 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 30 00:36:43.798870 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:36:43.798870 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:36:43.798870 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:36:43.798870 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:36:43.798870 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:36:43.798870 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:36:43.798870 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:36:43.798870 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:36:43.798870 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:36:43.798870 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:36:43.798870 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:36:43.798870 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 30 00:36:43.798870 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 30 00:36:43.798870 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 30 00:36:43.798870 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 30 00:36:43.800090 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:36:43.800090 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:36:43.800090 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 30 00:36:43.800090 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 30 00:36:43.800090 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 30 00:36:43.800090 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 30 00:36:43.800090 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:36:43.800090 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:36:43.800090 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:36:43.800090 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:36:43.800090 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:36:43.800090 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application with Lock( Oct 30 00:36:43.800090 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:36:43.800090 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:36:43.800090 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:36:43.800090 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:36:43.800090 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:36:43.800090 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:36:43.801076 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:36:43.801076 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:36:43.801076 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 30 00:36:43.801076 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 30 00:36:43.801076 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 30 00:36:43.801076 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 30 00:36:43.801076 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 30 00:36:43.801076 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 30 00:36:43.801076 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 30 00:36:43.801076 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application Oct 30 00:36:43.801076 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 421/824] 10.222.0.42 () {56 vars in 1093 bytes} [Sun Oct 30 00:36:43 2022] GET /identity/v3/users/nova => generated 82 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:36:43.806516 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747f93c6-afd1-4030-a2b3-2296ad7b3764 None admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:36:43.888869 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:36:43.916557 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747f93c6-afd1-4030-a2b3-2296ad7b3764 None admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:36:43.962904 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdef0f59-26a7-44bb-b59d-e7d6cb0ee46d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:36:43.963586 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdef0f59-26a7-44bb-b59d-e7d6cb0ee46d None admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:36:43.963860 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdef0f59-26a7-44bb-b59d-e7d6cb0ee46d None admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:36:43.964125 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdef0f59-26a7-44bb-b59d-e7d6cb0ee46d None admin] PATH_INFO: `/v3/users` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:36:43.964847 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdef0f59-26a7-44bb-b59d-e7d6cb0ee46d None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=87955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:36:43.965140 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdef0f59-26a7-44bb-b59d-e7d6cb0ee46d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:36:43.966591 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdef0f59-26a7-44bb-b59d-e7d6cb0ee46d None admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:36:43.984042 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 404/825] 10.222.0.42 () {56 vars in 1133 bytes} [Sun Oct 30 00:36:43 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:36:43.989980 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca40198-eef2-4680-aae6-c972acd28b90 None admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:36:44.098382 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca40198-eef2-4680-aae6-c972acd28b90 None admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:36:44.120946 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=100 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:36:44.133209 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4402b68e-a0d5-4308-9fd3-c7a6295b2555 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:36:44.133817 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4402b68e-a0d5-4308-9fd3-c7a6295b2555 None admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:36:44.134088 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4402b68e-a0d5-4308-9fd3-c7a6295b2555 None admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:36:44.134350 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4402b68e-a0d5-4308-9fd3-c7a6295b2555 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:36:44.199703 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4402b68e-a0d5-4308-9fd3-c7a6295b2555 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:36:44.201135 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4402b68e-a0d5-4308-9fd3-c7a6295b2555 None admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:36:44.298781 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 422/826] 10.222.0.42 () {58 vars in 1282 bytes} [Sun Oct 30 00:36:43 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 30 00:36:44.304673 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdef0f59-26a7-44bb-b59d-e7d6cb0ee46d None admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:36:44.401752 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdef0f59-26a7-44bb-b59d-e7d6cb0ee46d None admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:36:44.431627 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=100 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:36:44.437571 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391ed933-59b7-472b-97ab-674ed171bbd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:36:44.438203 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391ed933-59b7-472b-97ab-674ed171bbd9 None admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:36:44.438477 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391ed933-59b7-472b-97ab-674ed171bbd9 None admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:36:44.438742 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391ed933-59b7-472b-97ab-674ed171bbd9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:36:44.448820 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391ed933-59b7-472b-97ab-674ed171bbd9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:36:44.450267 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391ed933-59b7-472b-97ab-674ed171bbd9 None admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:36:44.465014 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application [None req-391ed933-59b7-472b-97ab-674ed171bbd9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 30 00:36:44.465014 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:36:44.465014 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:36:44.465014 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:36:44.465014 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:36:44.465014 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:36:44.465014 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:36:44.465014 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:36:44.465014 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:36:44.465014 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:36:44.465014 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:36:44.465014 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:36:44.465014 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 30 00:36:44.465014 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 30 00:36:44.465014 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 30 00:36:44.465014 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 30 00:36:44.465961 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:36:44.465961 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:36:44.465961 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:36:44.465961 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:36:44.465961 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:36:44.465961 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:36:44.465961 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:36:44.465961 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application with Lock( Oct 30 00:36:44.465961 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:36:44.465961 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:36:44.465961 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:36:44.465961 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:36:44.465961 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:36:44.465961 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:36:44.465961 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:36:44.465961 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:36:44.465961 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 30 00:36:44.466850 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 30 00:36:44.466850 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 30 00:36:44.466850 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application Oct 30 00:36:44.466850 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 405/827] 10.222.0.42 () {56 vars in 1108 bytes} [Sun Oct 30 00:36:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:36:44.472002 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4402b68e-a0d5-4308-9fd3-c7a6295b2555 None admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:36:44.496040 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=100 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:36:44.572997 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4402b68e-a0d5-4308-9fd3-c7a6295b2555 None admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:36:44.608152 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecb7d04-8eca-4d0b-b0fc-b162fb854b8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:36:44.608756 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecb7d04-8eca-4d0b-b0fc-b162fb854b8d None admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:36:44.609026 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecb7d04-8eca-4d0b-b0fc-b162fb854b8d None admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:36:44.609289 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecb7d04-8eca-4d0b-b0fc-b162fb854b8d None admin] PATH_INFO: `/v3/domains` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:36:44.609924 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ecb7d04-8eca-4d0b-b0fc-b162fb854b8d None admin] RBAC: Adding query filter params (name=Default) {{(pid=87956) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:36:44.610218 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ecb7d04-8eca-4d0b-b0fc-b162fb854b8d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:36:44.611618 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ecb7d04-8eca-4d0b-b0fc-b162fb854b8d None admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:36:44.623040 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 423/828] 10.222.0.42 () {56 vars in 1109 bytes} [Sun Oct 30 00:36:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:36:44.628971 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391ed933-59b7-472b-97ab-674ed171bbd9 None admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:36:44.728756 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391ed933-59b7-472b-97ab-674ed171bbd9 None admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:36:44.762733 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0cba02-0d96-48f2-9670-d7d4aa14abc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:36:44.763386 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0cba02-0d96-48f2-9670-d7d4aa14abc6 None admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:36:44.763666 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0cba02-0d96-48f2-9670-d7d4aa14abc6 None admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:36:44.763935 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0cba02-0d96-48f2-9670-d7d4aa14abc6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:36:44.771004 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0cba02-0d96-48f2-9670-d7d4aa14abc6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:36:44.772609 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0cba02-0d96-48f2-9670-d7d4aa14abc6 None admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:36:44.784173 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application [None req-2b0cba02-0d96-48f2-9670-d7d4aa14abc6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 30 00:36:44.784173 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:36:44.784173 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:36:44.784173 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:36:44.784173 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:36:44.784173 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:36:44.784173 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:36:44.784173 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:36:44.784173 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:36:44.784173 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:36:44.784173 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:36:44.784173 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:36:44.784173 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 30 00:36:44.784173 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 30 00:36:44.784173 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 30 00:36:44.785217 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 30 00:36:44.785217 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:36:44.785217 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:36:44.785217 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:36:44.785217 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:36:44.785217 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:36:44.785217 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:36:44.785217 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:36:44.785217 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application with Lock( Oct 30 00:36:44.785217 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:36:44.785217 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:36:44.785217 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:36:44.785217 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:36:44.785217 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:36:44.785217 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:36:44.785217 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:36:44.785217 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:36:44.786099 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 30 00:36:44.786099 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 30 00:36:44.786099 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 30 00:36:44.786099 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 30 00:36:44.786099 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 30 00:36:44.786099 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 30 00:36:44.786099 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 30 00:36:44.786099 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application Oct 30 00:36:44.786099 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 406/829] 10.222.0.42 () {56 vars in 1111 bytes} [Sun Oct 30 00:36:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:36:44.791460 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecb7d04-8eca-4d0b-b0fc-b162fb854b8d None admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:36:44.874525 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=100 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:36:44.893336 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecb7d04-8eca-4d0b-b0fc-b162fb854b8d None admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:36:44.928294 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806b5642-5396-4501-9b21-1120421d0c79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:36:44.928895 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806b5642-5396-4501-9b21-1120421d0c79 None admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:36:44.929168 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806b5642-5396-4501-9b21-1120421d0c79 None admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:36:44.929434 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806b5642-5396-4501-9b21-1120421d0c79 None admin] PATH_INFO: `/v3/projects` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:36:44.930147 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806b5642-5396-4501-9b21-1120421d0c79 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87956) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:36:44.930444 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806b5642-5396-4501-9b21-1120421d0c79 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:36:44.931930 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806b5642-5396-4501-9b21-1120421d0c79 None admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:36:44.945804 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 424/830] 10.222.0.42 () {56 vars in 1148 bytes} [Sun Oct 30 00:36:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:36:44.952299 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0cba02-0d96-48f2-9670-d7d4aa14abc6 None admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:36:44.999397 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=100 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:36:45.056249 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0cba02-0d96-48f2-9670-d7d4aa14abc6 None admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:36:45.089036 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e34dd0e-fa38-42f2-977b-f4dd6d93951e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:36:45.089625 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e34dd0e-fa38-42f2-977b-f4dd6d93951e None admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:36:45.089900 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e34dd0e-fa38-42f2-977b-f4dd6d93951e None admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:36:45.090162 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e34dd0e-fa38-42f2-977b-f4dd6d93951e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:36:45.090906 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e34dd0e-fa38-42f2-977b-f4dd6d93951e None admin] RBAC: Adding query filter params (role.id=a64bec5660434fb2831dc60bad3c0d2f, scope.project.id=17d2387fdf794d4eaef07bbcd7b39f2a, user.id=fde877b6ddc74f4a87baf21471eb31d2) {{(pid=87955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:36:45.091217 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e34dd0e-fa38-42f2-977b-f4dd6d93951e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:36:45.092630 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e34dd0e-fa38-42f2-977b-f4dd6d93951e None admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:36:45.098252 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 407/831] 10.222.0.42 () {56 vars in 1374 bytes} [Sun Oct 30 00:36:44 2022] GET /identity/v3/role_assignments?user.id=fde877b6ddc74f4a87baf21471eb31d2&scope.project.id=17d2387fdf794d4eaef07bbcd7b39f2a&role.id=a64bec5660434fb2831dc60bad3c0d2f => generated 608 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:36:45.889339 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a607aa9b-fffe-47b2-b486-4b751bda34b0 None None] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:36:45.891873 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a607aa9b-fffe-47b2-b486-4b751bda34b0 None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:36:45.891873 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a607aa9b-fffe-47b2-b486-4b751bda34b0 None None] PATH_INFO: `/` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:36:45.891873 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 425/832] 10.222.0.42 () {54 vars in 927 bytes} [Sun Oct 30 00:36:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:36:45.897166 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc219980-8057-41e7-ac72-61168cdb8dca None None] REQUEST_METHOD: `POST` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:36:45.897641 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc219980-8057-41e7-ac72-61168cdb8dca None None] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:36:45.897742 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc219980-8057-41e7-ac72-61168cdb8dca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:36:45.918648 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.auth.core [None req-fc219980-8057-41e7-ac72-61168cdb8dca None None] MFA Rules not processed for user `eb55b6cbca4945abb21b0e49eb745e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=87955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:36:45.919886 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-fc219980-8057-41e7-ac72-61168cdb8dca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:36:45.987939 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 408/833] 10.222.0.42 () {58 vars in 1024 bytes} [Sun Oct 30 00:36:45 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 30 00:36:46.259029 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a607aa9b-fffe-47b2-b486-4b751bda34b0 None None] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:36:46.366378 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a607aa9b-fffe-47b2-b486-4b751bda34b0 None None] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:36:46.400559 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309de3e5-c2c4-4f0b-adbc-a863960c07eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:36:46.401173 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309de3e5-c2c4-4f0b-adbc-a863960c07eb None admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:36:46.401446 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309de3e5-c2c4-4f0b-adbc-a863960c07eb None admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:36:46.401712 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309de3e5-c2c4-4f0b-adbc-a863960c07eb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:36:46.411958 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309de3e5-c2c4-4f0b-adbc-a863960c07eb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 30 00:36:46.416796 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application [None req-309de3e5-c2c4-4f0b-adbc-a863960c07eb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 30 00:36:46.416796 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:36:46.416796 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:36:46.416796 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:36:46.416796 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:36:46.416796 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:36:46.416796 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:36:46.416796 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:36:46.416796 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:36:46.416796 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:36:46.416796 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:36:46.416796 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:36:46.416796 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 30 00:36:46.416796 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 30 00:36:46.416796 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 30 00:36:46.416796 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 30 00:36:46.417881 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 30 00:36:46.417881 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 30 00:36:46.417881 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 30 00:36:46.417881 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 30 00:36:46.417881 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:36:46.417881 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:36:46.417881 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:36:46.417881 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:36:46.417881 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:36:46.417881 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:36:46.417881 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:36:46.417881 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application with Lock( Oct 30 00:36:46.417881 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:36:46.417881 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:36:46.417881 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:36:46.417881 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:36:46.418789 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:36:46.418789 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:36:46.418789 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:36:46.418789 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:36:46.418789 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 30 00:36:46.418789 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 30 00:36:46.418789 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 30 00:36:46.418789 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 30 00:36:46.418789 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 30 00:36:46.418789 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 30 00:36:46.418789 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 30 00:36:46.418789 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application Oct 30 00:36:46.418789 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 426/834] 10.222.0.42 () {56 vars in 1096 bytes} [Sun Oct 30 00:36:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:36:46.424915 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc219980-8057-41e7-ac72-61168cdb8dca None None] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:36:46.473292 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=100 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:36:46.537760 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc219980-8057-41e7-ac72-61168cdb8dca None None] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:36:46.573201 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfaaa69-e8f0-43e7-a764-c093b9c9955d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:36:46.573803 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfaaa69-e8f0-43e7-a764-c093b9c9955d None admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:36:46.574080 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfaaa69-e8f0-43e7-a764-c093b9c9955d None admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:36:46.574348 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfaaa69-e8f0-43e7-a764-c093b9c9955d None admin] PATH_INFO: `/v3/roles` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:36:46.575013 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adfaaa69-e8f0-43e7-a764-c093b9c9955d None admin] RBAC: Adding query filter params (name=admin) {{(pid=87955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:36:46.575345 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adfaaa69-e8f0-43e7-a764-c093b9c9955d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:36:46.577033 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adfaaa69-e8f0-43e7-a764-c093b9c9955d None admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:36:46.585295 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 409/835] 10.222.0.42 () {56 vars in 1099 bytes} [Sun Oct 30 00:36:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:36:46.591462 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309de3e5-c2c4-4f0b-adbc-a863960c07eb None admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:36:46.595127 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=100 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:36:46.697713 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309de3e5-c2c4-4f0b-adbc-a863960c07eb None admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:36:46.736364 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2206844-fb50-49b3-8a92-eb92ce241ad8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:36:46.737329 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2206844-fb50-49b3-8a92-eb92ce241ad8 None admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:36:46.737757 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2206844-fb50-49b3-8a92-eb92ce241ad8 None admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:36:46.738169 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2206844-fb50-49b3-8a92-eb92ce241ad8 None admin] PATH_INFO: `/v3/users/24c4c1e0e91641eaae927853c58db195` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:36:46.740296 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2206844-fb50-49b3-8a92-eb92ce241ad8 None admin] RBAC: Authorizing `identity:get_user(user_id=24c4c1e0e91641eaae927853c58db195)` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:36:46.741736 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2206844-fb50-49b3-8a92-eb92ce241ad8 None admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:36:46.743342 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 427/836] 10.222.0.42 () {56 vars in 1177 bytes} [Sun Oct 30 00:36:46 2022] GET /identity/v3/users/24c4c1e0e91641eaae927853c58db195 => generated 285 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:36:46.749207 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfaaa69-e8f0-43e7-a764-c093b9c9955d None admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:36:46.853453 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=100 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:36:46.857022 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfaaa69-e8f0-43e7-a764-c093b9c9955d None admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:36:46.891454 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf867a7a-e4df-4d73-9a3a-66f2a294857a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:36:46.892037 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf867a7a-e4df-4d73-9a3a-66f2a294857a None admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:36:46.892307 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf867a7a-e4df-4d73-9a3a-66f2a294857a None admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:36:46.892572 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf867a7a-e4df-4d73-9a3a-66f2a294857a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:36:46.969781 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf867a7a-e4df-4d73-9a3a-66f2a294857a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:36:46.971232 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf867a7a-e4df-4d73-9a3a-66f2a294857a None admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:36:47.068343 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=100 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:36:47.073956 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 410/837] 10.222.0.42 () {58 vars in 1282 bytes} [Sun Oct 30 00:36:46 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 30 00:36:47.083017 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2206844-fb50-49b3-8a92-eb92ce241ad8 None admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:36:47.160943 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=100 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:36:47.205886 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2206844-fb50-49b3-8a92-eb92ce241ad8 None admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:36:47.242483 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7e2925-79ca-493d-ac86-cab616e6f04b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:36:47.243102 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7e2925-79ca-493d-ac86-cab616e6f04b None admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:36:47.243404 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7e2925-79ca-493d-ac86-cab616e6f04b None admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:36:47.243671 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7e2925-79ca-493d-ac86-cab616e6f04b None admin] PATH_INFO: `/v3/projects/5787f7e89a5648b9853887e36521e9f4` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:36:47.244819 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7e2925-79ca-493d-ac86-cab616e6f04b None admin] RBAC: Authorizing `identity:get_project(project_id=5787f7e89a5648b9853887e36521e9f4)` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:36:47.246293 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7e2925-79ca-493d-ac86-cab616e6f04b None admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:36:47.248029 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 428/838] 10.222.0.42 () {56 vars in 1186 bytes} [Sun Oct 30 00:36:47 2022] GET /identity/v3/projects/5787f7e89a5648b9853887e36521e9f4 => generated 311 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:36:47.255173 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf867a7a-e4df-4d73-9a3a-66f2a294857a None admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:36:47.358078 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf867a7a-e4df-4d73-9a3a-66f2a294857a None admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:36:47.394920 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5c858f-9c3a-4d29-b9ed-a4808a5a861a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:36:47.395530 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5c858f-9c3a-4d29-b9ed-a4808a5a861a None admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:36:47.395801 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5c858f-9c3a-4d29-b9ed-a4808a5a861a None admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:36:47.396065 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5c858f-9c3a-4d29-b9ed-a4808a5a861a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:36:47.396823 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5c858f-9c3a-4d29-b9ed-a4808a5a861a None admin] RBAC: Adding query filter params (role.id=6ccaa8c11f29456fb4e4eeccb21616c7, scope.project.id=5787f7e89a5648b9853887e36521e9f4, user.id=24c4c1e0e91641eaae927853c58db195) {{(pid=87955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:36:47.397126 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5c858f-9c3a-4d29-b9ed-a4808a5a861a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:36:47.398540 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5c858f-9c3a-4d29-b9ed-a4808a5a861a None admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:36:47.405016 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 411/839] 10.222.0.42 () {56 vars in 1374 bytes} [Sun Oct 30 00:36:47 2022] GET /identity/v3/role_assignments?user.id=24c4c1e0e91641eaae927853c58db195&scope.project.id=5787f7e89a5648b9853887e36521e9f4&role.id=6ccaa8c11f29456fb4e4eeccb21616c7 => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:36:49.517592 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b091219-f24e-449c-a984-5327cf68f551 None None] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:36:49.518137 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b091219-f24e-449c-a984-5327cf68f551 None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:36:49.518137 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b091219-f24e-449c-a984-5327cf68f551 None None] PATH_INFO: `/` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:36:49.519423 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 429/840] 10.222.0.42 () {54 vars in 927 bytes} [Sun Oct 30 00:36:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:36:49.525786 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4369949-c3d4-407f-87ad-79790a32fa26 None None] REQUEST_METHOD: `POST` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:36:49.526530 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4369949-c3d4-407f-87ad-79790a32fa26 None None] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:36:49.526684 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4369949-c3d4-407f-87ad-79790a32fa26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:36:49.549585 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.auth.core [None req-e4369949-c3d4-407f-87ad-79790a32fa26 None None] MFA Rules not processed for user `eb55b6cbca4945abb21b0e49eb745e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=87955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:36:49.550880 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-e4369949-c3d4-407f-87ad-79790a32fa26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:36:49.612099 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=100 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:36:49.621302 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 412/841] 10.222.0.42 () {58 vars in 1024 bytes} [Sun Oct 30 00:36:49 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 30 00:36:49.914021 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b091219-f24e-449c-a984-5327cf68f551 None None] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:36:50.051222 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b091219-f24e-449c-a984-5327cf68f551 None None] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:36:50.087104 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940260ca-2615-4cfc-a1e7-0296da381b88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:36:50.087758 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940260ca-2615-4cfc-a1e7-0296da381b88 None admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:36:50.088030 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940260ca-2615-4cfc-a1e7-0296da381b88 None admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:36:50.088298 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940260ca-2615-4cfc-a1e7-0296da381b88 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:36:50.089405 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940260ca-2615-4cfc-a1e7-0296da381b88 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:36:50.090825 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940260ca-2615-4cfc-a1e7-0296da381b88 None admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:36:50.092410 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 430/842] 10.222.0.42 () {56 vars in 1108 bytes} [Sun Oct 30 00:36:49 2022] GET /identity/v3/domains/default => generated 199 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:36:50.098356 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4369949-c3d4-407f-87ad-79790a32fa26 None None] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:36:50.204835 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4369949-c3d4-407f-87ad-79790a32fa26 None None] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:36:50.241836 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef14674-d690-4e76-a717-6cb09584515f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:36:50.242420 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef14674-d690-4e76-a717-6cb09584515f None admin] REQUEST_METHOD: `POST` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:36:50.242692 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef14674-d690-4e76-a717-6cb09584515f None admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:36:50.242952 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef14674-d690-4e76-a717-6cb09584515f None admin] PATH_INFO: `/v3/users` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:36:50.243616 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef14674-d690-4e76-a717-6cb09584515f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:36:50.245031 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef14674-d690-4e76-a717-6cb09584515f None admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:36:50.272636 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 413/843] 10.222.0.42 () {60 vars in 1132 bytes} [Sun Oct 30 00:36:50 2022] POST /identity/v3/users => generated 286 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 00:36:52.406502 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef71df9f-5cf4-449e-a47c-fd60373bc762 None None] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:36:52.407338 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef71df9f-5cf4-449e-a47c-fd60373bc762 None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:36:52.407338 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef71df9f-5cf4-449e-a47c-fd60373bc762 None None] PATH_INFO: `/` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:36:52.409386 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 431/844] 10.222.0.42 () {54 vars in 927 bytes} [Sun Oct 30 00:36:52 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:36:52.414759 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23618e5-bc89-4c4b-847d-5d31ef99da11 None None] REQUEST_METHOD: `POST` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:36:52.415187 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23618e5-bc89-4c4b-847d-5d31ef99da11 None None] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:36:52.415314 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23618e5-bc89-4c4b-847d-5d31ef99da11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:36:52.434734 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.auth.core [None req-f23618e5-bc89-4c4b-847d-5d31ef99da11 None None] MFA Rules not processed for user `eb55b6cbca4945abb21b0e49eb745e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=87955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:36:52.435935 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-f23618e5-bc89-4c4b-847d-5d31ef99da11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:36:52.484159 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:36:52.505139 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 414/845] 10.222.0.42 () {58 vars in 1024 bytes} [Sun Oct 30 00:36:52 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 30 00:36:52.771492 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef71df9f-5cf4-449e-a47c-fd60373bc762 None None] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:36:52.786508 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=100 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:36:52.893133 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef71df9f-5cf4-449e-a47c-fd60373bc762 None None] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:36:52.928824 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774ef5f8-5b6d-4db4-ac30-36ed08d92e3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:36:52.929471 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774ef5f8-5b6d-4db4-ac30-36ed08d92e3b None admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:36:52.929748 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774ef5f8-5b6d-4db4-ac30-36ed08d92e3b None admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:36:52.930014 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774ef5f8-5b6d-4db4-ac30-36ed08d92e3b None admin] PATH_INFO: `/v3/roles/7f42beaeb9e84fd8961e2fa0ae82d034` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:36:52.931554 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774ef5f8-5b6d-4db4-ac30-36ed08d92e3b None admin] RBAC: Authorizing `identity:get_role(role_id=7f42beaeb9e84fd8961e2fa0ae82d034)` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:36:52.932924 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774ef5f8-5b6d-4db4-ac30-36ed08d92e3b None admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:36:52.934242 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 432/846] 10.222.0.42 () {56 vars in 1177 bytes} [Sun Oct 30 00:36:52 2022] GET /identity/v3/roles/7f42beaeb9e84fd8961e2fa0ae82d034 => generated 223 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:36:52.943636 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23618e5-bc89-4c4b-847d-5d31ef99da11 None None] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:36:53.063166 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23618e5-bc89-4c4b-847d-5d31ef99da11 None None] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:36:53.103216 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbaef23-8d81-447f-933d-7e6faa7138cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:36:53.103860 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbaef23-8d81-447f-933d-7e6faa7138cb None admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:36:53.104132 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbaef23-8d81-447f-933d-7e6faa7138cb None admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:36:53.104402 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbaef23-8d81-447f-933d-7e6faa7138cb None admin] PATH_INFO: `/v3/users/923c9531389845eeb596e633b86ea6d9` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:36:53.117699 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbaef23-8d81-447f-933d-7e6faa7138cb None admin] RBAC: Authorizing `identity:get_user(user_id=923c9531389845eeb596e633b86ea6d9)` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:36:53.119187 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbaef23-8d81-447f-933d-7e6faa7138cb None admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:36:53.120790 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 415/847] 10.222.0.42 () {56 vars in 1177 bytes} [Sun Oct 30 00:36:52 2022] GET /identity/v3/users/923c9531389845eeb596e633b86ea6d9 => generated 286 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:36:53.126843 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774ef5f8-5b6d-4db4-ac30-36ed08d92e3b None admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:36:53.208306 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=100 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:36:53.235108 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774ef5f8-5b6d-4db4-ac30-36ed08d92e3b None admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:36:53.394589 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55caa48-24ab-49d6-b5ec-6fd7dfebacec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:36:53.395109 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55caa48-24ab-49d6-b5ec-6fd7dfebacec None admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:36:53.395416 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55caa48-24ab-49d6-b5ec-6fd7dfebacec None admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:36:53.395682 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55caa48-24ab-49d6-b5ec-6fd7dfebacec None admin] PATH_INFO: `/v3/projects/5787f7e89a5648b9853887e36521e9f4` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:36:53.396940 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55caa48-24ab-49d6-b5ec-6fd7dfebacec None admin] RBAC: Authorizing `identity:get_project(project_id=5787f7e89a5648b9853887e36521e9f4)` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:36:53.398369 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55caa48-24ab-49d6-b5ec-6fd7dfebacec None admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:36:53.400031 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 433/848] 10.222.0.42 () {56 vars in 1186 bytes} [Sun Oct 30 00:36:53 2022] GET /identity/v3/projects/5787f7e89a5648b9853887e36521e9f4 => generated 311 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:36:53.406393 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbaef23-8d81-447f-933d-7e6faa7138cb None admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:36:53.448549 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=100 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:36:53.512614 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbaef23-8d81-447f-933d-7e6faa7138cb None admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:36:53.547777 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87aa2aaf-8b8d-471f-8eb6-dee3e26ccde2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:36:53.548427 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87aa2aaf-8b8d-471f-8eb6-dee3e26ccde2 None admin] REQUEST_METHOD: `PUT` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:36:53.548701 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87aa2aaf-8b8d-471f-8eb6-dee3e26ccde2 None admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:36:53.548975 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87aa2aaf-8b8d-471f-8eb6-dee3e26ccde2 None admin] PATH_INFO: `/v3/projects/5787f7e89a5648b9853887e36521e9f4/users/923c9531389845eeb596e633b86ea6d9/roles/7f42beaeb9e84fd8961e2fa0ae82d034` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:36:53.551405 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87aa2aaf-8b8d-471f-8eb6-dee3e26ccde2 None admin] RBAC: Authorizing `identity:create_grant(project_id=5787f7e89a5648b9853887e36521e9f4, user_id=923c9531389845eeb596e633b86ea6d9, role_id=7f42beaeb9e84fd8961e2fa0ae82d034)` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:36:53.552867 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87aa2aaf-8b8d-471f-8eb6-dee3e26ccde2 None admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:36:53.569520 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 416/849] 10.222.0.42 () {58 vars in 1439 bytes} [Sun Oct 30 00:36:53 2022] PUT /identity/v3/projects/5787f7e89a5648b9853887e36521e9f4/users/923c9531389845eeb596e633b86ea6d9/roles/7f42beaeb9e84fd8961e2fa0ae82d034 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 00:36:55.662349 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b46a2da-8d5b-4ea4-876c-e6cdc4da1ad9 None None] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:36:55.662942 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b46a2da-8d5b-4ea4-876c-e6cdc4da1ad9 None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:36:55.662942 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b46a2da-8d5b-4ea4-876c-e6cdc4da1ad9 None None] PATH_INFO: `/` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:36:55.664264 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 434/850] 10.222.0.42 () {54 vars in 927 bytes} [Sun Oct 30 00:36:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:36:55.670690 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c082821-39e7-44bb-a7d3-234e78950670 None None] REQUEST_METHOD: `POST` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:36:55.671518 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c082821-39e7-44bb-a7d3-234e78950670 None None] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:36:55.671686 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c082821-39e7-44bb-a7d3-234e78950670 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:36:55.698876 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.auth.core [None req-2c082821-39e7-44bb-a7d3-234e78950670 None None] MFA Rules not processed for user `eb55b6cbca4945abb21b0e49eb745e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=87955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:36:55.700108 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-2c082821-39e7-44bb-a7d3-234e78950670 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:36:55.772692 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 417/851] 10.222.0.42 () {58 vars in 1024 bytes} [Sun Oct 30 00:36:55 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 30 00:36:56.052342 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b46a2da-8d5b-4ea4-876c-e6cdc4da1ad9 None None] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:36:56.158769 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b46a2da-8d5b-4ea4-876c-e6cdc4da1ad9 None None] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:36:56.193758 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9249f14d-0084-4fcd-acb6-b322f93850d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:36:56.194376 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9249f14d-0084-4fcd-acb6-b322f93850d0 None admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:36:56.194645 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9249f14d-0084-4fcd-acb6-b322f93850d0 None admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:36:56.194908 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9249f14d-0084-4fcd-acb6-b322f93850d0 None admin] PATH_INFO: `/v3/roles/7f42beaeb9e84fd8961e2fa0ae82d034` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:36:56.196364 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9249f14d-0084-4fcd-acb6-b322f93850d0 None admin] RBAC: Authorizing `identity:get_role(role_id=7f42beaeb9e84fd8961e2fa0ae82d034)` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:36:56.197710 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9249f14d-0084-4fcd-acb6-b322f93850d0 None admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:36:56.199018 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 435/852] 10.222.0.42 () {56 vars in 1177 bytes} [Sun Oct 30 00:36:56 2022] GET /identity/v3/roles/7f42beaeb9e84fd8961e2fa0ae82d034 => generated 223 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:36:56.206178 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c082821-39e7-44bb-a7d3-234e78950670 None None] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:36:56.241504 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:36:56.314151 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c082821-39e7-44bb-a7d3-234e78950670 None None] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:36:56.355479 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6966230f-c4d1-4641-9f4f-31dc9ee5bd53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:36:56.356100 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6966230f-c4d1-4641-9f4f-31dc9ee5bd53 None admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:36:56.356375 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6966230f-c4d1-4641-9f4f-31dc9ee5bd53 None admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:36:56.356643 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6966230f-c4d1-4641-9f4f-31dc9ee5bd53 None admin] PATH_INFO: `/v3/users/923c9531389845eeb596e633b86ea6d9` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:36:56.357881 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6966230f-c4d1-4641-9f4f-31dc9ee5bd53 None admin] RBAC: Authorizing `identity:get_user(user_id=923c9531389845eeb596e633b86ea6d9)` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:36:56.359354 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6966230f-c4d1-4641-9f4f-31dc9ee5bd53 None admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:36:56.360926 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 418/853] 10.222.0.42 () {56 vars in 1177 bytes} [Sun Oct 30 00:36:56 2022] GET /identity/v3/users/923c9531389845eeb596e633b86ea6d9 => generated 286 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:36:56.367047 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9249f14d-0084-4fcd-acb6-b322f93850d0 None admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:36:56.379930 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=100 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:36:56.471029 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9249f14d-0084-4fcd-acb6-b322f93850d0 None admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:36:56.506708 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e89d2d1-0626-4f61-8839-33bc66c98651 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:36:56.507300 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e89d2d1-0626-4f61-8839-33bc66c98651 None admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:36:56.507601 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e89d2d1-0626-4f61-8839-33bc66c98651 None admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:36:56.507858 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e89d2d1-0626-4f61-8839-33bc66c98651 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:36:56.579319 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e89d2d1-0626-4f61-8839-33bc66c98651 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:36:56.580687 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e89d2d1-0626-4f61-8839-33bc66c98651 None admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:36:56.591640 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=100 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:36:56.696857 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 436/854] 10.222.0.42 () {58 vars in 1282 bytes} [Sun Oct 30 00:36:56 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 30 00:36:56.706645 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6966230f-c4d1-4641-9f4f-31dc9ee5bd53 None admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:36:56.814667 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=100 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:36:56.820519 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6966230f-c4d1-4641-9f4f-31dc9ee5bd53 None admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:36:56.856570 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a841bf5-bc94-42f8-9f74-e13502ea648b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:36:56.857124 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a841bf5-bc94-42f8-9f74-e13502ea648b None admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:36:56.857400 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a841bf5-bc94-42f8-9f74-e13502ea648b None admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:36:56.857665 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a841bf5-bc94-42f8-9f74-e13502ea648b None admin] PATH_INFO: `/v3/projects/5787f7e89a5648b9853887e36521e9f4` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:36:56.858812 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a841bf5-bc94-42f8-9f74-e13502ea648b None admin] RBAC: Authorizing `identity:get_project(project_id=5787f7e89a5648b9853887e36521e9f4)` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:36:56.860262 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a841bf5-bc94-42f8-9f74-e13502ea648b None admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:36:56.861870 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 419/855] 10.222.0.42 () {56 vars in 1186 bytes} [Sun Oct 30 00:36:56 2022] GET /identity/v3/projects/5787f7e89a5648b9853887e36521e9f4 => generated 311 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:36:56.868909 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e89d2d1-0626-4f61-8839-33bc66c98651 None admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:36:56.998385 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e89d2d1-0626-4f61-8839-33bc66c98651 None admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:36:57.008915 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=100 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:36:57.044168 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de94f6ae-2286-416f-a8a7-c7cec9eeb65f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:36:57.044763 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de94f6ae-2286-416f-a8a7-c7cec9eeb65f None admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:36:57.045034 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de94f6ae-2286-416f-a8a7-c7cec9eeb65f None admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:36:57.045298 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de94f6ae-2286-416f-a8a7-c7cec9eeb65f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:36:57.046018 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de94f6ae-2286-416f-a8a7-c7cec9eeb65f None admin] RBAC: Adding query filter params (role.id=7f42beaeb9e84fd8961e2fa0ae82d034, scope.project.id=5787f7e89a5648b9853887e36521e9f4, user.id=923c9531389845eeb596e633b86ea6d9) {{(pid=87956) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:36:57.046318 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de94f6ae-2286-416f-a8a7-c7cec9eeb65f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:36:57.047755 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de94f6ae-2286-416f-a8a7-c7cec9eeb65f None admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:36:57.053742 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 437/856] 10.222.0.42 () {56 vars in 1374 bytes} [Sun Oct 30 00:36:56 2022] GET /identity/v3/role_assignments?user.id=923c9531389845eeb596e633b86ea6d9&scope.project.id=5787f7e89a5648b9853887e36521e9f4&role.id=7f42beaeb9e84fd8961e2fa0ae82d034 => generated 608 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:36:59.170876 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dcfb50-e4ce-4d96-93e0-3f6e5d98f04d None None] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:36:59.171485 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dcfb50-e4ce-4d96-93e0-3f6e5d98f04d None None] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:36:59.171485 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dcfb50-e4ce-4d96-93e0-3f6e5d98f04d None None] PATH_INFO: `/` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:36:59.172798 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 420/857] 10.222.0.42 () {54 vars in 927 bytes} [Sun Oct 30 00:36:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:36:59.179170 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79233201-b703-490b-b8ed-6bcb8ea510e2 None None] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:36:59.179958 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79233201-b703-490b-b8ed-6bcb8ea510e2 None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:36:59.180085 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79233201-b703-490b-b8ed-6bcb8ea510e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:36:59.204574 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.auth.core [None req-79233201-b703-490b-b8ed-6bcb8ea510e2 None None] MFA Rules not processed for user `eb55b6cbca4945abb21b0e49eb745e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=87956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:36:59.205760 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-79233201-b703-490b-b8ed-6bcb8ea510e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:36:59.273644 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 438/858] 10.222.0.42 () {58 vars in 1024 bytes} [Sun Oct 30 00:36:59 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 30 00:36:59.544882 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10dcfb50-e4ce-4d96-93e0-3f6e5d98f04d None None] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:36:59.652491 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10dcfb50-e4ce-4d96-93e0-3f6e5d98f04d None None] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:36:59.690013 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f20c329-9e41-48fe-a519-425926ce3106 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:36:59.690946 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f20c329-9e41-48fe-a519-425926ce3106 None admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:36:59.691376 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f20c329-9e41-48fe-a519-425926ce3106 None admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:36:59.691795 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f20c329-9e41-48fe-a519-425926ce3106 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:36:59.693800 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f20c329-9e41-48fe-a519-425926ce3106 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:36:59.696125 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f20c329-9e41-48fe-a519-425926ce3106 None admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:36:59.698624 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 421/859] 10.222.0.42 () {56 vars in 1108 bytes} [Sun Oct 30 00:36:59 2022] GET /identity/v3/domains/default => generated 199 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:36:59.705574 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79233201-b703-490b-b8ed-6bcb8ea510e2 None None] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:36:59.822157 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79233201-b703-490b-b8ed-6bcb8ea510e2 None None] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:36:59.824550 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=100 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:36:59.857072 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb097bd-964d-4cae-b6cc-10160eef5c3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:36:59.857666 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb097bd-964d-4cae-b6cc-10160eef5c3b None admin] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:36:59.857935 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb097bd-964d-4cae-b6cc-10160eef5c3b None admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:36:59.858198 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb097bd-964d-4cae-b6cc-10160eef5c3b None admin] PATH_INFO: `/v3/projects` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:36:59.858830 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb097bd-964d-4cae-b6cc-10160eef5c3b None admin] RBAC: Authorizing `identity:create_project()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:36:59.860261 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb097bd-964d-4cae-b6cc-10160eef5c3b None admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:36:59.894205 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 439/860] 10.222.0.42 () {60 vars in 1141 bytes} [Sun Oct 30 00:36:59 2022] POST /identity/v3/projects => generated 311 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 00:37:02.038556 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8106c53-30af-4569-9211-9e8fc02ce0e9 None None] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:37:02.039435 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8106c53-30af-4569-9211-9e8fc02ce0e9 None None] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:37:02.039435 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8106c53-30af-4569-9211-9e8fc02ce0e9 None None] PATH_INFO: `/` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:37:02.041736 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 422/861] 10.222.0.42 () {54 vars in 927 bytes} [Sun Oct 30 00:37:02 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:37:02.047927 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce89f311-d1c4-44c2-a6ce-858dd5f06dd5 None None] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:37:02.048364 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce89f311-d1c4-44c2-a6ce-858dd5f06dd5 None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:37:02.048594 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce89f311-d1c4-44c2-a6ce-858dd5f06dd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:37:02.069469 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.auth.core [None req-ce89f311-d1c4-44c2-a6ce-858dd5f06dd5 None None] MFA Rules not processed for user `eb55b6cbca4945abb21b0e49eb745e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=87956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:37:02.071380 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-ce89f311-d1c4-44c2-a6ce-858dd5f06dd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:37:02.144575 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 440/862] 10.222.0.42 () {58 vars in 1024 bytes} [Sun Oct 30 00:37:02 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 30 00:37:02.409768 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8106c53-30af-4569-9211-9e8fc02ce0e9 None None] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:37:02.449344 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=100 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:37:02.524527 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8106c53-30af-4569-9211-9e8fc02ce0e9 None None] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:37:02.558768 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416bd8e4-42c6-4f6c-a1de-1c17bce90969 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:37:02.559413 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416bd8e4-42c6-4f6c-a1de-1c17bce90969 None admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:37:02.559684 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416bd8e4-42c6-4f6c-a1de-1c17bce90969 None admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:37:02.559949 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416bd8e4-42c6-4f6c-a1de-1c17bce90969 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:37:02.561148 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416bd8e4-42c6-4f6c-a1de-1c17bce90969 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:37:02.562568 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416bd8e4-42c6-4f6c-a1de-1c17bce90969 None admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:37:02.564258 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 423/863] 10.222.0.42 () {56 vars in 1108 bytes} [Sun Oct 30 00:37:02 2022] GET /identity/v3/domains/default => generated 199 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:37:02.570409 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce89f311-d1c4-44c2-a6ce-858dd5f06dd5 None None] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:37:02.668415 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:37:02.684688 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce89f311-d1c4-44c2-a6ce-858dd5f06dd5 None None] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:37:02.719989 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2270f236-ce41-4bf4-aedf-5937b091468b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:37:02.720593 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2270f236-ce41-4bf4-aedf-5937b091468b None admin] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:37:02.720861 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2270f236-ce41-4bf4-aedf-5937b091468b None admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:37:02.721135 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2270f236-ce41-4bf4-aedf-5937b091468b None admin] PATH_INFO: `/v3/users` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:37:02.721784 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2270f236-ce41-4bf4-aedf-5937b091468b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:37:02.723336 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2270f236-ce41-4bf4-aedf-5937b091468b None admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:37:02.747488 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 441/864] 10.222.0.42 () {60 vars in 1132 bytes} [Sun Oct 30 00:37:02 2022] POST /identity/v3/users => generated 286 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 00:37:04.888596 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1a847c-d2a5-45cb-ab52-1695fad0a0cb None None] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:37:04.889506 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1a847c-d2a5-45cb-ab52-1695fad0a0cb None None] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:37:04.889506 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1a847c-d2a5-45cb-ab52-1695fad0a0cb None None] PATH_INFO: `/` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:37:04.891622 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 424/865] 10.222.0.42 () {54 vars in 927 bytes} [Sun Oct 30 00:37:04 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:37:04.898052 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1360bf33-3889-4dce-9b45-c25b0b84aa47 None None] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:37:04.898484 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1360bf33-3889-4dce-9b45-c25b0b84aa47 None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:37:04.898586 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1360bf33-3889-4dce-9b45-c25b0b84aa47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:37:04.927473 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.auth.core [None req-1360bf33-3889-4dce-9b45-c25b0b84aa47 None None] MFA Rules not processed for user `eb55b6cbca4945abb21b0e49eb745e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=87956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:37:04.928939 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-1360bf33-3889-4dce-9b45-c25b0b84aa47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:37:05.003841 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 442/866] 10.222.0.42 () {58 vars in 1024 bytes} [Sun Oct 30 00:37:04 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 30 00:37:05.271313 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1a847c-d2a5-45cb-ab52-1695fad0a0cb None None] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:37:05.391150 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=100 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:37:05.395634 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1a847c-d2a5-45cb-ab52-1695fad0a0cb None None] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:37:05.432953 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42717f26-2171-4491-9217-47f68013ae1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:37:05.433570 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42717f26-2171-4491-9217-47f68013ae1f None admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:37:05.433846 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42717f26-2171-4491-9217-47f68013ae1f None admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:37:05.434108 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42717f26-2171-4491-9217-47f68013ae1f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:37:05.444904 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42717f26-2171-4491-9217-47f68013ae1f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 30 00:37:05.449693 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application [None req-42717f26-2171-4491-9217-47f68013ae1f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 30 00:37:05.449693 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:37:05.449693 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:37:05.449693 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:37:05.449693 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:37:05.449693 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:37:05.449693 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:37:05.449693 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:37:05.449693 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:37:05.449693 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:37:05.449693 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:37:05.449693 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:37:05.449693 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 30 00:37:05.449693 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 30 00:37:05.449693 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 30 00:37:05.449693 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 30 00:37:05.450755 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 30 00:37:05.450755 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 30 00:37:05.450755 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 30 00:37:05.450755 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 30 00:37:05.450755 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:37:05.450755 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:37:05.450755 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:37:05.450755 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:37:05.450755 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:37:05.450755 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:37:05.450755 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:37:05.450755 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application with Lock( Oct 30 00:37:05.450755 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:37:05.450755 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:37:05.450755 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:37:05.450755 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:37:05.452518 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:37:05.452518 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:37:05.452518 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:37:05.452518 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:37:05.452518 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 30 00:37:05.452518 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 30 00:37:05.452518 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 30 00:37:05.452518 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 30 00:37:05.452518 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 30 00:37:05.452518 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 30 00:37:05.452518 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 30 00:37:05.452518 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application Oct 30 00:37:05.452518 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 425/867] 10.222.0.42 () {56 vars in 1096 bytes} [Sun Oct 30 00:37:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:37:05.460706 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1360bf33-3889-4dce-9b45-c25b0b84aa47 None None] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:37:05.535333 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:37:05.565884 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1360bf33-3889-4dce-9b45-c25b0b84aa47 None None] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:37:05.600382 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1a4176-d159-48b6-a128-3dc22c3c1d17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:37:05.600995 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1a4176-d159-48b6-a128-3dc22c3c1d17 None admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:37:05.601270 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1a4176-d159-48b6-a128-3dc22c3c1d17 None admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:37:05.601533 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1a4176-d159-48b6-a128-3dc22c3c1d17 None admin] PATH_INFO: `/v3/roles` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:37:05.602196 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1a4176-d159-48b6-a128-3dc22c3c1d17 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87956) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:37:05.602491 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1a4176-d159-48b6-a128-3dc22c3c1d17 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:37:05.603891 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1a4176-d159-48b6-a128-3dc22c3c1d17 None admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:37:05.613329 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 443/868] 10.222.0.42 () {56 vars in 1099 bytes} [Sun Oct 30 00:37:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:37:05.620335 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42717f26-2171-4491-9217-47f68013ae1f None admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:37:05.719125 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42717f26-2171-4491-9217-47f68013ae1f None admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:37:05.753838 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa9f927-eddb-4ed1-af6c-fcaecc32f82a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:37:05.754435 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa9f927-eddb-4ed1-af6c-fcaecc32f82a None admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:37:05.754691 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa9f927-eddb-4ed1-af6c-fcaecc32f82a None admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:37:05.754962 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa9f927-eddb-4ed1-af6c-fcaecc32f82a None admin] PATH_INFO: `/v3/users/802580486f1b47708cf9a02cda51715d` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:37:05.890309 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa9f927-eddb-4ed1-af6c-fcaecc32f82a None admin] RBAC: Authorizing `identity:get_user(user_id=802580486f1b47708cf9a02cda51715d)` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:37:05.891680 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa9f927-eddb-4ed1-af6c-fcaecc32f82a None admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:37:05.893361 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 426/869] 10.222.0.42 () {56 vars in 1177 bytes} [Sun Oct 30 00:37:05 2022] GET /identity/v3/users/802580486f1b47708cf9a02cda51715d => generated 286 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:37:05.900369 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1a4176-d159-48b6-a128-3dc22c3c1d17 None admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:37:06.012507 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1a4176-d159-48b6-a128-3dc22c3c1d17 None admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:37:06.053032 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f5b3aa-1635-4123-aa8c-f103febef4dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:37:06.053661 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f5b3aa-1635-4123-aa8c-f103febef4dd None admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:37:06.053930 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f5b3aa-1635-4123-aa8c-f103febef4dd None admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:37:06.054196 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f5b3aa-1635-4123-aa8c-f103febef4dd None admin] PATH_INFO: `/v3/projects/d6517e352b744201abc73ebbdda3979f` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:37:06.055347 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f5b3aa-1635-4123-aa8c-f103febef4dd None admin] RBAC: Authorizing `identity:get_project(project_id=d6517e352b744201abc73ebbdda3979f)` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:37:06.056761 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f5b3aa-1635-4123-aa8c-f103febef4dd None admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:37:06.058377 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 444/870] 10.222.0.42 () {56 vars in 1186 bytes} [Sun Oct 30 00:37:05 2022] GET /identity/v3/projects/d6517e352b744201abc73ebbdda3979f => generated 311 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:37:06.064540 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa9f927-eddb-4ed1-af6c-fcaecc32f82a None admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:37:06.085630 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=100 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:37:06.180420 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa9f927-eddb-4ed1-af6c-fcaecc32f82a None admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:37:06.215372 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9538bf5e-53f5-4ecb-ace4-0f3e639370aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:37:06.216022 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9538bf5e-53f5-4ecb-ace4-0f3e639370aa None admin] REQUEST_METHOD: `PUT` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:37:06.216291 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9538bf5e-53f5-4ecb-ace4-0f3e639370aa None admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:37:06.216558 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9538bf5e-53f5-4ecb-ace4-0f3e639370aa None admin] PATH_INFO: `/v3/projects/d6517e352b744201abc73ebbdda3979f/users/802580486f1b47708cf9a02cda51715d/roles/6ccaa8c11f29456fb4e4eeccb21616c7` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:37:06.218701 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9538bf5e-53f5-4ecb-ace4-0f3e639370aa None admin] RBAC: Authorizing `identity:create_grant(project_id=d6517e352b744201abc73ebbdda3979f, user_id=802580486f1b47708cf9a02cda51715d, role_id=6ccaa8c11f29456fb4e4eeccb21616c7)` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:37:06.220161 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9538bf5e-53f5-4ecb-ace4-0f3e639370aa None admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:37:06.235557 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 427/871] 10.222.0.42 () {58 vars in 1439 bytes} [Sun Oct 30 00:37:06 2022] PUT /identity/v3/projects/d6517e352b744201abc73ebbdda3979f/users/802580486f1b47708cf9a02cda51715d/roles/6ccaa8c11f29456fb4e4eeccb21616c7 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 00:37:08.358384 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b11488-6cb3-4a68-be01-fe21c0ff172a None None] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:37:08.358907 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b11488-6cb3-4a68-be01-fe21c0ff172a None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:37:08.358907 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b11488-6cb3-4a68-be01-fe21c0ff172a None None] PATH_INFO: `/` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:37:08.360196 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 445/872] 10.222.0.42 () {54 vars in 927 bytes} [Sun Oct 30 00:37:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:37:08.366516 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9885c6-43a7-4e8b-b4bb-251db036dea8 None None] REQUEST_METHOD: `POST` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:37:08.367257 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9885c6-43a7-4e8b-b4bb-251db036dea8 None None] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:37:08.367401 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9885c6-43a7-4e8b-b4bb-251db036dea8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:37:08.390760 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.auth.core [None req-4a9885c6-43a7-4e8b-b4bb-251db036dea8 None None] MFA Rules not processed for user `eb55b6cbca4945abb21b0e49eb745e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=87955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:37:08.391982 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-4a9885c6-43a7-4e8b-b4bb-251db036dea8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:37:08.465427 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 428/873] 10.222.0.42 () {58 vars in 1024 bytes} [Sun Oct 30 00:37:08 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 30 00:37:08.727562 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b11488-6cb3-4a68-be01-fe21c0ff172a None None] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:37:08.732391 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=100 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:37:08.843391 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b11488-6cb3-4a68-be01-fe21c0ff172a None None] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:37:08.878770 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a68ec5-c998-44b5-baa2-f912f1b96ce4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:37:08.879423 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a68ec5-c998-44b5-baa2-f912f1b96ce4 None admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:37:08.879807 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a68ec5-c998-44b5-baa2-f912f1b96ce4 None admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:37:08.880083 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a68ec5-c998-44b5-baa2-f912f1b96ce4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:37:08.891078 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a68ec5-c998-44b5-baa2-f912f1b96ce4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 30 00:37:08.896002 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application [None req-e0a68ec5-c998-44b5-baa2-f912f1b96ce4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 30 00:37:08.896002 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:37:08.896002 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:37:08.896002 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:37:08.896002 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:37:08.896002 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:37:08.896002 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:37:08.896002 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:37:08.896002 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:37:08.896002 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:37:08.896002 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:37:08.896002 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:37:08.896002 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 30 00:37:08.896002 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 30 00:37:08.896002 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 30 00:37:08.896002 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 30 00:37:08.897193 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 30 00:37:08.897193 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 30 00:37:08.897193 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 30 00:37:08.897193 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 30 00:37:08.897193 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:37:08.897193 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:37:08.897193 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:37:08.897193 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:37:08.897193 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:37:08.897193 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:37:08.897193 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:37:08.897193 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application with Lock( Oct 30 00:37:08.897193 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:37:08.897193 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:37:08.897193 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:37:08.897193 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:37:08.898041 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:37:08.898041 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:37:08.898041 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:37:08.898041 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:37:08.898041 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 30 00:37:08.898041 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 30 00:37:08.898041 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 30 00:37:08.898041 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 30 00:37:08.898041 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 30 00:37:08.898041 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 30 00:37:08.898041 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 30 00:37:08.898041 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application Oct 30 00:37:08.898041 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 446/874] 10.222.0.42 () {56 vars in 1096 bytes} [Sun Oct 30 00:37:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:37:08.903422 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9885c6-43a7-4e8b-b4bb-251db036dea8 None None] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:37:08.913994 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:37:09.008279 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9885c6-43a7-4e8b-b4bb-251db036dea8 None None] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:37:09.042655 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e38b80-5d02-4aa8-8a1d-0e48c6e0bb09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:37:09.043239 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e38b80-5d02-4aa8-8a1d-0e48c6e0bb09 None admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:37:09.043548 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e38b80-5d02-4aa8-8a1d-0e48c6e0bb09 None admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:37:09.043812 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e38b80-5d02-4aa8-8a1d-0e48c6e0bb09 None admin] PATH_INFO: `/v3/roles` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:37:09.044475 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e38b80-5d02-4aa8-8a1d-0e48c6e0bb09 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:37:09.044771 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e38b80-5d02-4aa8-8a1d-0e48c6e0bb09 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:37:09.046107 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e38b80-5d02-4aa8-8a1d-0e48c6e0bb09 None admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:37:09.054258 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 429/875] 10.222.0.42 () {56 vars in 1099 bytes} [Sun Oct 30 00:37:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:37:09.060946 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a68ec5-c998-44b5-baa2-f912f1b96ce4 None admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:37:09.124828 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=100 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:37:09.165097 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a68ec5-c998-44b5-baa2-f912f1b96ce4 None admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:37:09.200432 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e4255a-e421-4ab4-8309-00c9606439af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:37:09.201048 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e4255a-e421-4ab4-8309-00c9606439af None admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:37:09.201324 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e4255a-e421-4ab4-8309-00c9606439af None admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:37:09.201581 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e4255a-e421-4ab4-8309-00c9606439af None admin] PATH_INFO: `/v3/users/802580486f1b47708cf9a02cda51715d` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:37:09.203148 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e4255a-e421-4ab4-8309-00c9606439af None admin] RBAC: Authorizing `identity:get_user(user_id=802580486f1b47708cf9a02cda51715d)` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:37:09.204587 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e4255a-e421-4ab4-8309-00c9606439af None admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:37:09.206141 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 447/876] 10.222.0.42 () {56 vars in 1177 bytes} [Sun Oct 30 00:37:09 2022] GET /identity/v3/users/802580486f1b47708cf9a02cda51715d => generated 286 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:37:09.215371 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e38b80-5d02-4aa8-8a1d-0e48c6e0bb09 None admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:37:09.311513 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=100 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:37:09.347357 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e38b80-5d02-4aa8-8a1d-0e48c6e0bb09 None admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:37:09.381629 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b716fc9-5b14-47d1-bcb2-9df76987e872 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:37:09.382209 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b716fc9-5b14-47d1-bcb2-9df76987e872 None admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:37:09.382473 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b716fc9-5b14-47d1-bcb2-9df76987e872 None admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:37:09.382744 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b716fc9-5b14-47d1-bcb2-9df76987e872 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:37:09.449401 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b716fc9-5b14-47d1-bcb2-9df76987e872 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:37:09.450811 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b716fc9-5b14-47d1-bcb2-9df76987e872 None admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:37:09.519018 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=100 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:37:09.553608 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 430/877] 10.222.0.42 () {58 vars in 1282 bytes} [Sun Oct 30 00:37:09 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 30 00:37:09.559880 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e4255a-e421-4ab4-8309-00c9606439af None admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:37:09.676382 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e4255a-e421-4ab4-8309-00c9606439af None admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:37:09.706011 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=100 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:37:09.712287 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba663ea4-28ae-4fd3-9733-65de49e56344 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:37:09.712929 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba663ea4-28ae-4fd3-9733-65de49e56344 None admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:37:09.713193 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba663ea4-28ae-4fd3-9733-65de49e56344 None admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:37:09.713468 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba663ea4-28ae-4fd3-9733-65de49e56344 None admin] PATH_INFO: `/v3/projects/d6517e352b744201abc73ebbdda3979f` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:37:09.714627 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba663ea4-28ae-4fd3-9733-65de49e56344 None admin] RBAC: Authorizing `identity:get_project(project_id=d6517e352b744201abc73ebbdda3979f)` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:37:09.716082 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba663ea4-28ae-4fd3-9733-65de49e56344 None admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:37:09.717728 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 448/878] 10.222.0.42 () {56 vars in 1186 bytes} [Sun Oct 30 00:37:09 2022] GET /identity/v3/projects/d6517e352b744201abc73ebbdda3979f => generated 311 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:37:09.724345 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b716fc9-5b14-47d1-bcb2-9df76987e872 None admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:37:09.825274 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b716fc9-5b14-47d1-bcb2-9df76987e872 None admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:37:09.860338 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdfab78-86c7-4e36-92dd-673510f64f12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:37:09.860925 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdfab78-86c7-4e36-92dd-673510f64f12 None admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:37:09.861194 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdfab78-86c7-4e36-92dd-673510f64f12 None admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:37:09.861456 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdfab78-86c7-4e36-92dd-673510f64f12 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:37:09.862162 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdfab78-86c7-4e36-92dd-673510f64f12 None admin] RBAC: Adding query filter params (role.id=6ccaa8c11f29456fb4e4eeccb21616c7, scope.project.id=d6517e352b744201abc73ebbdda3979f, user.id=802580486f1b47708cf9a02cda51715d) {{(pid=87955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:37:09.862456 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdfab78-86c7-4e36-92dd-673510f64f12 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:37:09.863875 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdfab78-86c7-4e36-92dd-673510f64f12 None admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:37:09.869738 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 431/879] 10.222.0.42 () {56 vars in 1374 bytes} [Sun Oct 30 00:37:09 2022] GET /identity/v3/role_assignments?user.id=802580486f1b47708cf9a02cda51715d&scope.project.id=d6517e352b744201abc73ebbdda3979f&role.id=6ccaa8c11f29456fb4e4eeccb21616c7 => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:37:11.999251 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e35062c-9da4-4692-a795-55e90fb18174 None None] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:37:12.000142 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e35062c-9da4-4692-a795-55e90fb18174 None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:37:12.000142 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e35062c-9da4-4692-a795-55e90fb18174 None None] PATH_INFO: `/` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:37:12.002272 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 449/880] 10.222.0.42 () {54 vars in 927 bytes} [Sun Oct 30 00:37:11 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:37:12.007923 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf43a4f-1eca-4f3f-9532-cf20d45737c5 None None] REQUEST_METHOD: `POST` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:37:12.008379 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf43a4f-1eca-4f3f-9532-cf20d45737c5 None None] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:37:12.008489 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf43a4f-1eca-4f3f-9532-cf20d45737c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:37:12.028065 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.auth.core [None req-1bf43a4f-1eca-4f3f-9532-cf20d45737c5 None None] MFA Rules not processed for user `eb55b6cbca4945abb21b0e49eb745e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=87955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:37:12.029254 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-1bf43a4f-1eca-4f3f-9532-cf20d45737c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:37:12.062246 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=100 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:37:12.106806 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 432/881] 10.222.0.42 () {58 vars in 1024 bytes} [Sun Oct 30 00:37:12 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 30 00:37:12.381836 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e35062c-9da4-4692-a795-55e90fb18174 None None] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:37:12.497748 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e35062c-9da4-4692-a795-55e90fb18174 None None] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:37:12.531919 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a97330-aef2-4005-923b-f089a6b0cdfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:37:12.532502 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a97330-aef2-4005-923b-f089a6b0cdfa None admin] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:37:12.532773 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a97330-aef2-4005-923b-f089a6b0cdfa None admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:37:12.533109 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a97330-aef2-4005-923b-f089a6b0cdfa None admin] PATH_INFO: `/v3/domains` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:37:12.533760 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a97330-aef2-4005-923b-f089a6b0cdfa None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:37:12.535113 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a97330-aef2-4005-923b-f089a6b0cdfa None admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:37:12.556333 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 450/882] 10.222.0.42 () {60 vars in 1138 bytes} [Sun Oct 30 00:37:12 2022] POST /identity/v3/domains => generated 267 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 00:37:14.709402 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee78659-3084-4695-a4f2-3bde191264b3 None None] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:37:14.710311 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee78659-3084-4695-a4f2-3bde191264b3 None None] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:37:14.710311 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee78659-3084-4695-a4f2-3bde191264b3 None None] PATH_INFO: `/` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:37:14.712560 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 433/883] 10.222.0.42 () {54 vars in 927 bytes} [Sun Oct 30 00:37:14 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:37:14.721741 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539581f8-8876-4081-8137-e93274e86f52 None None] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:37:14.722484 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539581f8-8876-4081-8137-e93274e86f52 None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:37:14.722645 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539581f8-8876-4081-8137-e93274e86f52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:37:14.748877 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.auth.core [None req-539581f8-8876-4081-8137-e93274e86f52 None None] MFA Rules not processed for user `eb55b6cbca4945abb21b0e49eb745e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=87956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:37:14.750059 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-539581f8-8876-4081-8137-e93274e86f52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:37:14.808232 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:37:14.831907 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 451/884] 10.222.0.42 () {58 vars in 1024 bytes} [Sun Oct 30 00:37:14 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 30 00:37:15.099605 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee78659-3084-4695-a4f2-3bde191264b3 None None] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:37:15.205399 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee78659-3084-4695-a4f2-3bde191264b3 None None] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:37:15.240143 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ddea4d-8e3c-41a8-b62b-4cde82af7754 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:37:15.240804 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ddea4d-8e3c-41a8-b62b-4cde82af7754 None admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:37:15.241082 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ddea4d-8e3c-41a8-b62b-4cde82af7754 None admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:37:15.241351 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ddea4d-8e3c-41a8-b62b-4cde82af7754 None admin] PATH_INFO: `/v3/domains/6b75df8777634684ae907406988ac274` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:37:15.251920 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ddea4d-8e3c-41a8-b62b-4cde82af7754 None admin] RBAC: Authorizing `identity:get_domain(domain_id=6b75df8777634684ae907406988ac274)` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:37:15.253348 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ddea4d-8e3c-41a8-b62b-4cde82af7754 None admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:37:15.254903 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 434/885] 10.222.0.42 () {56 vars in 1183 bytes} [Sun Oct 30 00:37:15 2022] GET /identity/v3/domains/6b75df8777634684ae907406988ac274 => generated 267 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:37:15.261064 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539581f8-8876-4081-8137-e93274e86f52 None None] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:37:15.371017 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539581f8-8876-4081-8137-e93274e86f52 None None] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:37:15.406333 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303433ce-b154-4d15-a2a4-86a7ccda5a2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:37:15.406926 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303433ce-b154-4d15-a2a4-86a7ccda5a2a None admin] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:37:15.407240 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303433ce-b154-4d15-a2a4-86a7ccda5a2a None admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:37:15.407465 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303433ce-b154-4d15-a2a4-86a7ccda5a2a None admin] PATH_INFO: `/v3/projects` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:37:15.408128 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303433ce-b154-4d15-a2a4-86a7ccda5a2a None admin] RBAC: Authorizing `identity:create_project()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:37:15.409546 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303433ce-b154-4d15-a2a4-86a7ccda5a2a None admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:37:15.440621 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 452/886] 10.222.0.42 () {60 vars in 1141 bytes} [Sun Oct 30 00:37:15 2022] POST /identity/v3/projects => generated 361 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 00:37:17.680392 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2540edaa-9828-453f-a91c-f86226d8a786 None None] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:37:17.681242 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2540edaa-9828-453f-a91c-f86226d8a786 None None] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:37:17.681242 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2540edaa-9828-453f-a91c-f86226d8a786 None None] PATH_INFO: `/` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:37:17.683389 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 435/887] 10.222.0.42 () {54 vars in 927 bytes} [Sun Oct 30 00:37:17 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:37:17.692076 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e6e988-035b-4da4-bdff-2f8a9a71ab58 None None] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:37:17.692496 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e6e988-035b-4da4-bdff-2f8a9a71ab58 None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:37:17.692657 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e6e988-035b-4da4-bdff-2f8a9a71ab58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:37:17.718742 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.auth.core [None req-90e6e988-035b-4da4-bdff-2f8a9a71ab58 None None] MFA Rules not processed for user `eb55b6cbca4945abb21b0e49eb745e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=87956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:37:17.719964 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-90e6e988-035b-4da4-bdff-2f8a9a71ab58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:37:17.755466 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:37:17.800563 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 453/888] 10.222.0.42 () {58 vars in 1024 bytes} [Sun Oct 30 00:37:17 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 30 00:37:18.067460 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2540edaa-9828-453f-a91c-f86226d8a786 None None] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:37:18.095479 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=100 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:37:18.176302 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2540edaa-9828-453f-a91c-f86226d8a786 None None] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:37:18.210777 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963438fa-f9f3-4765-a2fb-f58df9285032 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:37:18.211416 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963438fa-f9f3-4765-a2fb-f58df9285032 None admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:37:18.211696 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963438fa-f9f3-4765-a2fb-f58df9285032 None admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:37:18.211960 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963438fa-f9f3-4765-a2fb-f58df9285032 None admin] PATH_INFO: `/v3/domains/6b75df8777634684ae907406988ac274` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:37:18.213191 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963438fa-f9f3-4765-a2fb-f58df9285032 None admin] RBAC: Authorizing `identity:get_domain(domain_id=6b75df8777634684ae907406988ac274)` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:37:18.214601 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963438fa-f9f3-4765-a2fb-f58df9285032 None admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:37:18.216243 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 436/889] 10.222.0.42 () {56 vars in 1183 bytes} [Sun Oct 30 00:37:18 2022] GET /identity/v3/domains/6b75df8777634684ae907406988ac274 => generated 267 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:37:18.224874 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e6e988-035b-4da4-bdff-2f8a9a71ab58 None None] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:37:18.333135 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e6e988-035b-4da4-bdff-2f8a9a71ab58 None None] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:37:18.367425 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee18659-009b-455e-bf2d-ed7c37c98773 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:37:18.368032 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee18659-009b-455e-bf2d-ed7c37c98773 None admin] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:37:18.368329 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee18659-009b-455e-bf2d-ed7c37c98773 None admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:37:18.368563 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee18659-009b-455e-bf2d-ed7c37c98773 None admin] PATH_INFO: `/v3/users` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:37:18.369214 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee18659-009b-455e-bf2d-ed7c37c98773 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:37:18.370642 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee18659-009b-455e-bf2d-ed7c37c98773 None admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:37:18.395536 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 454/890] 10.222.0.42 () {60 vars in 1132 bytes} [Sun Oct 30 00:37:18 2022] POST /identity/v3/users => generated 311 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 00:37:20.537248 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa597ce8-9df9-4834-a6aa-fd7c63a2e3be None None] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:37:20.538105 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa597ce8-9df9-4834-a6aa-fd7c63a2e3be None None] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:37:20.538105 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa597ce8-9df9-4834-a6aa-fd7c63a2e3be None None] PATH_INFO: `/` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:37:20.540338 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 437/891] 10.222.0.42 () {54 vars in 927 bytes} [Sun Oct 30 00:37:20 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:37:20.549098 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8da604-3125-48a6-8cd9-be0eb9307fd2 None None] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:37:20.549519 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8da604-3125-48a6-8cd9-be0eb9307fd2 None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:37:20.549669 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8da604-3125-48a6-8cd9-be0eb9307fd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:37:20.570874 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.auth.core [None req-5e8da604-3125-48a6-8cd9-be0eb9307fd2 None None] MFA Rules not processed for user `eb55b6cbca4945abb21b0e49eb745e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=87956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:37:20.572123 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-5e8da604-3125-48a6-8cd9-be0eb9307fd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:37:20.594077 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:37:20.645531 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 455/892] 10.222.0.42 () {58 vars in 1024 bytes} [Sun Oct 30 00:37:20 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 30 00:37:20.908881 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa597ce8-9df9-4834-a6aa-fd7c63a2e3be None None] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:37:21.003590 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=100 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:37:21.014412 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa597ce8-9df9-4834-a6aa-fd7c63a2e3be None None] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:37:21.049163 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bb337c-67ab-4d33-b15f-c21b873dbcc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:37:21.049781 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bb337c-67ab-4d33-b15f-c21b873dbcc6 None admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:37:21.050058 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bb337c-67ab-4d33-b15f-c21b873dbcc6 None admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:37:21.050326 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bb337c-67ab-4d33-b15f-c21b873dbcc6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:37:21.061807 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0bb337c-67ab-4d33-b15f-c21b873dbcc6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 30 00:37:21.066639 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application [None req-d0bb337c-67ab-4d33-b15f-c21b873dbcc6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 30 00:37:21.066639 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:37:21.066639 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:37:21.066639 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:37:21.066639 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:37:21.066639 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:37:21.066639 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:37:21.066639 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:37:21.066639 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:37:21.066639 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:37:21.066639 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:37:21.066639 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:37:21.066639 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 30 00:37:21.066639 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 30 00:37:21.066639 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 30 00:37:21.066639 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 30 00:37:21.067673 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 30 00:37:21.067673 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 30 00:37:21.067673 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 30 00:37:21.067673 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 30 00:37:21.067673 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:37:21.067673 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:37:21.067673 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:37:21.067673 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:37:21.067673 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:37:21.067673 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:37:21.067673 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:37:21.067673 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application with Lock( Oct 30 00:37:21.067673 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:37:21.067673 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:37:21.067673 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:37:21.067673 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:37:21.068623 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:37:21.068623 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:37:21.068623 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:37:21.068623 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:37:21.068623 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 30 00:37:21.068623 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 30 00:37:21.068623 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 30 00:37:21.068623 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 30 00:37:21.068623 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 30 00:37:21.068623 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 30 00:37:21.068623 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 30 00:37:21.068623 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application Oct 30 00:37:21.068623 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 438/893] 10.222.0.42 () {56 vars in 1096 bytes} [Sun Oct 30 00:37:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:37:21.074211 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8da604-3125-48a6-8cd9-be0eb9307fd2 None None] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:37:21.174886 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8da604-3125-48a6-8cd9-be0eb9307fd2 None None] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:37:21.211161 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ece7e3-8c5c-43da-b20c-d41dd30604b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:37:21.211784 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ece7e3-8c5c-43da-b20c-d41dd30604b7 None admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:37:21.212064 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ece7e3-8c5c-43da-b20c-d41dd30604b7 None admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:37:21.212332 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ece7e3-8c5c-43da-b20c-d41dd30604b7 None admin] PATH_INFO: `/v3/roles` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:37:21.212994 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ece7e3-8c5c-43da-b20c-d41dd30604b7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87956) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:37:21.213293 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ece7e3-8c5c-43da-b20c-d41dd30604b7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:37:21.214656 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ece7e3-8c5c-43da-b20c-d41dd30604b7 None admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:37:21.223002 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 456/894] 10.222.0.42 () {56 vars in 1099 bytes} [Sun Oct 30 00:37:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:37:21.229399 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bb337c-67ab-4d33-b15f-c21b873dbcc6 None admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:37:21.337708 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bb337c-67ab-4d33-b15f-c21b873dbcc6 None admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:37:21.373111 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184fa30c-0f67-4451-854a-e3ea8e0ef133 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:37:21.373716 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184fa30c-0f67-4451-854a-e3ea8e0ef133 None admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:37:21.373988 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184fa30c-0f67-4451-854a-e3ea8e0ef133 None admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:37:21.374251 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184fa30c-0f67-4451-854a-e3ea8e0ef133 None admin] PATH_INFO: `/v3/users/e091847d511e494c88753abd2c60645e` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:37:21.387755 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184fa30c-0f67-4451-854a-e3ea8e0ef133 None admin] RBAC: Authorizing `identity:get_user(user_id=e091847d511e494c88753abd2c60645e)` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:37:21.389173 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184fa30c-0f67-4451-854a-e3ea8e0ef133 None admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:37:21.390741 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 439/895] 10.222.0.42 () {56 vars in 1177 bytes} [Sun Oct 30 00:37:21 2022] GET /identity/v3/users/e091847d511e494c88753abd2c60645e => generated 311 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:37:21.399044 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ece7e3-8c5c-43da-b20c-d41dd30604b7 None admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:37:21.418565 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=100 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:37:21.502872 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ece7e3-8c5c-43da-b20c-d41dd30604b7 None admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:37:21.536897 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21999f9-6121-479a-a64f-4c37ae67b028 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:37:21.537510 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21999f9-6121-479a-a64f-4c37ae67b028 None admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:37:21.537798 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21999f9-6121-479a-a64f-4c37ae67b028 None admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:37:21.538072 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21999f9-6121-479a-a64f-4c37ae67b028 None admin] PATH_INFO: `/v3/projects/4d055e2e411c4d60bc87c5e5cd87d13e` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:37:21.539243 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21999f9-6121-479a-a64f-4c37ae67b028 None admin] RBAC: Authorizing `identity:get_project(project_id=4d055e2e411c4d60bc87c5e5cd87d13e)` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:37:21.540650 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21999f9-6121-479a-a64f-4c37ae67b028 None admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:37:21.542235 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 457/896] 10.222.0.42 () {56 vars in 1186 bytes} [Sun Oct 30 00:37:21 2022] GET /identity/v3/projects/4d055e2e411c4d60bc87c5e5cd87d13e => generated 361 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:37:21.548853 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184fa30c-0f67-4451-854a-e3ea8e0ef133 None admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:37:21.562300 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=100 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:37:21.669009 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184fa30c-0f67-4451-854a-e3ea8e0ef133 None admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:37:21.703929 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f1a39b-8db2-4d62-9e16-4c5d8001b6bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:37:21.704572 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f1a39b-8db2-4d62-9e16-4c5d8001b6bb None admin] REQUEST_METHOD: `PUT` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:37:21.704846 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f1a39b-8db2-4d62-9e16-4c5d8001b6bb None admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:37:21.705115 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f1a39b-8db2-4d62-9e16-4c5d8001b6bb None admin] PATH_INFO: `/v3/projects/4d055e2e411c4d60bc87c5e5cd87d13e/users/e091847d511e494c88753abd2c60645e/roles/6ccaa8c11f29456fb4e4eeccb21616c7` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:37:21.707250 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f1a39b-8db2-4d62-9e16-4c5d8001b6bb None admin] RBAC: Authorizing `identity:create_grant(project_id=4d055e2e411c4d60bc87c5e5cd87d13e, user_id=e091847d511e494c88753abd2c60645e, role_id=6ccaa8c11f29456fb4e4eeccb21616c7)` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:37:21.708669 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f1a39b-8db2-4d62-9e16-4c5d8001b6bb None admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:37:21.724980 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 440/897] 10.222.0.42 () {58 vars in 1439 bytes} [Sun Oct 30 00:37:21 2022] PUT /identity/v3/projects/4d055e2e411c4d60bc87c5e5cd87d13e/users/e091847d511e494c88753abd2c60645e/roles/6ccaa8c11f29456fb4e4eeccb21616c7 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 00:37:23.846139 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4c7a92-0538-4f7b-83dc-46b38cded435 None None] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:37:23.846697 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4c7a92-0538-4f7b-83dc-46b38cded435 None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:37:23.846697 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4c7a92-0538-4f7b-83dc-46b38cded435 None None] PATH_INFO: `/` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:37:23.848039 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 458/898] 10.222.0.42 () {54 vars in 927 bytes} [Sun Oct 30 00:37:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:37:23.855310 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f266f5-a4f2-45e3-b297-539f8f917263 None None] REQUEST_METHOD: `POST` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:37:23.855816 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f266f5-a4f2-45e3-b297-539f8f917263 None None] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:37:23.856194 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f266f5-a4f2-45e3-b297-539f8f917263 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:37:23.883528 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.auth.core [None req-15f266f5-a4f2-45e3-b297-539f8f917263 None None] MFA Rules not processed for user `eb55b6cbca4945abb21b0e49eb745e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=87955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:37:23.884705 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-15f266f5-a4f2-45e3-b297-539f8f917263 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:37:23.950949 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:37:23.956553 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 441/899] 10.222.0.42 () {58 vars in 1024 bytes} [Sun Oct 30 00:37:23 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 30 00:37:24.228164 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4c7a92-0538-4f7b-83dc-46b38cded435 None None] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:37:24.328704 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=100 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:37:24.346130 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4c7a92-0538-4f7b-83dc-46b38cded435 None None] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:37:24.380716 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c456ec9b-e940-4d45-86fb-5c9219611689 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:37:24.381331 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c456ec9b-e940-4d45-86fb-5c9219611689 None admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:37:24.381598 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c456ec9b-e940-4d45-86fb-5c9219611689 None admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:37:24.381890 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c456ec9b-e940-4d45-86fb-5c9219611689 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:37:24.392933 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c456ec9b-e940-4d45-86fb-5c9219611689 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 30 00:37:24.397794 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application [None req-c456ec9b-e940-4d45-86fb-5c9219611689 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 30 00:37:24.397794 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:37:24.397794 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:37:24.397794 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:37:24.397794 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:37:24.397794 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:37:24.397794 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:37:24.397794 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:37:24.397794 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:37:24.397794 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:37:24.397794 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:37:24.397794 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:37:24.397794 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 30 00:37:24.397794 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 30 00:37:24.397794 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 30 00:37:24.397794 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 30 00:37:24.398913 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 30 00:37:24.398913 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 30 00:37:24.398913 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 30 00:37:24.398913 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 30 00:37:24.398913 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:37:24.398913 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:37:24.398913 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:37:24.398913 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:37:24.398913 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:37:24.398913 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:37:24.398913 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:37:24.398913 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application with Lock( Oct 30 00:37:24.398913 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:37:24.398913 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:37:24.398913 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:37:24.398913 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:37:24.399860 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:37:24.399860 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:37:24.399860 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:37:24.399860 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:37:24.399860 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 30 00:37:24.399860 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 30 00:37:24.399860 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 30 00:37:24.399860 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 30 00:37:24.399860 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 30 00:37:24.399860 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 30 00:37:24.399860 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 30 00:37:24.399860 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application Oct 30 00:37:24.399860 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 459/900] 10.222.0.42 () {56 vars in 1096 bytes} [Sun Oct 30 00:37:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:37:24.405077 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f266f5-a4f2-45e3-b297-539f8f917263 None None] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:37:24.511364 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f266f5-a4f2-45e3-b297-539f8f917263 None None] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:37:24.545706 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9c8999-da1f-4691-b317-9f50e22c6731 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:37:24.546297 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9c8999-da1f-4691-b317-9f50e22c6731 None admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:37:24.546575 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9c8999-da1f-4691-b317-9f50e22c6731 None admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:37:24.546843 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9c8999-da1f-4691-b317-9f50e22c6731 None admin] PATH_INFO: `/v3/roles` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:37:24.547530 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9c8999-da1f-4691-b317-9f50e22c6731 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:37:24.547820 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9c8999-da1f-4691-b317-9f50e22c6731 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:37:24.549178 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9c8999-da1f-4691-b317-9f50e22c6731 None admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:37:24.557239 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 442/901] 10.222.0.42 () {56 vars in 1099 bytes} [Sun Oct 30 00:37:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:37:24.563591 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c456ec9b-e940-4d45-86fb-5c9219611689 None admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:37:24.673478 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c456ec9b-e940-4d45-86fb-5c9219611689 None admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:37:24.707797 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77158ecb-9037-42a1-af04-f7d5ef757a75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:37:24.708405 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77158ecb-9037-42a1-af04-f7d5ef757a75 None admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:37:24.708674 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77158ecb-9037-42a1-af04-f7d5ef757a75 None admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:37:24.708916 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77158ecb-9037-42a1-af04-f7d5ef757a75 None admin] PATH_INFO: `/v3/users/e091847d511e494c88753abd2c60645e` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:37:24.710203 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77158ecb-9037-42a1-af04-f7d5ef757a75 None admin] RBAC: Authorizing `identity:get_user(user_id=e091847d511e494c88753abd2c60645e)` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:37:24.711654 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77158ecb-9037-42a1-af04-f7d5ef757a75 None admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:37:24.713197 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 460/902] 10.222.0.42 () {56 vars in 1177 bytes} [Sun Oct 30 00:37:24 2022] GET /identity/v3/users/e091847d511e494c88753abd2c60645e => generated 311 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:37:24.722480 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9c8999-da1f-4691-b317-9f50e22c6731 None admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:37:24.785299 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=100 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:37:24.825765 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9c8999-da1f-4691-b317-9f50e22c6731 None admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:37:24.859872 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ce2b23-6bd9-48e1-941e-baa4d71dc192 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:37:24.860478 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ce2b23-6bd9-48e1-941e-baa4d71dc192 None admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:37:24.860710 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ce2b23-6bd9-48e1-941e-baa4d71dc192 None admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:37:24.860968 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ce2b23-6bd9-48e1-941e-baa4d71dc192 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:37:24.932506 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ce2b23-6bd9-48e1-941e-baa4d71dc192 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:37:24.933920 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ce2b23-6bd9-48e1-941e-baa4d71dc192 None admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:37:24.993691 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=100 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:37:25.046571 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 443/903] 10.222.0.42 () {58 vars in 1282 bytes} [Sun Oct 30 00:37:24 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 30 00:37:25.052671 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77158ecb-9037-42a1-af04-f7d5ef757a75 None admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:37:25.069882 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=100 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:37:25.160484 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77158ecb-9037-42a1-af04-f7d5ef757a75 None admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:37:25.198600 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f569398-69f4-41a4-b214-327e1d244afb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:37:25.199295 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f569398-69f4-41a4-b214-327e1d244afb None admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:37:25.199571 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f569398-69f4-41a4-b214-327e1d244afb None admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:37:25.199844 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f569398-69f4-41a4-b214-327e1d244afb None admin] PATH_INFO: `/v3/projects/4d055e2e411c4d60bc87c5e5cd87d13e` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:37:25.200989 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f569398-69f4-41a4-b214-327e1d244afb None admin] RBAC: Authorizing `identity:get_project(project_id=4d055e2e411c4d60bc87c5e5cd87d13e)` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:37:25.202414 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f569398-69f4-41a4-b214-327e1d244afb None admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:37:25.204391 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 461/904] 10.222.0.42 () {56 vars in 1186 bytes} [Sun Oct 30 00:37:25 2022] GET /identity/v3/projects/4d055e2e411c4d60bc87c5e5cd87d13e => generated 361 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:37:25.212667 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ce2b23-6bd9-48e1-941e-baa4d71dc192 None admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:37:25.315054 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ce2b23-6bd9-48e1-941e-baa4d71dc192 None admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:37:25.359929 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c729a2-c502-4edc-bae0-19b39931e96d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:37:25.360540 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c729a2-c502-4edc-bae0-19b39931e96d None admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:37:25.360968 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c729a2-c502-4edc-bae0-19b39931e96d None admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:37:25.361427 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c729a2-c502-4edc-bae0-19b39931e96d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:37:25.362497 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c729a2-c502-4edc-bae0-19b39931e96d None admin] RBAC: Adding query filter params (role.id=6ccaa8c11f29456fb4e4eeccb21616c7, scope.project.id=4d055e2e411c4d60bc87c5e5cd87d13e, user.id=e091847d511e494c88753abd2c60645e) {{(pid=87955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:37:25.363018 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c729a2-c502-4edc-bae0-19b39931e96d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:37:25.365326 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c729a2-c502-4edc-bae0-19b39931e96d None admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:37:25.376678 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 444/905] 10.222.0.42 () {56 vars in 1374 bytes} [Sun Oct 30 00:37:25 2022] GET /identity/v3/role_assignments?user.id=e091847d511e494c88753abd2c60645e&scope.project.id=4d055e2e411c4d60bc87c5e5cd87d13e&role.id=6ccaa8c11f29456fb4e4eeccb21616c7 => generated 608 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:37:35.194440 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=59 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:37:35.373420 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=87 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:38:20.513248 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c7f20b-4983-4a16-93b2-47b568e29527 None None] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:38:20.513825 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c7f20b-4983-4a16-93b2-47b568e29527 None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:38:20.513825 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c7f20b-4983-4a16-93b2-47b568e29527 None None] PATH_INFO: `/` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:38:20.515465 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 462/906] 10.222.0.42 () {54 vars in 927 bytes} [Sun Oct 30 00:38:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:38:20.521385 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759d0631-2cf5-4007-99a0-189e688f3505 None None] REQUEST_METHOD: `POST` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:38:20.521943 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759d0631-2cf5-4007-99a0-189e688f3505 None None] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:38:20.522045 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759d0631-2cf5-4007-99a0-189e688f3505 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:38:20.541607 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.auth.core [None req-759d0631-2cf5-4007-99a0-189e688f3505 None None] MFA Rules not processed for user `eb55b6cbca4945abb21b0e49eb745e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=87955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:38:20.542845 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-759d0631-2cf5-4007-99a0-189e688f3505 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:38:20.630185 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 445/907] 10.222.0.42 () {58 vars in 1024 bytes} [Sun Oct 30 00:38:20 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 30 00:38:20.899184 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c7f20b-4983-4a16-93b2-47b568e29527 None None] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:38:21.047331 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c7f20b-4983-4a16-93b2-47b568e29527 None None] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:38:21.092620 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9163763e-6d9c-4df9-afa7-230b73f97b1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:38:21.093258 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9163763e-6d9c-4df9-afa7-230b73f97b1a None admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:38:21.093527 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9163763e-6d9c-4df9-afa7-230b73f97b1a None admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:38:21.093791 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9163763e-6d9c-4df9-afa7-230b73f97b1a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:38:21.107309 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9163763e-6d9c-4df9-afa7-230b73f97b1a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:38:21.108973 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9163763e-6d9c-4df9-afa7-230b73f97b1a None admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:38:21.126678 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application [None req-9163763e-6d9c-4df9-afa7-230b73f97b1a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 30 00:38:21.126678 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:38:21.126678 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:38:21.126678 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:38:21.126678 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:38:21.126678 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:38:21.126678 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:38:21.126678 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:38:21.126678 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:38:21.126678 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:38:21.126678 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:38:21.126678 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:38:21.126678 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 30 00:38:21.126678 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 30 00:38:21.126678 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 30 00:38:21.126678 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 30 00:38:21.128271 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:38:21.128271 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:38:21.128271 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:38:21.128271 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:38:21.128271 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:38:21.128271 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:38:21.128271 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:38:21.128271 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application with Lock( Oct 30 00:38:21.128271 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:38:21.128271 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:38:21.128271 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:38:21.128271 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:38:21.128271 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:38:21.128271 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:38:21.128271 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:38:21.128271 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:38:21.128271 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 30 00:38:21.129440 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 30 00:38:21.129440 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 30 00:38:21.129440 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application Oct 30 00:38:21.131057 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 463/908] 10.222.0.42 () {56 vars in 1108 bytes} [Sun Oct 30 00:38:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 30 00:38:21.139063 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759d0631-2cf5-4007-99a0-189e688f3505 None None] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:38:21.254696 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759d0631-2cf5-4007-99a0-189e688f3505 None None] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:38:21.288094 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=100 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:38:21.297774 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46721f13-1955-4fa9-9a2c-279242dca7a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:38:21.298389 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46721f13-1955-4fa9-9a2c-279242dca7a8 None admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:38:21.298749 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46721f13-1955-4fa9-9a2c-279242dca7a8 None admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:38:21.299023 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46721f13-1955-4fa9-9a2c-279242dca7a8 None admin] PATH_INFO: `/v3/domains` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:38:21.299750 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46721f13-1955-4fa9-9a2c-279242dca7a8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:38:21.300053 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46721f13-1955-4fa9-9a2c-279242dca7a8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:38:21.301451 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46721f13-1955-4fa9-9a2c-279242dca7a8 None admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:38:21.315300 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 446/909] 10.222.0.42 () {56 vars in 1109 bytes} [Sun Oct 30 00:38:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:38:21.322962 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9163763e-6d9c-4df9-afa7-230b73f97b1a None admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:38:21.385903 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=100 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:38:21.445984 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9163763e-6d9c-4df9-afa7-230b73f97b1a None admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:38:21.487364 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2e7bfc-a8f7-454d-b84c-b3bbf28f22b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:38:21.487969 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2e7bfc-a8f7-454d-b84c-b3bbf28f22b5 None admin] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:38:21.488286 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2e7bfc-a8f7-454d-b84c-b3bbf28f22b5 None admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:38:21.488540 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2e7bfc-a8f7-454d-b84c-b3bbf28f22b5 None admin] PATH_INFO: `/v3/users` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:38:21.489266 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2e7bfc-a8f7-454d-b84c-b3bbf28f22b5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:38:21.490864 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2e7bfc-a8f7-454d-b84c-b3bbf28f22b5 None admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:38:21.526373 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 464/910] 10.222.0.42 () {60 vars in 1132 bytes} [Sun Oct 30 00:38:21 2022] POST /identity/v3/users => generated 251 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 30 00:38:23.894205 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3629c056-4f4f-4481-801d-49c2b6757857 None None] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:38:23.894791 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3629c056-4f4f-4481-801d-49c2b6757857 None None] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:38:23.894791 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3629c056-4f4f-4481-801d-49c2b6757857 None None] PATH_INFO: `/` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:38:23.896372 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 447/911] 10.222.0.42 () {54 vars in 927 bytes} [Sun Oct 30 00:38:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:38:23.902214 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bf301d-6c85-4025-bf79-a66e3b541115 None None] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:38:23.902667 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bf301d-6c85-4025-bf79-a66e3b541115 None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:38:23.902770 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bf301d-6c85-4025-bf79-a66e3b541115 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:38:23.923362 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.auth.core [None req-33bf301d-6c85-4025-bf79-a66e3b541115 None None] MFA Rules not processed for user `eb55b6cbca4945abb21b0e49eb745e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=87956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:38:23.924562 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-33bf301d-6c85-4025-bf79-a66e3b541115 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:38:24.001549 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 465/912] 10.222.0.42 () {58 vars in 1024 bytes} [Sun Oct 30 00:38:23 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 30 00:38:24.268273 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3629c056-4f4f-4481-801d-49c2b6757857 None None] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:38:24.381131 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3629c056-4f4f-4481-801d-49c2b6757857 None None] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:38:24.420181 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07779192-841d-47b0-a1ee-05f1f6920e4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:38:24.420684 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07779192-841d-47b0-a1ee-05f1f6920e4f None admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:38:24.420904 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07779192-841d-47b0-a1ee-05f1f6920e4f None admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:38:24.421173 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07779192-841d-47b0-a1ee-05f1f6920e4f None admin] PATH_INFO: `/v3/roles/service` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:38:24.435427 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07779192-841d-47b0-a1ee-05f1f6920e4f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 30 00:38:24.441610 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application [None req-07779192-841d-47b0-a1ee-05f1f6920e4f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 30 00:38:24.441610 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:38:24.441610 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:38:24.441610 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:38:24.441610 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:38:24.441610 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:38:24.441610 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:38:24.441610 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:38:24.441610 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:38:24.441610 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:38:24.441610 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:38:24.441610 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:38:24.441610 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 30 00:38:24.441610 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 30 00:38:24.441610 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 30 00:38:24.441610 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 30 00:38:24.442534 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 30 00:38:24.442534 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 30 00:38:24.442534 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 30 00:38:24.442534 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 30 00:38:24.442534 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:38:24.442534 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:38:24.442534 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:38:24.442534 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:38:24.442534 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:38:24.442534 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:38:24.442534 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:38:24.442534 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application with Lock( Oct 30 00:38:24.442534 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:38:24.442534 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:38:24.442534 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:38:24.442534 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:38:24.443604 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:38:24.443604 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:38:24.443604 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:38:24.443604 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:38:24.443604 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 30 00:38:24.443604 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 30 00:38:24.443604 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 30 00:38:24.443604 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 30 00:38:24.443604 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 30 00:38:24.443604 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 30 00:38:24.443604 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 30 00:38:24.443604 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application Oct 30 00:38:24.445858 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 448/913] 10.222.0.42 () {56 vars in 1102 bytes} [Sun Oct 30 00:38:24 2022] GET /identity/v3/roles/service => generated 85 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:38:24.452333 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bf301d-6c85-4025-bf79-a66e3b541115 None None] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:38:24.500308 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:38:24.570263 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bf301d-6c85-4025-bf79-a66e3b541115 None None] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:38:24.616488 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833a8c3e-0433-4b28-b2cf-85382fbd2051 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:38:24.617007 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833a8c3e-0433-4b28-b2cf-85382fbd2051 None admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:38:24.617435 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833a8c3e-0433-4b28-b2cf-85382fbd2051 None admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:38:24.617706 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833a8c3e-0433-4b28-b2cf-85382fbd2051 None admin] PATH_INFO: `/v3/roles` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:38:24.618462 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833a8c3e-0433-4b28-b2cf-85382fbd2051 None admin] RBAC: Adding query filter params (name=service) {{(pid=87956) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:38:24.618844 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833a8c3e-0433-4b28-b2cf-85382fbd2051 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:38:24.620624 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833a8c3e-0433-4b28-b2cf-85382fbd2051 None admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:38:24.630447 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 466/914] 10.222.0.42 () {56 vars in 1103 bytes} [Sun Oct 30 00:38:24 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:38:24.636471 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07779192-841d-47b0-a1ee-05f1f6920e4f None admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:38:24.697597 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=100 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:38:24.760057 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07779192-841d-47b0-a1ee-05f1f6920e4f None admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:38:24.806369 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6f3556-3668-431f-9a79-228fe488f58f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:38:24.807013 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6f3556-3668-431f-9a79-228fe488f58f None admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:38:24.807328 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6f3556-3668-431f-9a79-228fe488f58f None admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:38:24.807686 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6f3556-3668-431f-9a79-228fe488f58f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:38:24.818873 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6f3556-3668-431f-9a79-228fe488f58f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:38:24.821758 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6f3556-3668-431f-9a79-228fe488f58f None admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:38:24.841383 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application [None req-9a6f3556-3668-431f-9a79-228fe488f58f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 30 00:38:24.841383 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:38:24.841383 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:38:24.841383 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:38:24.841383 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:38:24.841383 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:38:24.841383 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:38:24.841383 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:38:24.841383 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:38:24.841383 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:38:24.841383 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:38:24.841383 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:38:24.841383 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 30 00:38:24.841383 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 30 00:38:24.841383 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 30 00:38:24.841383 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 30 00:38:24.842806 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:38:24.842806 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:38:24.842806 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:38:24.842806 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:38:24.842806 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:38:24.842806 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:38:24.842806 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:38:24.842806 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application with Lock( Oct 30 00:38:24.842806 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:38:24.842806 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:38:24.842806 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:38:24.842806 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:38:24.842806 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:38:24.842806 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:38:24.842806 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:38:24.842806 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:38:24.842806 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 30 00:38:24.843732 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 30 00:38:24.843732 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 30 00:38:24.843732 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application Oct 30 00:38:24.843732 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 449/915] 10.222.0.42 () {56 vars in 1108 bytes} [Sun Oct 30 00:38:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 30 00:38:24.847478 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833a8c3e-0433-4b28-b2cf-85382fbd2051 None admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:38:24.971495 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=100 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:38:24.974283 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833a8c3e-0433-4b28-b2cf-85382fbd2051 None admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:38:25.012372 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d788b6e5-f0ae-4413-a18b-1137af7cc522 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:38:25.013003 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d788b6e5-f0ae-4413-a18b-1137af7cc522 None admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:38:25.013275 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d788b6e5-f0ae-4413-a18b-1137af7cc522 None admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:38:25.013540 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d788b6e5-f0ae-4413-a18b-1137af7cc522 None admin] PATH_INFO: `/v3/domains` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:38:25.014201 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d788b6e5-f0ae-4413-a18b-1137af7cc522 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87956) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:38:25.014498 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d788b6e5-f0ae-4413-a18b-1137af7cc522 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:38:25.016774 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d788b6e5-f0ae-4413-a18b-1137af7cc522 None admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:38:25.030381 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 467/916] 10.222.0.42 () {56 vars in 1109 bytes} [Sun Oct 30 00:38:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:38:25.035772 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6f3556-3668-431f-9a79-228fe488f58f None admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:38:25.143082 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6f3556-3668-431f-9a79-228fe488f58f None admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:38:25.145904 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=100 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:38:25.183305 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee59a98-e1cb-4662-a9d3-edf6f1e366c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:38:25.184138 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee59a98-e1cb-4662-a9d3-edf6f1e366c9 None admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:38:25.184407 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee59a98-e1cb-4662-a9d3-edf6f1e366c9 None admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:38:25.184650 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee59a98-e1cb-4662-a9d3-edf6f1e366c9 None admin] PATH_INFO: `/v3/users/placement` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:38:25.193925 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee59a98-e1cb-4662-a9d3-edf6f1e366c9 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:38:25.195575 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee59a98-e1cb-4662-a9d3-edf6f1e366c9 None admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:38:25.208409 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application [None req-7ee59a98-e1cb-4662-a9d3-edf6f1e366c9 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 30 00:38:25.208409 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:38:25.208409 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:38:25.208409 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:38:25.208409 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:38:25.208409 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:38:25.208409 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:38:25.208409 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:38:25.208409 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:38:25.208409 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:38:25.208409 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:38:25.208409 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:38:25.208409 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 30 00:38:25.208409 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 30 00:38:25.208409 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 30 00:38:25.208409 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 30 00:38:25.210253 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:38:25.210253 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:38:25.210253 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 30 00:38:25.210253 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 30 00:38:25.210253 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 30 00:38:25.210253 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 30 00:38:25.210253 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:38:25.210253 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:38:25.210253 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:38:25.210253 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:38:25.210253 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:38:25.210253 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application with Lock( Oct 30 00:38:25.210253 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:38:25.210253 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:38:25.210253 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:38:25.210253 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:38:25.210253 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:38:25.210253 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:38:25.211645 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:38:25.211645 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:38:25.211645 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 30 00:38:25.211645 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 30 00:38:25.211645 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 30 00:38:25.211645 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 30 00:38:25.211645 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 30 00:38:25.211645 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 30 00:38:25.211645 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 30 00:38:25.211645 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application Oct 30 00:38:25.216986 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 450/917] 10.222.0.42 () {56 vars in 1108 bytes} [Sun Oct 30 00:38:25 2022] GET /identity/v3/users/placement => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:38:25.220373 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d788b6e5-f0ae-4413-a18b-1137af7cc522 None admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:38:25.341697 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d788b6e5-f0ae-4413-a18b-1137af7cc522 None admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:38:25.381632 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07066b1c-846a-4efe-b72b-e2d619aefad7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:38:25.382345 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07066b1c-846a-4efe-b72b-e2d619aefad7 None admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:38:25.382689 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07066b1c-846a-4efe-b72b-e2d619aefad7 None admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:38:25.383030 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07066b1c-846a-4efe-b72b-e2d619aefad7 None admin] PATH_INFO: `/v3/users` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:38:25.383982 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07066b1c-846a-4efe-b72b-e2d619aefad7 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=87956) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:38:25.384234 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07066b1c-846a-4efe-b72b-e2d619aefad7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:38:25.385716 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07066b1c-846a-4efe-b72b-e2d619aefad7 None admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:38:25.410078 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 468/918] 10.222.0.42 () {56 vars in 1143 bytes} [Sun Oct 30 00:38:25 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:38:25.410737 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee59a98-e1cb-4662-a9d3-edf6f1e366c9 None admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:38:25.522642 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee59a98-e1cb-4662-a9d3-edf6f1e366c9 None admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:38:25.562805 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3df1fa9-b6e3-49e0-9b29-bf2be9308444 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:38:25.563544 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3df1fa9-b6e3-49e0-9b29-bf2be9308444 None admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:38:25.563834 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3df1fa9-b6e3-49e0-9b29-bf2be9308444 None admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:38:25.564132 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3df1fa9-b6e3-49e0-9b29-bf2be9308444 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:38:25.576387 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3df1fa9-b6e3-49e0-9b29-bf2be9308444 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:38:25.578040 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3df1fa9-b6e3-49e0-9b29-bf2be9308444 None admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:38:25.596049 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application [None req-a3df1fa9-b6e3-49e0-9b29-bf2be9308444 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 30 00:38:25.596049 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:38:25.596049 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:38:25.596049 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:38:25.596049 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:38:25.596049 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:38:25.596049 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:38:25.596049 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:38:25.596049 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:38:25.596049 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:38:25.596049 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:38:25.596049 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:38:25.596049 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 30 00:38:25.596049 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 30 00:38:25.596049 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 30 00:38:25.596049 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 30 00:38:25.597023 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:38:25.597023 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:38:25.597023 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:38:25.597023 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:38:25.597023 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:38:25.597023 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:38:25.597023 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:38:25.597023 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application with Lock( Oct 30 00:38:25.597023 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:38:25.597023 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:38:25.597023 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:38:25.597023 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:38:25.597023 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:38:25.597023 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:38:25.597023 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:38:25.597023 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:38:25.597023 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 30 00:38:25.604228 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 30 00:38:25.604228 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 30 00:38:25.604228 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application Oct 30 00:38:25.604228 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 451/919] 10.222.0.42 () {56 vars in 1108 bytes} [Sun Oct 30 00:38:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:38:25.604558 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07066b1c-846a-4efe-b72b-e2d619aefad7 None admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:38:25.628093 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=100 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:38:25.722565 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07066b1c-846a-4efe-b72b-e2d619aefad7 None admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:38:25.760202 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56efa221-df16-4f91-b8c1-27288d663e22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:38:25.760943 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56efa221-df16-4f91-b8c1-27288d663e22 None admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:38:25.761283 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56efa221-df16-4f91-b8c1-27288d663e22 None admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:38:25.761555 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56efa221-df16-4f91-b8c1-27288d663e22 None admin] PATH_INFO: `/v3/domains` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:38:25.762261 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56efa221-df16-4f91-b8c1-27288d663e22 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87956) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:38:25.762563 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56efa221-df16-4f91-b8c1-27288d663e22 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:38:25.764021 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56efa221-df16-4f91-b8c1-27288d663e22 None admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:38:25.776985 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 469/920] 10.222.0.42 () {56 vars in 1109 bytes} [Sun Oct 30 00:38:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:38:25.782857 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3df1fa9-b6e3-49e0-9b29-bf2be9308444 None admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:38:25.801247 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=100 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:38:25.899660 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3df1fa9-b6e3-49e0-9b29-bf2be9308444 None admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:38:25.942542 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3bdc24-a89f-4400-97d5-46bf0b84871a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:38:25.943169 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3bdc24-a89f-4400-97d5-46bf0b84871a None admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:38:25.943478 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3bdc24-a89f-4400-97d5-46bf0b84871a None admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:38:25.943747 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3bdc24-a89f-4400-97d5-46bf0b84871a None admin] PATH_INFO: `/v3/projects/service` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:38:25.954888 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3bdc24-a89f-4400-97d5-46bf0b84871a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:38:25.956373 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3bdc24-a89f-4400-97d5-46bf0b84871a None admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:38:25.971140 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application [None req-9e3bdc24-a89f-4400-97d5-46bf0b84871a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 30 00:38:25.971140 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:38:25.971140 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:38:25.971140 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:38:25.971140 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:38:25.971140 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:38:25.971140 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:38:25.971140 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:38:25.971140 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:38:25.971140 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:38:25.971140 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:38:25.971140 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:38:25.971140 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 30 00:38:25.971140 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 30 00:38:25.971140 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 30 00:38:25.972281 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 30 00:38:25.972281 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:38:25.972281 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:38:25.972281 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:38:25.972281 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:38:25.972281 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:38:25.972281 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:38:25.972281 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:38:25.972281 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application with Lock( Oct 30 00:38:25.972281 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:38:25.972281 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:38:25.972281 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:38:25.972281 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:38:25.972281 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:38:25.972281 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:38:25.972281 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:38:25.972281 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:38:25.973236 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 30 00:38:25.973236 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 30 00:38:25.973236 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 30 00:38:25.973236 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 30 00:38:25.973236 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 30 00:38:25.973236 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 30 00:38:25.973236 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 30 00:38:25.973236 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application Oct 30 00:38:25.973236 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 452/921] 10.222.0.42 () {56 vars in 1111 bytes} [Sun Oct 30 00:38:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 30 00:38:25.978697 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56efa221-df16-4f91-b8c1-27288d663e22 None admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:38:26.072941 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=100 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:38:26.101163 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56efa221-df16-4f91-b8c1-27288d663e22 None admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:38:26.137776 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7cdf79-ed33-43e1-bf08-8203caeb180f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:38:26.138473 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7cdf79-ed33-43e1-bf08-8203caeb180f None admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:38:26.138747 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7cdf79-ed33-43e1-bf08-8203caeb180f None admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:38:26.139005 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7cdf79-ed33-43e1-bf08-8203caeb180f None admin] PATH_INFO: `/v3/projects` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:38:26.139804 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7cdf79-ed33-43e1-bf08-8203caeb180f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87956) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:38:26.140173 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7cdf79-ed33-43e1-bf08-8203caeb180f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:38:26.141848 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7cdf79-ed33-43e1-bf08-8203caeb180f None admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:38:26.155259 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 470/922] 10.222.0.42 () {56 vars in 1148 bytes} [Sun Oct 30 00:38:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:38:26.161287 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3bdc24-a89f-4400-97d5-46bf0b84871a None admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:38:26.241398 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=100 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:38:26.268821 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3bdc24-a89f-4400-97d5-46bf0b84871a None admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:38:26.307869 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df841d1-8450-4e11-9416-976862221713 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:38:26.308629 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df841d1-8450-4e11-9416-976862221713 None admin] REQUEST_METHOD: `PUT` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:38:26.308845 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df841d1-8450-4e11-9416-976862221713 None admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:38:26.309113 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df841d1-8450-4e11-9416-976862221713 None admin] PATH_INFO: `/v3/projects/17d2387fdf794d4eaef07bbcd7b39f2a/users/202b8b2c0f454297bfb97c1ac4033625/roles/904973500441476eadb9406925a575df` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:38:26.326401 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df841d1-8450-4e11-9416-976862221713 None admin] RBAC: Authorizing `identity:create_grant(project_id=17d2387fdf794d4eaef07bbcd7b39f2a, user_id=202b8b2c0f454297bfb97c1ac4033625, role_id=904973500441476eadb9406925a575df)` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:38:26.327983 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df841d1-8450-4e11-9416-976862221713 None admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:38:26.344773 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 453/923] 10.222.0.42 () {58 vars in 1439 bytes} [Sun Oct 30 00:38:26 2022] PUT /identity/v3/projects/17d2387fdf794d4eaef07bbcd7b39f2a/users/202b8b2c0f454297bfb97c1ac4033625/roles/904973500441476eadb9406925a575df => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 00:38:28.733254 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175ac061-163d-4711-b704-33b2b5ad7f66 None None] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:38:28.733862 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175ac061-163d-4711-b704-33b2b5ad7f66 None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:38:28.733862 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175ac061-163d-4711-b704-33b2b5ad7f66 None None] PATH_INFO: `/` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:38:28.735141 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 471/924] 10.222.0.42 () {54 vars in 927 bytes} [Sun Oct 30 00:38:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:38:28.740528 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1048593-2ec2-40d8-8652-9010617a3ae6 None None] REQUEST_METHOD: `POST` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:38:28.740939 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1048593-2ec2-40d8-8652-9010617a3ae6 None None] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:38:28.741055 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1048593-2ec2-40d8-8652-9010617a3ae6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:38:28.761885 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.auth.core [None req-d1048593-2ec2-40d8-8652-9010617a3ae6 None None] MFA Rules not processed for user `eb55b6cbca4945abb21b0e49eb745e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=87955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:38:28.763285 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-d1048593-2ec2-40d8-8652-9010617a3ae6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:38:28.838545 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 454/925] 10.222.0.42 () {58 vars in 1024 bytes} [Sun Oct 30 00:38:28 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 30 00:38:29.131967 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175ac061-163d-4711-b704-33b2b5ad7f66 None None] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:38:29.245537 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175ac061-163d-4711-b704-33b2b5ad7f66 None None] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:38:29.282648 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c0a353-f623-4b98-adc9-0ef8e7d3214c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:38:29.283315 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c0a353-f623-4b98-adc9-0ef8e7d3214c None admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:38:29.283590 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c0a353-f623-4b98-adc9-0ef8e7d3214c None admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:38:29.283855 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c0a353-f623-4b98-adc9-0ef8e7d3214c None admin] PATH_INFO: `/v3/roles/service` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:38:29.290507 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=100 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:38:29.295066 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c0a353-f623-4b98-adc9-0ef8e7d3214c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 30 00:38:29.299996 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application [None req-e1c0a353-f623-4b98-adc9-0ef8e7d3214c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 30 00:38:29.299996 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:38:29.299996 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:38:29.299996 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:38:29.299996 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:38:29.299996 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:38:29.299996 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:38:29.299996 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:38:29.299996 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:38:29.299996 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:38:29.299996 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:38:29.299996 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:38:29.299996 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 30 00:38:29.299996 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 30 00:38:29.299996 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 30 00:38:29.299996 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 30 00:38:29.301033 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 30 00:38:29.301033 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 30 00:38:29.301033 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 30 00:38:29.301033 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 30 00:38:29.301033 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:38:29.301033 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:38:29.301033 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:38:29.301033 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:38:29.301033 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:38:29.301033 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:38:29.301033 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:38:29.301033 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application with Lock( Oct 30 00:38:29.301033 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:38:29.301033 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:38:29.301033 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:38:29.301033 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:38:29.301930 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:38:29.301930 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:38:29.301930 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:38:29.301930 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:38:29.301930 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 30 00:38:29.301930 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 30 00:38:29.301930 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 30 00:38:29.301930 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 30 00:38:29.301930 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 30 00:38:29.301930 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 30 00:38:29.301930 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 30 00:38:29.301930 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application Oct 30 00:38:29.301930 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 472/926] 10.222.0.42 () {56 vars in 1102 bytes} [Sun Oct 30 00:38:29 2022] GET /identity/v3/roles/service => generated 85 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:38:29.307444 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1048593-2ec2-40d8-8652-9010617a3ae6 None None] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:38:29.361820 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:38:29.407100 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1048593-2ec2-40d8-8652-9010617a3ae6 None None] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:38:29.441576 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c74ee7-39d2-49b9-bcbd-d984d06e195c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:38:29.442264 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c74ee7-39d2-49b9-bcbd-d984d06e195c None admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:38:29.442551 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c74ee7-39d2-49b9-bcbd-d984d06e195c None admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:38:29.442810 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c74ee7-39d2-49b9-bcbd-d984d06e195c None admin] PATH_INFO: `/v3/roles` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:38:29.443522 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c74ee7-39d2-49b9-bcbd-d984d06e195c None admin] RBAC: Adding query filter params (name=service) {{(pid=87955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:38:29.443861 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c74ee7-39d2-49b9-bcbd-d984d06e195c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:38:29.445288 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c74ee7-39d2-49b9-bcbd-d984d06e195c None admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:38:29.455613 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 455/927] 10.222.0.42 () {56 vars in 1103 bytes} [Sun Oct 30 00:38:29 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:38:29.462523 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c0a353-f623-4b98-adc9-0ef8e7d3214c None admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:38:29.571301 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c0a353-f623-4b98-adc9-0ef8e7d3214c None admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:38:29.614997 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7134f42f-90ef-4571-9c44-a72591db2298 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:38:29.615635 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7134f42f-90ef-4571-9c44-a72591db2298 None admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:38:29.615915 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7134f42f-90ef-4571-9c44-a72591db2298 None admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:38:29.616210 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7134f42f-90ef-4571-9c44-a72591db2298 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:38:29.627498 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7134f42f-90ef-4571-9c44-a72591db2298 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:38:29.629190 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7134f42f-90ef-4571-9c44-a72591db2298 None admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:38:29.643932 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application [None req-7134f42f-90ef-4571-9c44-a72591db2298 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 30 00:38:29.643932 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:38:29.643932 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:38:29.643932 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:38:29.643932 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:38:29.643932 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:38:29.643932 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:38:29.643932 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:38:29.643932 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:38:29.643932 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:38:29.643932 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:38:29.643932 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:38:29.643932 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 30 00:38:29.643932 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 30 00:38:29.643932 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 30 00:38:29.643932 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 30 00:38:29.645047 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:38:29.645047 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:38:29.645047 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:38:29.645047 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:38:29.645047 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:38:29.645047 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:38:29.645047 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:38:29.645047 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application with Lock( Oct 30 00:38:29.645047 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:38:29.645047 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:38:29.645047 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:38:29.645047 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:38:29.645047 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:38:29.645047 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:38:29.645047 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:38:29.645047 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:38:29.645047 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 30 00:38:29.645965 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 30 00:38:29.645965 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 30 00:38:29.645965 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application Oct 30 00:38:29.645965 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 473/928] 10.222.0.42 () {56 vars in 1108 bytes} [Sun Oct 30 00:38:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:38:29.651060 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c74ee7-39d2-49b9-bcbd-d984d06e195c None admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:38:29.760955 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c74ee7-39d2-49b9-bcbd-d984d06e195c None admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:38:29.780263 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=100 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:38:29.798724 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0460eec9-28f5-451e-8a02-d596a14c2040 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:38:29.799373 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0460eec9-28f5-451e-8a02-d596a14c2040 None admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:38:29.799650 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0460eec9-28f5-451e-8a02-d596a14c2040 None admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:38:29.799920 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0460eec9-28f5-451e-8a02-d596a14c2040 None admin] PATH_INFO: `/v3/domains` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:38:29.800563 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0460eec9-28f5-451e-8a02-d596a14c2040 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:38:29.800861 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0460eec9-28f5-451e-8a02-d596a14c2040 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:38:29.802221 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0460eec9-28f5-451e-8a02-d596a14c2040 None admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:38:29.814163 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 456/929] 10.222.0.42 () {56 vars in 1109 bytes} [Sun Oct 30 00:38:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 30 00:38:29.820349 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7134f42f-90ef-4571-9c44-a72591db2298 None admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:38:29.877827 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=100 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:38:29.933290 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7134f42f-90ef-4571-9c44-a72591db2298 None admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:38:29.969327 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410ab579-d346-4693-8bc6-1bc9929d49c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:38:29.969954 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410ab579-d346-4693-8bc6-1bc9929d49c2 None admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:38:29.970226 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410ab579-d346-4693-8bc6-1bc9929d49c2 None admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:38:29.970491 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410ab579-d346-4693-8bc6-1bc9929d49c2 None admin] PATH_INFO: `/v3/users/placement` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:38:29.978312 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410ab579-d346-4693-8bc6-1bc9929d49c2 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:38:29.979834 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410ab579-d346-4693-8bc6-1bc9929d49c2 None admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:38:29.991670 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application [None req-410ab579-d346-4693-8bc6-1bc9929d49c2 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 30 00:38:29.991670 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:38:29.991670 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:38:29.991670 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:38:29.991670 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:38:29.991670 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:38:29.991670 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:38:29.991670 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:38:29.991670 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:38:29.991670 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:38:29.991670 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:38:29.991670 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:38:29.991670 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 30 00:38:29.991670 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 30 00:38:29.991670 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 30 00:38:29.991670 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 30 00:38:29.992666 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:38:29.992666 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:38:29.992666 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 30 00:38:29.992666 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 30 00:38:29.992666 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 30 00:38:29.992666 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 30 00:38:29.992666 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:38:29.992666 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:38:29.992666 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:38:29.992666 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:38:29.992666 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:38:29.992666 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application with Lock( Oct 30 00:38:29.992666 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:38:29.992666 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:38:29.992666 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:38:29.992666 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:38:29.992666 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:38:29.992666 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:38:29.993634 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:38:29.993634 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:38:29.993634 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 30 00:38:29.993634 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 30 00:38:29.993634 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 30 00:38:29.993634 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 30 00:38:29.993634 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 30 00:38:29.993634 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 30 00:38:29.993634 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 30 00:38:29.993634 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application Oct 30 00:38:29.993634 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 474/930] 10.222.0.42 () {56 vars in 1108 bytes} [Sun Oct 30 00:38:29 2022] GET /identity/v3/users/placement => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 30 00:38:29.999072 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0460eec9-28f5-451e-8a02-d596a14c2040 None admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:38:30.109334 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0460eec9-28f5-451e-8a02-d596a14c2040 None admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:38:30.144807 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a9f277-55e9-489e-951f-4e3209764b4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:38:30.145398 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a9f277-55e9-489e-951f-4e3209764b4c None admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:38:30.145698 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a9f277-55e9-489e-951f-4e3209764b4c None admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:38:30.146031 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a9f277-55e9-489e-951f-4e3209764b4c None admin] PATH_INFO: `/v3/users` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:38:30.146849 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a9f277-55e9-489e-951f-4e3209764b4c None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=87955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:38:30.147217 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a9f277-55e9-489e-951f-4e3209764b4c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:38:30.148705 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a9f277-55e9-489e-951f-4e3209764b4c None admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:38:30.166976 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 457/931] 10.222.0.42 () {56 vars in 1143 bytes} [Sun Oct 30 00:38:29 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:38:30.172865 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410ab579-d346-4693-8bc6-1bc9929d49c2 None admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:38:30.278800 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410ab579-d346-4693-8bc6-1bc9929d49c2 None admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:38:30.289516 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=100 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:38:30.314423 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6d6dcf-85e4-4dac-a311-c0fb9c2242e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:38:30.315136 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6d6dcf-85e4-4dac-a311-c0fb9c2242e5 None admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:38:30.315466 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6d6dcf-85e4-4dac-a311-c0fb9c2242e5 None admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:38:30.315734 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6d6dcf-85e4-4dac-a311-c0fb9c2242e5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:38:30.386629 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6d6dcf-85e4-4dac-a311-c0fb9c2242e5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:38:30.388123 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6d6dcf-85e4-4dac-a311-c0fb9c2242e5 None admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:38:30.496649 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 475/932] 10.222.0.42 () {58 vars in 1282 bytes} [Sun Oct 30 00:38:30 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 30 00:38:30.502747 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a9f277-55e9-489e-951f-4e3209764b4c None admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:38:30.540672 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=100 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:38:30.616344 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a9f277-55e9-489e-951f-4e3209764b4c None admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:38:30.657990 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2fabfa-a24e-4139-a2ba-8f387b0c7bce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:38:30.658734 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2fabfa-a24e-4139-a2ba-8f387b0c7bce None admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:38:30.659039 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2fabfa-a24e-4139-a2ba-8f387b0c7bce None admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:38:30.659363 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2fabfa-a24e-4139-a2ba-8f387b0c7bce None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:38:30.670196 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2fabfa-a24e-4139-a2ba-8f387b0c7bce None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:38:30.671786 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2fabfa-a24e-4139-a2ba-8f387b0c7bce None admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:38:30.686844 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application [None req-9a2fabfa-a24e-4139-a2ba-8f387b0c7bce None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 30 00:38:30.686844 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:38:30.686844 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:38:30.686844 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:38:30.686844 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:38:30.686844 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:38:30.686844 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:38:30.686844 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:38:30.686844 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:38:30.686844 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:38:30.686844 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:38:30.686844 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:38:30.686844 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 30 00:38:30.686844 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 30 00:38:30.686844 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 30 00:38:30.686844 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 30 00:38:30.688035 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:38:30.688035 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:38:30.688035 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:38:30.688035 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:38:30.688035 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:38:30.688035 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:38:30.688035 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:38:30.688035 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application with Lock( Oct 30 00:38:30.688035 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:38:30.688035 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:38:30.688035 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:38:30.688035 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:38:30.688035 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:38:30.688035 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:38:30.688035 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:38:30.688035 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:38:30.688035 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 30 00:38:30.689452 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 30 00:38:30.689452 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 30 00:38:30.689452 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application Oct 30 00:38:30.689452 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 458/933] 10.222.0.42 () {56 vars in 1108 bytes} [Sun Oct 30 00:38:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:38:30.694885 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6d6dcf-85e4-4dac-a311-c0fb9c2242e5 None admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:38:30.707515 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=100 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:38:30.802346 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6d6dcf-85e4-4dac-a311-c0fb9c2242e5 None admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:38:30.838637 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222a955e-7996-4d83-b524-2815184f6c1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:38:30.839367 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222a955e-7996-4d83-b524-2815184f6c1f None admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:38:30.839648 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222a955e-7996-4d83-b524-2815184f6c1f None admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:38:30.839942 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222a955e-7996-4d83-b524-2815184f6c1f None admin] PATH_INFO: `/v3/domains` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:38:30.840690 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222a955e-7996-4d83-b524-2815184f6c1f None admin] RBAC: Adding query filter params (name=Default) {{(pid=87956) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:38:30.841000 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222a955e-7996-4d83-b524-2815184f6c1f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:38:30.842438 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222a955e-7996-4d83-b524-2815184f6c1f None admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:38:30.855463 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 476/934] 10.222.0.42 () {56 vars in 1109 bytes} [Sun Oct 30 00:38:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:38:30.861337 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2fabfa-a24e-4139-a2ba-8f387b0c7bce None admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:38:30.952092 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=100 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:38:30.968747 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2fabfa-a24e-4139-a2ba-8f387b0c7bce None admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:38:31.003809 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623f1064-a19b-42be-9dd3-6da498572ffe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:38:31.004432 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623f1064-a19b-42be-9dd3-6da498572ffe None admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:38:31.004715 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623f1064-a19b-42be-9dd3-6da498572ffe None admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:38:31.004966 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623f1064-a19b-42be-9dd3-6da498572ffe None admin] PATH_INFO: `/v3/projects/service` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:38:31.011392 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623f1064-a19b-42be-9dd3-6da498572ffe None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:38:31.012855 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623f1064-a19b-42be-9dd3-6da498572ffe None admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:38:31.024286 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application [None req-623f1064-a19b-42be-9dd3-6da498572ffe None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 30 00:38:31.024286 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:38:31.024286 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:38:31.024286 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:38:31.024286 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:38:31.024286 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:38:31.024286 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:38:31.024286 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:38:31.024286 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:38:31.024286 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:38:31.024286 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:38:31.024286 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:38:31.024286 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 30 00:38:31.024286 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 30 00:38:31.024286 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 30 00:38:31.025397 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 30 00:38:31.025397 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:38:31.025397 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:38:31.025397 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:38:31.025397 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:38:31.025397 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:38:31.025397 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:38:31.025397 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:38:31.025397 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application with Lock( Oct 30 00:38:31.025397 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:38:31.025397 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:38:31.025397 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:38:31.025397 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:38:31.025397 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:38:31.025397 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:38:31.025397 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:38:31.025397 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:38:31.026420 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 30 00:38:31.026420 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 30 00:38:31.026420 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 30 00:38:31.026420 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 30 00:38:31.026420 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 30 00:38:31.026420 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 30 00:38:31.026420 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 30 00:38:31.026420 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application Oct 30 00:38:31.026420 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 459/935] 10.222.0.42 () {56 vars in 1111 bytes} [Sun Oct 30 00:38:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:38:31.031928 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222a955e-7996-4d83-b524-2815184f6c1f None admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:38:31.110245 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=100 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:38:31.145095 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222a955e-7996-4d83-b524-2815184f6c1f None admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:38:31.185600 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7094ca-18cd-4dff-ae9e-e09e5145ac05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:38:31.186483 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7094ca-18cd-4dff-ae9e-e09e5145ac05 None admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:38:31.186902 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7094ca-18cd-4dff-ae9e-e09e5145ac05 None admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:38:31.187321 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7094ca-18cd-4dff-ae9e-e09e5145ac05 None admin] PATH_INFO: `/v3/projects` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:38:31.188518 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7094ca-18cd-4dff-ae9e-e09e5145ac05 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87956) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:38:31.188984 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7094ca-18cd-4dff-ae9e-e09e5145ac05 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:38:31.191079 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7094ca-18cd-4dff-ae9e-e09e5145ac05 None admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:38:31.207579 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 477/936] 10.222.0.42 () {56 vars in 1148 bytes} [Sun Oct 30 00:38:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:38:31.216495 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623f1064-a19b-42be-9dd3-6da498572ffe None admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:38:31.323679 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623f1064-a19b-42be-9dd3-6da498572ffe None admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:38:31.365234 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4466134d-102f-4c5c-93fc-9e19ebd74925 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:38:31.365866 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4466134d-102f-4c5c-93fc-9e19ebd74925 None admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:38:31.366134 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4466134d-102f-4c5c-93fc-9e19ebd74925 None admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:38:31.366403 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4466134d-102f-4c5c-93fc-9e19ebd74925 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:38:31.367129 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4466134d-102f-4c5c-93fc-9e19ebd74925 None admin] RBAC: Adding query filter params (role.id=904973500441476eadb9406925a575df, scope.project.id=17d2387fdf794d4eaef07bbcd7b39f2a, user.id=202b8b2c0f454297bfb97c1ac4033625) {{(pid=87955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:38:31.367502 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4466134d-102f-4c5c-93fc-9e19ebd74925 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:38:31.368927 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4466134d-102f-4c5c-93fc-9e19ebd74925 None admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:38:31.375472 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 460/937] 10.222.0.42 () {56 vars in 1374 bytes} [Sun Oct 30 00:38:31 2022] GET /identity/v3/role_assignments?user.id=202b8b2c0f454297bfb97c1ac4033625&scope.project.id=17d2387fdf794d4eaef07bbcd7b39f2a&role.id=904973500441476eadb9406925a575df => generated 608 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:38:33.564534 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59c2c13-e8a1-4ecb-ba49-632af0b07cfe None None] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:38:33.565110 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59c2c13-e8a1-4ecb-ba49-632af0b07cfe None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:38:33.565110 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59c2c13-e8a1-4ecb-ba49-632af0b07cfe None None] PATH_INFO: `/` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:38:33.566553 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 478/938] 10.222.0.42 () {54 vars in 927 bytes} [Sun Oct 30 00:38:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:38:33.575298 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3a33e7-01bc-476b-929b-c148f68b60c4 None None] REQUEST_METHOD: `POST` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:38:33.575298 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3a33e7-01bc-476b-929b-c148f68b60c4 None None] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:38:33.575298 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3a33e7-01bc-476b-929b-c148f68b60c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:38:33.594396 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.auth.core [None req-8a3a33e7-01bc-476b-929b-c148f68b60c4 None None] MFA Rules not processed for user `eb55b6cbca4945abb21b0e49eb745e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=87955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:38:33.595947 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-8a3a33e7-01bc-476b-929b-c148f68b60c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:38:33.598966 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=100 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:38:33.674678 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 461/939] 10.222.0.42 () {58 vars in 1024 bytes} [Sun Oct 30 00:38:33 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 30 00:38:33.936687 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59c2c13-e8a1-4ecb-ba49-632af0b07cfe None None] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:38:34.050948 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59c2c13-e8a1-4ecb-ba49-632af0b07cfe None None] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:38:34.084868 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=100 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:38:34.092000 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23289a03-875d-4402-8dae-e849bb8ffa0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:38:34.092719 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23289a03-875d-4402-8dae-e849bb8ffa0b None admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:38:34.092999 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23289a03-875d-4402-8dae-e849bb8ffa0b None admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:38:34.093339 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23289a03-875d-4402-8dae-e849bb8ffa0b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:38:34.104719 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23289a03-875d-4402-8dae-e849bb8ffa0b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 30 00:38:34.110151 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application [None req-23289a03-875d-4402-8dae-e849bb8ffa0b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 30 00:38:34.110151 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:38:34.110151 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:38:34.110151 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:38:34.110151 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:38:34.110151 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:38:34.110151 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:38:34.110151 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:38:34.110151 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:38:34.110151 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:38:34.110151 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:38:34.110151 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:38:34.110151 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 30 00:38:34.110151 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 30 00:38:34.110151 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 30 00:38:34.110151 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 30 00:38:34.111171 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 30 00:38:34.111171 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 30 00:38:34.111171 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 30 00:38:34.111171 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 30 00:38:34.111171 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:38:34.111171 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:38:34.111171 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:38:34.111171 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:38:34.111171 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:38:34.111171 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:38:34.111171 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:38:34.111171 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application with Lock( Oct 30 00:38:34.111171 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:38:34.111171 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:38:34.111171 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:38:34.111171 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:38:34.112534 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:38:34.112534 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:38:34.112534 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:38:34.112534 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:38:34.112534 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 30 00:38:34.112534 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 30 00:38:34.112534 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 30 00:38:34.112534 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 30 00:38:34.112534 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 30 00:38:34.112534 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 30 00:38:34.112534 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 30 00:38:34.112534 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application Oct 30 00:38:34.112534 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 479/940] 10.222.0.42 () {56 vars in 1096 bytes} [Sun Oct 30 00:38:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:38:34.118318 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3a33e7-01bc-476b-929b-c148f68b60c4 None None] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:38:34.234830 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3a33e7-01bc-476b-929b-c148f68b60c4 None None] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:38:34.272145 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80a88ca-c31a-4542-a803-aec61b162c3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:38:34.272880 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80a88ca-c31a-4542-a803-aec61b162c3b None admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:38:34.273243 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80a88ca-c31a-4542-a803-aec61b162c3b None admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:38:34.273507 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80a88ca-c31a-4542-a803-aec61b162c3b None admin] PATH_INFO: `/v3/roles` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:38:34.274301 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80a88ca-c31a-4542-a803-aec61b162c3b None admin] RBAC: Adding query filter params (name=admin) {{(pid=87955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:38:34.274550 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80a88ca-c31a-4542-a803-aec61b162c3b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:38:34.276060 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80a88ca-c31a-4542-a803-aec61b162c3b None admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:38:34.284294 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 462/941] 10.222.0.42 () {56 vars in 1099 bytes} [Sun Oct 30 00:38:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:38:34.290192 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23289a03-875d-4402-8dae-e849bb8ffa0b None admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:38:34.399426 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23289a03-875d-4402-8dae-e849bb8ffa0b None admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:38:34.437401 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abd4637-67d4-47d3-95d4-cdf02fe1cb8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:38:34.438195 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abd4637-67d4-47d3-95d4-cdf02fe1cb8b None admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:38:34.438500 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abd4637-67d4-47d3-95d4-cdf02fe1cb8b None admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:38:34.438905 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abd4637-67d4-47d3-95d4-cdf02fe1cb8b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:38:34.453101 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abd4637-67d4-47d3-95d4-cdf02fe1cb8b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:38:34.454568 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abd4637-67d4-47d3-95d4-cdf02fe1cb8b None admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:38:34.470074 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application [None req-8abd4637-67d4-47d3-95d4-cdf02fe1cb8b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 30 00:38:34.470074 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:38:34.470074 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:38:34.470074 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:38:34.470074 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:38:34.470074 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:38:34.470074 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:38:34.470074 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:38:34.470074 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:38:34.470074 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:38:34.470074 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:38:34.470074 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:38:34.470074 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 30 00:38:34.470074 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 30 00:38:34.470074 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 30 00:38:34.470074 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 30 00:38:34.471312 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:38:34.471312 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:38:34.471312 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:38:34.471312 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:38:34.471312 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:38:34.471312 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:38:34.471312 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:38:34.471312 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application with Lock( Oct 30 00:38:34.471312 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:38:34.471312 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:38:34.471312 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:38:34.471312 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:38:34.471312 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:38:34.471312 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:38:34.471312 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:38:34.471312 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:38:34.471312 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 30 00:38:34.472221 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 30 00:38:34.472221 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 30 00:38:34.472221 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application Oct 30 00:38:34.472221 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 480/942] 10.222.0.42 () {56 vars in 1108 bytes} [Sun Oct 30 00:38:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:38:34.477397 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80a88ca-c31a-4542-a803-aec61b162c3b None admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:38:34.480379 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=100 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:38:34.586236 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80a88ca-c31a-4542-a803-aec61b162c3b None admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:38:34.625696 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2759435-8205-469b-83e1-3b25ebfcc932 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:38:34.626299 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2759435-8205-469b-83e1-3b25ebfcc932 None admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:38:34.626572 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2759435-8205-469b-83e1-3b25ebfcc932 None admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:38:34.626848 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2759435-8205-469b-83e1-3b25ebfcc932 None admin] PATH_INFO: `/v3/domains` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:38:34.627506 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2759435-8205-469b-83e1-3b25ebfcc932 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:38:34.627799 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2759435-8205-469b-83e1-3b25ebfcc932 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:38:34.629155 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2759435-8205-469b-83e1-3b25ebfcc932 None admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:38:34.641344 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 463/943] 10.222.0.42 () {56 vars in 1109 bytes} [Sun Oct 30 00:38:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 30 00:38:34.647274 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abd4637-67d4-47d3-95d4-cdf02fe1cb8b None admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:38:34.693717 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=100 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:38:34.754183 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abd4637-67d4-47d3-95d4-cdf02fe1cb8b None admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:38:34.790480 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cefcd8-e36d-48de-b322-9f039c1f4ea7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:38:34.791119 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cefcd8-e36d-48de-b322-9f039c1f4ea7 None admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:38:34.791427 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cefcd8-e36d-48de-b322-9f039c1f4ea7 None admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:38:34.791732 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cefcd8-e36d-48de-b322-9f039c1f4ea7 None admin] PATH_INFO: `/v3/users/placement` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:38:34.799755 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56cefcd8-e36d-48de-b322-9f039c1f4ea7 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:38:34.801309 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56cefcd8-e36d-48de-b322-9f039c1f4ea7 None admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:38:34.813464 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application [None req-56cefcd8-e36d-48de-b322-9f039c1f4ea7 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 30 00:38:34.813464 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:38:34.813464 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:38:34.813464 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:38:34.813464 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:38:34.813464 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:38:34.813464 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:38:34.813464 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:38:34.813464 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:38:34.813464 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:38:34.813464 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:38:34.813464 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:38:34.813464 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 30 00:38:34.813464 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 30 00:38:34.813464 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 30 00:38:34.813464 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 30 00:38:34.814581 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:38:34.814581 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:38:34.814581 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 30 00:38:34.814581 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 30 00:38:34.814581 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 30 00:38:34.814581 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 30 00:38:34.814581 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:38:34.814581 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:38:34.814581 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:38:34.814581 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:38:34.814581 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:38:34.814581 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application with Lock( Oct 30 00:38:34.814581 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:38:34.814581 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:38:34.814581 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:38:34.814581 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:38:34.814581 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:38:34.814581 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:38:34.815963 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:38:34.815963 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:38:34.815963 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 30 00:38:34.815963 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 30 00:38:34.815963 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 30 00:38:34.815963 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 30 00:38:34.815963 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 30 00:38:34.815963 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 30 00:38:34.815963 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 30 00:38:34.815963 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application Oct 30 00:38:34.815963 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 481/944] 10.222.0.42 () {56 vars in 1108 bytes} [Sun Oct 30 00:38:34 2022] GET /identity/v3/users/placement => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:38:34.820796 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2759435-8205-469b-83e1-3b25ebfcc932 None admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:38:34.891974 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=100 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:38:34.931557 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2759435-8205-469b-83e1-3b25ebfcc932 None admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:38:34.974764 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c38414-92b7-4196-9de1-4bcb1185c3af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:38:34.975437 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c38414-92b7-4196-9de1-4bcb1185c3af None admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:38:34.975818 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c38414-92b7-4196-9de1-4bcb1185c3af None admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:38:34.976122 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c38414-92b7-4196-9de1-4bcb1185c3af None admin] PATH_INFO: `/v3/users` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:38:34.976840 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c38414-92b7-4196-9de1-4bcb1185c3af None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=87955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:38:34.977124 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c38414-92b7-4196-9de1-4bcb1185c3af None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:38:34.978570 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c38414-92b7-4196-9de1-4bcb1185c3af None admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:38:34.997604 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 464/945] 10.222.0.42 () {56 vars in 1143 bytes} [Sun Oct 30 00:38:34 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:38:35.003330 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cefcd8-e36d-48de-b322-9f039c1f4ea7 None admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:38:35.107826 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cefcd8-e36d-48de-b322-9f039c1f4ea7 None admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:38:35.109701 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=100 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:38:35.145596 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb2b1ac-05b4-4c96-9df9-56e2a75ec864 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:38:35.146157 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb2b1ac-05b4-4c96-9df9-56e2a75ec864 None admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:38:35.146430 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb2b1ac-05b4-4c96-9df9-56e2a75ec864 None admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:38:35.146696 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb2b1ac-05b4-4c96-9df9-56e2a75ec864 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:38:35.158348 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb2b1ac-05b4-4c96-9df9-56e2a75ec864 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:38:35.159966 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb2b1ac-05b4-4c96-9df9-56e2a75ec864 None admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:38:35.175063 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application [None req-dcb2b1ac-05b4-4c96-9df9-56e2a75ec864 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 30 00:38:35.175063 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:38:35.175063 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:38:35.175063 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:38:35.175063 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:38:35.175063 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:38:35.175063 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:38:35.175063 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:38:35.175063 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:38:35.175063 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:38:35.175063 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:38:35.175063 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:38:35.175063 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 30 00:38:35.175063 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 30 00:38:35.175063 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 30 00:38:35.175063 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 30 00:38:35.176363 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:38:35.176363 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:38:35.176363 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:38:35.176363 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:38:35.176363 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:38:35.176363 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:38:35.176363 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:38:35.176363 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application with Lock( Oct 30 00:38:35.176363 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:38:35.176363 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:38:35.176363 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:38:35.176363 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:38:35.176363 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:38:35.176363 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:38:35.176363 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:38:35.176363 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:38:35.176363 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 30 00:38:35.177235 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 30 00:38:35.177235 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 30 00:38:35.177235 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application Oct 30 00:38:35.177235 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 482/946] 10.222.0.42 () {56 vars in 1108 bytes} [Sun Oct 30 00:38:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:38:35.182650 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c38414-92b7-4196-9de1-4bcb1185c3af None admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:38:35.295213 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c38414-92b7-4196-9de1-4bcb1185c3af None admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:38:35.317932 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=100 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:38:35.333747 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75188377-4716-42c4-96e9-cdbaadc67c41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:38:35.334449 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75188377-4716-42c4-96e9-cdbaadc67c41 None admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:38:35.334725 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75188377-4716-42c4-96e9-cdbaadc67c41 None admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:38:35.334994 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75188377-4716-42c4-96e9-cdbaadc67c41 None admin] PATH_INFO: `/v3/domains` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:38:35.336072 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75188377-4716-42c4-96e9-cdbaadc67c41 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:38:35.336465 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75188377-4716-42c4-96e9-cdbaadc67c41 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:38:35.338050 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75188377-4716-42c4-96e9-cdbaadc67c41 None admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:38:35.350249 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 465/947] 10.222.0.42 () {56 vars in 1109 bytes} [Sun Oct 30 00:38:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:38:35.356429 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb2b1ac-05b4-4c96-9df9-56e2a75ec864 None admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:38:35.462179 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb2b1ac-05b4-4c96-9df9-56e2a75ec864 None admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:38:35.501496 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f47b96f-c9a5-4cf6-bf5d-1acbf5bfa920 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:38:35.502140 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f47b96f-c9a5-4cf6-bf5d-1acbf5bfa920 None admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:38:35.502476 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f47b96f-c9a5-4cf6-bf5d-1acbf5bfa920 None admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:38:35.502752 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f47b96f-c9a5-4cf6-bf5d-1acbf5bfa920 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:38:35.510305 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f47b96f-c9a5-4cf6-bf5d-1acbf5bfa920 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:38:35.512095 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f47b96f-c9a5-4cf6-bf5d-1acbf5bfa920 None admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:38:35.524725 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application [None req-5f47b96f-c9a5-4cf6-bf5d-1acbf5bfa920 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 30 00:38:35.524725 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:38:35.524725 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:38:35.524725 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:38:35.524725 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:38:35.524725 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:38:35.524725 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:38:35.524725 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:38:35.524725 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:38:35.524725 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:38:35.524725 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:38:35.524725 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:38:35.524725 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 30 00:38:35.524725 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 30 00:38:35.524725 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 30 00:38:35.525773 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 30 00:38:35.525773 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:38:35.525773 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:38:35.525773 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:38:35.525773 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:38:35.525773 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:38:35.525773 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:38:35.525773 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:38:35.525773 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application with Lock( Oct 30 00:38:35.525773 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:38:35.525773 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:38:35.525773 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:38:35.525773 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:38:35.525773 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:38:35.525773 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:38:35.525773 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:38:35.525773 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:38:35.526660 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 30 00:38:35.526660 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 30 00:38:35.526660 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 30 00:38:35.526660 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 30 00:38:35.526660 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 30 00:38:35.526660 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 30 00:38:35.526660 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 30 00:38:35.526660 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application Oct 30 00:38:35.526660 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 483/948] 10.222.0.42 () {56 vars in 1111 bytes} [Sun Oct 30 00:38:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 30 00:38:35.532359 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75188377-4716-42c4-96e9-cdbaadc67c41 None admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:38:35.654703 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75188377-4716-42c4-96e9-cdbaadc67c41 None admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:38:35.691976 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263f95ee-3e57-4470-b2cc-1ba8259a169c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:38:35.692653 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263f95ee-3e57-4470-b2cc-1ba8259a169c None admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:38:35.692923 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263f95ee-3e57-4470-b2cc-1ba8259a169c None admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:38:35.693206 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263f95ee-3e57-4470-b2cc-1ba8259a169c None admin] PATH_INFO: `/v3/projects` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:38:35.693994 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263f95ee-3e57-4470-b2cc-1ba8259a169c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:38:35.694267 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263f95ee-3e57-4470-b2cc-1ba8259a169c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:38:35.695993 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263f95ee-3e57-4470-b2cc-1ba8259a169c None admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:38:35.708780 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 466/949] 10.222.0.42 () {56 vars in 1148 bytes} [Sun Oct 30 00:38:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:38:35.715304 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f47b96f-c9a5-4cf6-bf5d-1acbf5bfa920 None admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:38:35.733575 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=100 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:38:35.825614 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f47b96f-c9a5-4cf6-bf5d-1acbf5bfa920 None admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:38:35.862021 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbae72e6-e7f8-4bd0-ba07-725ed2be25a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:38:35.862673 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbae72e6-e7f8-4bd0-ba07-725ed2be25a9 None admin] REQUEST_METHOD: `PUT` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:38:35.862950 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbae72e6-e7f8-4bd0-ba07-725ed2be25a9 None admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:38:35.863270 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbae72e6-e7f8-4bd0-ba07-725ed2be25a9 None admin] PATH_INFO: `/v3/projects/17d2387fdf794d4eaef07bbcd7b39f2a/users/202b8b2c0f454297bfb97c1ac4033625/roles/6ccaa8c11f29456fb4e4eeccb21616c7` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:38:35.865441 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbae72e6-e7f8-4bd0-ba07-725ed2be25a9 None admin] RBAC: Authorizing `identity:create_grant(project_id=17d2387fdf794d4eaef07bbcd7b39f2a, user_id=202b8b2c0f454297bfb97c1ac4033625, role_id=6ccaa8c11f29456fb4e4eeccb21616c7)` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:38:35.866931 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbae72e6-e7f8-4bd0-ba07-725ed2be25a9 None admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:38:35.879898 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 484/950] 10.222.0.42 () {58 vars in 1439 bytes} [Sun Oct 30 00:38:35 2022] PUT /identity/v3/projects/17d2387fdf794d4eaef07bbcd7b39f2a/users/202b8b2c0f454297bfb97c1ac4033625/roles/6ccaa8c11f29456fb4e4eeccb21616c7 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 00:38:38.250910 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a77dab-3f35-47b2-b610-278ff4025f5d None None] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:38:38.251527 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a77dab-3f35-47b2-b610-278ff4025f5d None None] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:38:38.251527 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a77dab-3f35-47b2-b610-278ff4025f5d None None] PATH_INFO: `/` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:38:38.252832 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 467/951] 10.222.0.42 () {54 vars in 927 bytes} [Sun Oct 30 00:38:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:38:38.259892 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd50383-4c4e-419e-ad27-083d641cd53c None None] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:38:38.260377 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd50383-4c4e-419e-ad27-083d641cd53c None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:38:38.260377 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd50383-4c4e-419e-ad27-083d641cd53c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:38:38.280609 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.auth.core [None req-ccd50383-4c4e-419e-ad27-083d641cd53c None None] MFA Rules not processed for user `eb55b6cbca4945abb21b0e49eb745e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=87956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:38:38.281823 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-ccd50383-4c4e-419e-ad27-083d641cd53c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:38:38.359995 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 485/952] 10.222.0.42 () {58 vars in 1024 bytes} [Sun Oct 30 00:38:38 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 30 00:38:38.693305 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a77dab-3f35-47b2-b610-278ff4025f5d None None] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:38:38.746754 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=100 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:38:38.809299 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a77dab-3f35-47b2-b610-278ff4025f5d None None] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:38:38.846214 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957ca763-fe32-4b14-98a0-fe7089bf8e61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:38:38.846994 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957ca763-fe32-4b14-98a0-fe7089bf8e61 None admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:38:38.847350 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957ca763-fe32-4b14-98a0-fe7089bf8e61 None admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:38:38.847695 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957ca763-fe32-4b14-98a0-fe7089bf8e61 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:38:38.859497 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957ca763-fe32-4b14-98a0-fe7089bf8e61 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 30 00:38:38.865052 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application [None req-957ca763-fe32-4b14-98a0-fe7089bf8e61 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 30 00:38:38.865052 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:38:38.865052 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:38:38.865052 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:38:38.865052 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:38:38.865052 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:38:38.865052 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:38:38.865052 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:38:38.865052 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:38:38.865052 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:38:38.865052 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:38:38.865052 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:38:38.865052 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 30 00:38:38.865052 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 30 00:38:38.865052 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 30 00:38:38.865052 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 30 00:38:38.866253 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 30 00:38:38.866253 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 30 00:38:38.866253 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 30 00:38:38.866253 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 30 00:38:38.866253 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:38:38.866253 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:38:38.866253 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:38:38.866253 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:38:38.866253 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:38:38.866253 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:38:38.866253 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:38:38.866253 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application with Lock( Oct 30 00:38:38.866253 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:38:38.866253 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:38:38.866253 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:38:38.866253 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:38:38.867417 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:38:38.867417 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:38:38.867417 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:38:38.867417 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:38:38.867417 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 30 00:38:38.867417 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 30 00:38:38.867417 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 30 00:38:38.867417 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 30 00:38:38.867417 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 30 00:38:38.867417 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 30 00:38:38.867417 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 30 00:38:38.867417 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application Oct 30 00:38:38.867417 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 468/953] 10.222.0.42 () {56 vars in 1096 bytes} [Sun Oct 30 00:38:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:38:38.873722 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd50383-4c4e-419e-ad27-083d641cd53c None None] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:38:38.877243 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:38:38.983550 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd50383-4c4e-419e-ad27-083d641cd53c None None] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:38:39.021586 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e1d136-0a26-49fa-b816-8407ab3b56a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:38:39.022220 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e1d136-0a26-49fa-b816-8407ab3b56a5 None admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:38:39.022467 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e1d136-0a26-49fa-b816-8407ab3b56a5 None admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:38:39.022745 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e1d136-0a26-49fa-b816-8407ab3b56a5 None admin] PATH_INFO: `/v3/roles` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:38:39.023528 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e1d136-0a26-49fa-b816-8407ab3b56a5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87956) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:38:39.023823 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e1d136-0a26-49fa-b816-8407ab3b56a5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:38:39.025344 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e1d136-0a26-49fa-b816-8407ab3b56a5 None admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:38:39.034414 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 486/954] 10.222.0.42 () {56 vars in 1099 bytes} [Sun Oct 30 00:38:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:38:39.041043 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957ca763-fe32-4b14-98a0-fe7089bf8e61 None admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:38:39.151340 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=100 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:38:39.155441 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957ca763-fe32-4b14-98a0-fe7089bf8e61 None admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:38:39.190035 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f76780-9bd0-46ef-a6fd-35f13639293f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:38:39.190691 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f76780-9bd0-46ef-a6fd-35f13639293f None admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:38:39.190938 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f76780-9bd0-46ef-a6fd-35f13639293f None admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:38:39.191231 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f76780-9bd0-46ef-a6fd-35f13639293f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:38:39.202220 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f76780-9bd0-46ef-a6fd-35f13639293f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:38:39.203700 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f76780-9bd0-46ef-a6fd-35f13639293f None admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:38:39.218479 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application [None req-02f76780-9bd0-46ef-a6fd-35f13639293f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 30 00:38:39.218479 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:38:39.218479 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:38:39.218479 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:38:39.218479 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:38:39.218479 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:38:39.218479 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:38:39.218479 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:38:39.218479 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:38:39.218479 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:38:39.218479 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:38:39.218479 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:38:39.218479 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 30 00:38:39.218479 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 30 00:38:39.218479 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 30 00:38:39.218479 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 30 00:38:39.219673 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:38:39.219673 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:38:39.219673 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:38:39.219673 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:38:39.219673 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:38:39.219673 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:38:39.219673 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:38:39.219673 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application with Lock( Oct 30 00:38:39.219673 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:38:39.219673 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:38:39.219673 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:38:39.219673 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:38:39.219673 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:38:39.219673 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:38:39.219673 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:38:39.219673 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:38:39.219673 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 30 00:38:39.220569 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 30 00:38:39.220569 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 30 00:38:39.220569 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application Oct 30 00:38:39.220569 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 469/955] 10.222.0.42 () {56 vars in 1108 bytes} [Sun Oct 30 00:38:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:38:39.225597 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e1d136-0a26-49fa-b816-8407ab3b56a5 None admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:38:39.296783 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=100 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:38:39.337414 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e1d136-0a26-49fa-b816-8407ab3b56a5 None admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:38:39.376864 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41d0db0-97b9-49ae-a947-5d76623f0103 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:38:39.377664 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41d0db0-97b9-49ae-a947-5d76623f0103 None admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:38:39.377956 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41d0db0-97b9-49ae-a947-5d76623f0103 None admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:38:39.378309 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41d0db0-97b9-49ae-a947-5d76623f0103 None admin] PATH_INFO: `/v3/domains` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:38:39.378845 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41d0db0-97b9-49ae-a947-5d76623f0103 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87956) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:38:39.379138 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41d0db0-97b9-49ae-a947-5d76623f0103 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:38:39.380526 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41d0db0-97b9-49ae-a947-5d76623f0103 None admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:38:39.394633 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 487/956] 10.222.0.42 () {56 vars in 1109 bytes} [Sun Oct 30 00:38:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:38:39.400713 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f76780-9bd0-46ef-a6fd-35f13639293f None admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:38:39.515760 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f76780-9bd0-46ef-a6fd-35f13639293f None admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:38:39.553989 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b48ef8-3703-4fc9-98f3-3a32d2b1d5da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:38:39.554577 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b48ef8-3703-4fc9-98f3-3a32d2b1d5da None admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:38:39.554867 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b48ef8-3703-4fc9-98f3-3a32d2b1d5da None admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:38:39.555140 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b48ef8-3703-4fc9-98f3-3a32d2b1d5da None admin] PATH_INFO: `/v3/users/placement` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:38:39.564195 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b48ef8-3703-4fc9-98f3-3a32d2b1d5da None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:38:39.566630 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b48ef8-3703-4fc9-98f3-3a32d2b1d5da None admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:38:39.579965 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application [None req-a5b48ef8-3703-4fc9-98f3-3a32d2b1d5da None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 30 00:38:39.579965 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:38:39.579965 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:38:39.579965 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:38:39.579965 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:38:39.579965 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:38:39.579965 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:38:39.579965 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:38:39.579965 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:38:39.579965 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:38:39.579965 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:38:39.579965 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:38:39.579965 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 30 00:38:39.579965 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 30 00:38:39.579965 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 30 00:38:39.579965 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 30 00:38:39.581120 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:38:39.581120 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:38:39.581120 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 30 00:38:39.581120 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 30 00:38:39.581120 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 30 00:38:39.581120 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 30 00:38:39.581120 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:38:39.581120 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:38:39.581120 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:38:39.581120 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:38:39.581120 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:38:39.581120 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application with Lock( Oct 30 00:38:39.581120 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:38:39.581120 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:38:39.581120 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:38:39.581120 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:38:39.581120 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:38:39.581120 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:38:39.582126 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:38:39.582126 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:38:39.582126 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 30 00:38:39.582126 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 30 00:38:39.582126 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 30 00:38:39.582126 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 30 00:38:39.582126 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 30 00:38:39.582126 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 30 00:38:39.582126 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 30 00:38:39.582126 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application Oct 30 00:38:39.582126 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 470/957] 10.222.0.42 () {56 vars in 1108 bytes} [Sun Oct 30 00:38:39 2022] GET /identity/v3/users/placement => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:38:39.588306 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41d0db0-97b9-49ae-a947-5d76623f0103 None admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:38:39.701686 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41d0db0-97b9-49ae-a947-5d76623f0103 None admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:38:39.728387 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=100 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:38:39.738875 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1b2773-a992-43e8-8f21-bb7e39b73ec7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:38:39.739722 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1b2773-a992-43e8-8f21-bb7e39b73ec7 None admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:38:39.740069 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1b2773-a992-43e8-8f21-bb7e39b73ec7 None admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:38:39.740345 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1b2773-a992-43e8-8f21-bb7e39b73ec7 None admin] PATH_INFO: `/v3/users` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:38:39.741277 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1b2773-a992-43e8-8f21-bb7e39b73ec7 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=87956) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:38:39.741659 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1b2773-a992-43e8-8f21-bb7e39b73ec7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:38:39.743290 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1b2773-a992-43e8-8f21-bb7e39b73ec7 None admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:38:39.764593 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 488/958] 10.222.0.42 () {56 vars in 1143 bytes} [Sun Oct 30 00:38:39 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:38:39.770752 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b48ef8-3703-4fc9-98f3-3a32d2b1d5da None admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:38:39.789061 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=100 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:38:39.888638 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b48ef8-3703-4fc9-98f3-3a32d2b1d5da None admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:38:39.922097 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a473b81-5bdd-46cd-b8a8-3fcc7b751bab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:38:39.922669 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a473b81-5bdd-46cd-b8a8-3fcc7b751bab None admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:38:39.922945 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a473b81-5bdd-46cd-b8a8-3fcc7b751bab None admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:38:39.923231 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a473b81-5bdd-46cd-b8a8-3fcc7b751bab None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:38:40.000529 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a473b81-5bdd-46cd-b8a8-3fcc7b751bab None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:38:40.002019 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a473b81-5bdd-46cd-b8a8-3fcc7b751bab None admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:38:40.016193 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=100 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:38:40.115757 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 471/959] 10.222.0.42 () {58 vars in 1282 bytes} [Sun Oct 30 00:38:39 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Oct 30 00:38:40.122098 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1b2773-a992-43e8-8f21-bb7e39b73ec7 None admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:38:40.230357 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1b2773-a992-43e8-8f21-bb7e39b73ec7 None admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:38:40.268493 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3f3653-b6df-4373-ac37-2c26362088d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:38:40.269222 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3f3653-b6df-4373-ac37-2c26362088d8 None admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:38:40.269570 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3f3653-b6df-4373-ac37-2c26362088d8 None admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:38:40.269873 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3f3653-b6df-4373-ac37-2c26362088d8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:38:40.282349 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3f3653-b6df-4373-ac37-2c26362088d8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:38:40.283820 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3f3653-b6df-4373-ac37-2c26362088d8 None admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:38:40.298284 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application [None req-8f3f3653-b6df-4373-ac37-2c26362088d8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 30 00:38:40.298284 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:38:40.298284 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:38:40.298284 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:38:40.298284 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:38:40.298284 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:38:40.298284 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:38:40.298284 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:38:40.298284 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:38:40.298284 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:38:40.298284 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:38:40.298284 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:38:40.298284 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 30 00:38:40.298284 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 30 00:38:40.298284 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 30 00:38:40.298284 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 30 00:38:40.299873 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:38:40.299873 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:38:40.299873 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:38:40.299873 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:38:40.299873 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:38:40.299873 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:38:40.299873 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:38:40.299873 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application with Lock( Oct 30 00:38:40.299873 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:38:40.299873 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:38:40.299873 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:38:40.299873 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:38:40.299873 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:38:40.299873 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:38:40.299873 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:38:40.299873 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:38:40.299873 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 30 00:38:40.300759 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 30 00:38:40.300759 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 30 00:38:40.300759 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application Oct 30 00:38:40.300759 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 489/960] 10.222.0.42 () {56 vars in 1108 bytes} [Sun Oct 30 00:38:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:38:40.305476 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a473b81-5bdd-46cd-b8a8-3fcc7b751bab None admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:38:40.412869 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a473b81-5bdd-46cd-b8a8-3fcc7b751bab None admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:38:40.429035 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=100 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:38:40.451581 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33403f3d-086d-4123-a99b-128660d17ae3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:38:40.452496 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33403f3d-086d-4123-a99b-128660d17ae3 None admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:38:40.452998 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33403f3d-086d-4123-a99b-128660d17ae3 None admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:38:40.453099 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33403f3d-086d-4123-a99b-128660d17ae3 None admin] PATH_INFO: `/v3/domains` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:38:40.453831 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33403f3d-086d-4123-a99b-128660d17ae3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:38:40.454132 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33403f3d-086d-4123-a99b-128660d17ae3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:38:40.455635 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33403f3d-086d-4123-a99b-128660d17ae3 None admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:38:40.469038 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 472/961] 10.222.0.42 () {56 vars in 1109 bytes} [Sun Oct 30 00:38:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:38:40.475343 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3f3653-b6df-4373-ac37-2c26362088d8 None admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:38:40.517146 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=100 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:38:40.591517 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3f3653-b6df-4373-ac37-2c26362088d8 None admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:38:40.635454 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b0e8c6-ecb5-4f88-b3d8-55dd2c236888 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:38:40.636551 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b0e8c6-ecb5-4f88-b3d8-55dd2c236888 None admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:38:40.636937 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b0e8c6-ecb5-4f88-b3d8-55dd2c236888 None admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:38:40.637335 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b0e8c6-ecb5-4f88-b3d8-55dd2c236888 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:38:40.646477 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b0e8c6-ecb5-4f88-b3d8-55dd2c236888 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:38:40.648291 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b0e8c6-ecb5-4f88-b3d8-55dd2c236888 None admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:38:40.662487 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application [None req-a3b0e8c6-ecb5-4f88-b3d8-55dd2c236888 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 30 00:38:40.662487 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:38:40.662487 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:38:40.662487 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:38:40.662487 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:38:40.662487 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:38:40.662487 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:38:40.662487 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:38:40.662487 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:38:40.662487 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:38:40.662487 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:38:40.662487 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:38:40.662487 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 30 00:38:40.662487 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 30 00:38:40.662487 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 30 00:38:40.663783 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 30 00:38:40.663783 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:38:40.663783 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:38:40.663783 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:38:40.663783 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:38:40.663783 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:38:40.663783 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:38:40.663783 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:38:40.663783 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application with Lock( Oct 30 00:38:40.663783 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:38:40.663783 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:38:40.663783 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:38:40.663783 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:38:40.663783 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:38:40.663783 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:38:40.663783 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:38:40.663783 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:38:40.664874 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 30 00:38:40.664874 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 30 00:38:40.664874 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 30 00:38:40.664874 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 30 00:38:40.664874 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 30 00:38:40.664874 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 30 00:38:40.664874 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 30 00:38:40.664874 dv-cinder-861491-6-smb devstack@keystone.service[87956]: ERROR keystone.server.flask.application Oct 30 00:38:40.664874 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 490/962] 10.222.0.42 () {56 vars in 1111 bytes} [Sun Oct 30 00:38:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 30 00:38:40.670419 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33403f3d-086d-4123-a99b-128660d17ae3 None admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:38:40.780168 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33403f3d-086d-4123-a99b-128660d17ae3 None admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:38:40.815661 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef58cf54-c642-4130-acc3-35e8d7a02695 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:38:40.816253 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef58cf54-c642-4130-acc3-35e8d7a02695 None admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:38:40.816530 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef58cf54-c642-4130-acc3-35e8d7a02695 None admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:38:40.816810 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef58cf54-c642-4130-acc3-35e8d7a02695 None admin] PATH_INFO: `/v3/projects` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:38:40.817509 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef58cf54-c642-4130-acc3-35e8d7a02695 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:38:40.817811 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef58cf54-c642-4130-acc3-35e8d7a02695 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:38:40.819297 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef58cf54-c642-4130-acc3-35e8d7a02695 None admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:38:40.833280 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 473/963] 10.222.0.42 () {56 vars in 1148 bytes} [Sun Oct 30 00:38:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 30 00:38:40.840087 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b0e8c6-ecb5-4f88-b3d8-55dd2c236888 None admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:38:40.942293 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=100 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:38:40.950480 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b0e8c6-ecb5-4f88-b3d8-55dd2c236888 None admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:38:40.988760 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3645088-1923-496a-97e0-8f0acefb876a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:38:40.989400 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3645088-1923-496a-97e0-8f0acefb876a None admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:38:40.989675 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3645088-1923-496a-97e0-8f0acefb876a None admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:38:40.989939 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3645088-1923-496a-97e0-8f0acefb876a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:38:40.990678 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3645088-1923-496a-97e0-8f0acefb876a None admin] RBAC: Adding query filter params (role.id=6ccaa8c11f29456fb4e4eeccb21616c7, scope.project.id=17d2387fdf794d4eaef07bbcd7b39f2a, user.id=202b8b2c0f454297bfb97c1ac4033625) {{(pid=87956) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:38:40.990983 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3645088-1923-496a-97e0-8f0acefb876a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:38:40.992473 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3645088-1923-496a-97e0-8f0acefb876a None admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:38:40.999271 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 491/964] 10.222.0.42 () {56 vars in 1374 bytes} [Sun Oct 30 00:38:40 2022] GET /identity/v3/role_assignments?user.id=202b8b2c0f454297bfb97c1ac4033625&scope.project.id=17d2387fdf794d4eaef07bbcd7b39f2a&role.id=6ccaa8c11f29456fb4e4eeccb21616c7 => generated 608 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:38:43.153661 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf521008-356e-45c2-8ae6-b38496eb428f None None] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:38:43.154201 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf521008-356e-45c2-8ae6-b38496eb428f None None] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:38:43.154201 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf521008-356e-45c2-8ae6-b38496eb428f None None] PATH_INFO: `/` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:38:43.155544 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 474/965] 10.222.0.42 () {54 vars in 927 bytes} [Sun Oct 30 00:38:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:38:43.164232 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc6ac16-a4d9-43b0-916a-b7946630d36e None None] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:38:43.164914 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc6ac16-a4d9-43b0-916a-b7946630d36e None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:38:43.165116 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc6ac16-a4d9-43b0-916a-b7946630d36e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:38:43.191426 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.auth.core [None req-fbc6ac16-a4d9-43b0-916a-b7946630d36e None None] MFA Rules not processed for user `eb55b6cbca4945abb21b0e49eb745e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=87956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:38:43.192617 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-fbc6ac16-a4d9-43b0-916a-b7946630d36e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:38:43.267177 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 492/966] 10.222.0.42 () {58 vars in 1024 bytes} [Sun Oct 30 00:38:43 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 30 00:38:43.530518 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf521008-356e-45c2-8ae6-b38496eb428f None None] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:38:43.571948 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=100 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:38:43.658639 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf521008-356e-45c2-8ae6-b38496eb428f None None] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:38:43.696182 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13503b71-0956-4a69-bdbf-3ce2dee40220 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:38:43.696802 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13503b71-0956-4a69-bdbf-3ce2dee40220 None admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:38:43.697081 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13503b71-0956-4a69-bdbf-3ce2dee40220 None admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:38:43.697383 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13503b71-0956-4a69-bdbf-3ce2dee40220 None admin] PATH_INFO: `/v3/services/placement` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:38:43.697929 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13503b71-0956-4a69-bdbf-3ce2dee40220 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:38:43.699408 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13503b71-0956-4a69-bdbf-3ce2dee40220 None admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:38:43.708673 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application [None req-13503b71-0956-4a69-bdbf-3ce2dee40220 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Oct 30 00:38:43.708673 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:38:43.708673 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 30 00:38:43.708673 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 30 00:38:43.708673 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 30 00:38:43.708673 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 30 00:38:43.708673 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 30 00:38:43.708673 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 30 00:38:43.708673 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 30 00:38:43.708673 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application Oct 30 00:38:43.708673 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 30 00:38:43.708673 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application Oct 30 00:38:43.708673 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:38:43.708673 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:38:43.708673 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:38:43.708673 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:38:43.708673 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:38:43.710158 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:38:43.710158 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:38:43.710158 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:38:43.710158 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:38:43.710158 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:38:43.710158 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:38:43.710158 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 30 00:38:43.710158 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 30 00:38:43.710158 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 30 00:38:43.710158 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 30 00:38:43.710158 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:38:43.710158 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:38:43.710158 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:38:43.710158 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:38:43.710158 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:38:43.710158 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:38:43.711318 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:38:43.711318 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application with Lock( Oct 30 00:38:43.711318 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:38:43.711318 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:38:43.711318 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:38:43.711318 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:38:43.711318 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:38:43.711318 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:38:43.711318 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:38:43.711318 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:38:43.711318 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 30 00:38:43.711318 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 30 00:38:43.711318 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 30 00:38:43.711318 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application Oct 30 00:38:43.711318 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 475/967] 10.222.0.42 () {56 vars in 1117 bytes} [Sun Oct 30 00:38:43 2022] GET /identity/v3/services/placement => generated 90 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:38:43.716510 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc6ac16-a4d9-43b0-916a-b7946630d36e None None] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:38:43.812537 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=100 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:38:43.823247 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc6ac16-a4d9-43b0-916a-b7946630d36e None None] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:38:43.858711 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91665119-6ff7-4e14-8678-d4180c41657d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:38:43.859351 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91665119-6ff7-4e14-8678-d4180c41657d None admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:38:43.859629 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91665119-6ff7-4e14-8678-d4180c41657d None admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:38:43.859895 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91665119-6ff7-4e14-8678-d4180c41657d None admin] PATH_INFO: `/v3/services` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:38:43.860525 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91665119-6ff7-4e14-8678-d4180c41657d None admin] RBAC: Adding query filter params (name=placement) {{(pid=87956) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:38:43.860827 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91665119-6ff7-4e14-8678-d4180c41657d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:38:43.862181 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91665119-6ff7-4e14-8678-d4180c41657d None admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:38:43.867150 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 493/968] 10.222.0.42 () {56 vars in 1116 bytes} [Sun Oct 30 00:38:43 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:38:43.873306 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13503b71-0956-4a69-bdbf-3ce2dee40220 None admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:38:43.973621 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=100 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:38:43.981065 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13503b71-0956-4a69-bdbf-3ce2dee40220 None admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:38:44.016599 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc986dc-add7-4588-9059-0b9f5b36989a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:38:44.017184 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc986dc-add7-4588-9059-0b9f5b36989a None admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:38:44.017452 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc986dc-add7-4588-9059-0b9f5b36989a None admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:38:44.017719 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc986dc-add7-4588-9059-0b9f5b36989a None admin] PATH_INFO: `/v3/services` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:38:44.018332 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc986dc-add7-4588-9059-0b9f5b36989a None admin] RBAC: Adding query filter params (type=placement) {{(pid=87955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:38:44.018631 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc986dc-add7-4588-9059-0b9f5b36989a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:38:44.019999 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc986dc-add7-4588-9059-0b9f5b36989a None admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:38:44.024694 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 476/969] 10.222.0.42 () {56 vars in 1116 bytes} [Sun Oct 30 00:38:43 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:38:46.129177 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43cde76-f7f2-4568-8c3d-be59ccaf5f1d None None] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:38:46.129999 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43cde76-f7f2-4568-8c3d-be59ccaf5f1d None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:38:46.129999 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43cde76-f7f2-4568-8c3d-be59ccaf5f1d None None] PATH_INFO: `/` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:38:46.132299 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 494/970] 10.222.0.42 () {54 vars in 927 bytes} [Sun Oct 30 00:38:46 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:38:46.140251 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be2080a-50a4-4f3a-89e8-0c090abc8d86 None None] REQUEST_METHOD: `POST` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:38:46.140707 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be2080a-50a4-4f3a-89e8-0c090abc8d86 None None] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:38:46.140809 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be2080a-50a4-4f3a-89e8-0c090abc8d86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:38:46.160305 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.auth.core [None req-2be2080a-50a4-4f3a-89e8-0c090abc8d86 None None] MFA Rules not processed for user `eb55b6cbca4945abb21b0e49eb745e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=87955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:38:46.161488 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-2be2080a-50a4-4f3a-89e8-0c090abc8d86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:38:46.232253 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 477/971] 10.222.0.42 () {58 vars in 1024 bytes} [Sun Oct 30 00:38:46 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 30 00:38:46.501105 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43cde76-f7f2-4568-8c3d-be59ccaf5f1d None None] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:38:46.612194 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43cde76-f7f2-4568-8c3d-be59ccaf5f1d None None] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:38:46.658221 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f199a9e4-e7c5-4e4e-9efe-3d23ba0444cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:38:46.658979 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f199a9e4-e7c5-4e4e-9efe-3d23ba0444cc None admin] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:38:46.659385 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f199a9e4-e7c5-4e4e-9efe-3d23ba0444cc None admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:38:46.659841 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f199a9e4-e7c5-4e4e-9efe-3d23ba0444cc None admin] PATH_INFO: `/v3/services` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:38:46.660631 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f199a9e4-e7c5-4e4e-9efe-3d23ba0444cc None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:38:46.662448 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f199a9e4-e7c5-4e4e-9efe-3d23ba0444cc None admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:38:46.679506 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 495/972] 10.222.0.42 () {60 vars in 1141 bytes} [Sun Oct 30 00:38:46 2022] POST /identity/v3/services => generated 246 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 00:38:48.820435 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a6cbc1-9bfb-47fd-9f91-4898f63bdcf8 None None] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:38:48.821405 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a6cbc1-9bfb-47fd-9f91-4898f63bdcf8 None None] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:38:48.821405 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a6cbc1-9bfb-47fd-9f91-4898f63bdcf8 None None] PATH_INFO: `/` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:38:48.823344 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 478/973] 10.222.0.42 () {54 vars in 927 bytes} [Sun Oct 30 00:38:48 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:38:48.832251 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ec2b60-0870-496d-94af-256038cbc45f None None] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:38:48.832966 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ec2b60-0870-496d-94af-256038cbc45f None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:38:48.833133 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ec2b60-0870-496d-94af-256038cbc45f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:38:48.860953 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.auth.core [None req-48ec2b60-0870-496d-94af-256038cbc45f None None] MFA Rules not processed for user `eb55b6cbca4945abb21b0e49eb745e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=87956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:38:48.862155 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-48ec2b60-0870-496d-94af-256038cbc45f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:38:48.872050 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:38:48.937939 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 496/974] 10.222.0.42 () {58 vars in 1024 bytes} [Sun Oct 30 00:38:48 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 30 00:38:49.205460 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a6cbc1-9bfb-47fd-9f91-4898f63bdcf8 None None] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:38:49.302283 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=100 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:38:49.321382 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a6cbc1-9bfb-47fd-9f91-4898f63bdcf8 None None] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:38:49.364457 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a5ffd8-de66-43d6-874b-04fa208a904a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:38:49.365065 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a5ffd8-de66-43d6-874b-04fa208a904a None admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:38:49.365336 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a5ffd8-de66-43d6-874b-04fa208a904a None admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:38:49.365604 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a5ffd8-de66-43d6-874b-04fa208a904a None admin] PATH_INFO: `/v3/services/placement` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:38:49.366183 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a5ffd8-de66-43d6-874b-04fa208a904a None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:38:49.367580 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a5ffd8-de66-43d6-874b-04fa208a904a None admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:38:49.376671 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application [None req-f6a5ffd8-de66-43d6-874b-04fa208a904a None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Oct 30 00:38:49.376671 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:38:49.376671 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 30 00:38:49.376671 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 30 00:38:49.376671 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 30 00:38:49.376671 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 30 00:38:49.376671 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 30 00:38:49.376671 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 30 00:38:49.376671 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 30 00:38:49.376671 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application Oct 30 00:38:49.376671 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 30 00:38:49.376671 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application Oct 30 00:38:49.376671 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:38:49.376671 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:38:49.376671 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:38:49.376671 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:38:49.376671 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:38:49.377815 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:38:49.377815 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:38:49.377815 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:38:49.377815 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:38:49.377815 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:38:49.377815 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:38:49.377815 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 30 00:38:49.377815 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 30 00:38:49.377815 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 30 00:38:49.377815 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 30 00:38:49.377815 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:38:49.377815 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:38:49.377815 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:38:49.377815 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:38:49.377815 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:38:49.377815 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:38:49.378861 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:38:49.378861 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application with Lock( Oct 30 00:38:49.378861 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:38:49.378861 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:38:49.378861 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:38:49.378861 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:38:49.378861 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:38:49.378861 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:38:49.378861 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:38:49.378861 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:38:49.378861 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 30 00:38:49.378861 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 30 00:38:49.378861 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 30 00:38:49.378861 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application Oct 30 00:38:49.378861 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 479/975] 10.222.0.42 () {56 vars in 1117 bytes} [Sun Oct 30 00:38:49 2022] GET /identity/v3/services/placement => generated 90 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:38:49.384053 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ec2b60-0870-496d-94af-256038cbc45f None None] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:38:49.484218 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ec2b60-0870-496d-94af-256038cbc45f None None] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:38:49.520311 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042567d9-45aa-4ace-8e8b-cb25fb11dc0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:38:49.521056 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042567d9-45aa-4ace-8e8b-cb25fb11dc0d None admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:38:49.521327 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042567d9-45aa-4ace-8e8b-cb25fb11dc0d None admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:38:49.521594 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042567d9-45aa-4ace-8e8b-cb25fb11dc0d None admin] PATH_INFO: `/v3/services` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:38:49.522226 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042567d9-45aa-4ace-8e8b-cb25fb11dc0d None admin] RBAC: Adding query filter params (name=placement) {{(pid=87956) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:38:49.522520 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042567d9-45aa-4ace-8e8b-cb25fb11dc0d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:38:49.523913 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042567d9-45aa-4ace-8e8b-cb25fb11dc0d None admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:38:49.529384 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 497/976] 10.222.0.42 () {56 vars in 1116 bytes} [Sun Oct 30 00:38:49 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:38:49.536363 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a5ffd8-de66-43d6-874b-04fa208a904a None admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:38:49.655310 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a5ffd8-de66-43d6-874b-04fa208a904a None admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:38:49.691850 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e21809d-9c63-4e17-b949-69ce1f2ec9b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:38:49.692476 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e21809d-9c63-4e17-b949-69ce1f2ec9b9 None admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:38:49.692743 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e21809d-9c63-4e17-b949-69ce1f2ec9b9 None admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:38:49.692991 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e21809d-9c63-4e17-b949-69ce1f2ec9b9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:38:49.693693 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e21809d-9c63-4e17-b949-69ce1f2ec9b9 None admin] RBAC: Adding query filter params (interface=public, service_id=7ffb60d791704b6cae289c4b375362eb, region_id=RegionOne) {{(pid=87955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:38:49.693996 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e21809d-9c63-4e17-b949-69ce1f2ec9b9 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:38:49.695392 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e21809d-9c63-4e17-b949-69ce1f2ec9b9 None admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:38:49.700518 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 480/977] 10.222.0.42 () {56 vars in 1251 bytes} [Sun Oct 30 00:38:49 2022] GET /identity/v3/endpoints?service_id=7ffb60d791704b6cae289c4b375362eb&interface=public®ion_id=RegionOne => generated 194 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:38:49.706548 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042567d9-45aa-4ace-8e8b-cb25fb11dc0d None admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:38:49.711285 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=100 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:38:49.813168 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042567d9-45aa-4ace-8e8b-cb25fb11dc0d None admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:38:49.850990 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9e8ae3-1bcd-43f3-9d55-03cefe4274fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:38:49.851642 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9e8ae3-1bcd-43f3-9d55-03cefe4274fb None admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:38:49.851859 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9e8ae3-1bcd-43f3-9d55-03cefe4274fb None admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:38:49.852125 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9e8ae3-1bcd-43f3-9d55-03cefe4274fb None admin] PATH_INFO: `/v3/services` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:38:49.852720 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9e8ae3-1bcd-43f3-9d55-03cefe4274fb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:38:49.854086 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9e8ae3-1bcd-43f3-9d55-03cefe4274fb None admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:38:49.861104 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 498/978] 10.222.0.42 () {56 vars in 1087 bytes} [Sun Oct 30 00:38:49 2022] GET /identity/v3/services => generated 2191 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 00:38:51.994179 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be07f6e-c1a3-43b6-bbc1-e3bc99f1b8be None None] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:38:51.994735 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be07f6e-c1a3-43b6-bbc1-e3bc99f1b8be None None] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:38:51.994735 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be07f6e-c1a3-43b6-bbc1-e3bc99f1b8be None None] PATH_INFO: `/` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:38:51.996077 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 481/979] 10.222.0.42 () {54 vars in 927 bytes} [Sun Oct 30 00:38:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:38:52.001571 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96501f75-8429-4361-9c21-823759c665a3 None None] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:38:52.001999 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96501f75-8429-4361-9c21-823759c665a3 None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:38:52.002096 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96501f75-8429-4361-9c21-823759c665a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:38:52.021694 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.auth.core [None req-96501f75-8429-4361-9c21-823759c665a3 None None] MFA Rules not processed for user `eb55b6cbca4945abb21b0e49eb745e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=87956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:38:52.022879 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-96501f75-8429-4361-9c21-823759c665a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:38:52.088070 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=100 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:38:52.094184 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 499/980] 10.222.0.42 () {58 vars in 1024 bytes} [Sun Oct 30 00:38:52 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 30 00:38:52.362722 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be07f6e-c1a3-43b6-bbc1-e3bc99f1b8be None None] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:38:52.392215 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=100 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:38:52.474883 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be07f6e-c1a3-43b6-bbc1-e3bc99f1b8be None None] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:38:52.508805 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef8eeca-1cd5-4d03-af71-eb405d1e00af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:38:52.509408 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef8eeca-1cd5-4d03-af71-eb405d1e00af None admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:38:52.509721 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef8eeca-1cd5-4d03-af71-eb405d1e00af None admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:38:52.509985 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef8eeca-1cd5-4d03-af71-eb405d1e00af None admin] PATH_INFO: `/v3/services/placement` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:38:52.510556 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef8eeca-1cd5-4d03-af71-eb405d1e00af None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:38:52.511927 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef8eeca-1cd5-4d03-af71-eb405d1e00af None admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:38:52.520661 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application [None req-3ef8eeca-1cd5-4d03-af71-eb405d1e00af None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Oct 30 00:38:52.520661 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:38:52.520661 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 30 00:38:52.520661 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 30 00:38:52.520661 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 30 00:38:52.520661 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 30 00:38:52.520661 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 30 00:38:52.520661 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 30 00:38:52.520661 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 30 00:38:52.520661 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application Oct 30 00:38:52.520661 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 30 00:38:52.520661 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application Oct 30 00:38:52.520661 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:38:52.520661 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:38:52.520661 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:38:52.520661 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:38:52.520661 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:38:52.521799 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:38:52.521799 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:38:52.521799 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:38:52.521799 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:38:52.521799 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:38:52.521799 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:38:52.521799 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 30 00:38:52.521799 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 30 00:38:52.521799 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 30 00:38:52.521799 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 30 00:38:52.521799 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:38:52.521799 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:38:52.521799 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:38:52.521799 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:38:52.521799 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:38:52.521799 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:38:52.522994 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:38:52.522994 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application with Lock( Oct 30 00:38:52.522994 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:38:52.522994 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:38:52.522994 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:38:52.522994 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:38:52.522994 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:38:52.522994 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:38:52.522994 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:38:52.522994 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:38:52.522994 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 30 00:38:52.522994 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 30 00:38:52.522994 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 30 00:38:52.522994 dv-cinder-861491-6-smb devstack@keystone.service[87955]: ERROR keystone.server.flask.application Oct 30 00:38:52.522994 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 482/981] 10.222.0.42 () {56 vars in 1117 bytes} [Sun Oct 30 00:38:52 2022] GET /identity/v3/services/placement => generated 90 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:38:52.530066 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96501f75-8429-4361-9c21-823759c665a3 None None] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:38:52.637732 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96501f75-8429-4361-9c21-823759c665a3 None None] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:38:52.673754 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ca423b-02c9-411a-b882-71a58c6c270d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:38:52.674388 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ca423b-02c9-411a-b882-71a58c6c270d None admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:38:52.674658 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ca423b-02c9-411a-b882-71a58c6c270d None admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:38:52.674923 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ca423b-02c9-411a-b882-71a58c6c270d None admin] PATH_INFO: `/v3/services` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:38:52.675587 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ca423b-02c9-411a-b882-71a58c6c270d None admin] RBAC: Adding query filter params (name=placement) {{(pid=87956) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:38:52.675883 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ca423b-02c9-411a-b882-71a58c6c270d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:38:52.677251 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ca423b-02c9-411a-b882-71a58c6c270d None admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:38:52.684872 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 500/982] 10.222.0.42 () {56 vars in 1116 bytes} [Sun Oct 30 00:38:52 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:38:52.690965 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef8eeca-1cd5-4d03-af71-eb405d1e00af None admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:38:52.776571 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=100 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:38:52.795256 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef8eeca-1cd5-4d03-af71-eb405d1e00af None admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:38:52.838457 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45851d9-b2d3-484b-8d9c-269f7516fef3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:38:52.839048 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45851d9-b2d3-484b-8d9c-269f7516fef3 None admin] REQUEST_METHOD: `POST` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:38:52.839346 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45851d9-b2d3-484b-8d9c-269f7516fef3 None admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:38:52.839596 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45851d9-b2d3-484b-8d9c-269f7516fef3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:38:52.840259 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45851d9-b2d3-484b-8d9c-269f7516fef3 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:38:52.841612 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45851d9-b2d3-484b-8d9c-269f7516fef3 None admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:38:52.867749 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 483/983] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 30 00:38:52 2022] POST /identity/v3/endpoints => generated 331 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 00:39:02.680006 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=69 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:39:02.860538 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=30,keystone:INSERT=1 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:39:56.304214 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8496f172-eec5-4c06-ad73-a6660a2b7b2e None None] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:39:56.304678 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8496f172-eec5-4c06-ad73-a6660a2b7b2e None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:39:56.304762 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8496f172-eec5-4c06-ad73-a6660a2b7b2e None None] PATH_INFO: `/` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:39:56.310043 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 501/984] 10.222.0.42 () {54 vars in 927 bytes} [Sun Oct 30 00:39:56 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:39:56.311451 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdd6df0-d1f5-43a4-a82f-6937fc59a66b None None] REQUEST_METHOD: `POST` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:39:56.311899 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdd6df0-d1f5-43a4-a82f-6937fc59a66b None None] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:39:56.312019 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdd6df0-d1f5-43a4-a82f-6937fc59a66b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:39:56.445809 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.auth.core [None req-3bdd6df0-d1f5-43a4-a82f-6937fc59a66b None None] MFA Rules not processed for user `eb55b6cbca4945abb21b0e49eb745e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=87955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:39:56.447046 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-3bdd6df0-d1f5-43a4-a82f-6937fc59a66b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:39:56.563623 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 484/985] 10.222.0.42 () {58 vars in 1024 bytes} [Sun Oct 30 00:39:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 30 00:39:56.858303 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bf61c4-ba65-4359-b9c7-bf1ec61dfcee None None] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:39:56.858801 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bf61c4-ba65-4359-b9c7-bf1ec61dfcee None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:39:56.859149 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bf61c4-ba65-4359-b9c7-bf1ec61dfcee None None] PATH_INFO: `/` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:39:56.860793 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 502/986] 10.222.0.42 () {54 vars in 965 bytes} [Sun Oct 30 00:39:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:39:56.866746 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85364b9-eceb-4d4d-a93d-484a9b3caa33 None None] REQUEST_METHOD: `POST` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:39:56.867106 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85364b9-eceb-4d4d-a93d-484a9b3caa33 None None] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:39:56.867486 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85364b9-eceb-4d4d-a93d-484a9b3caa33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:39:56.948827 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.auth.core [None req-f85364b9-eceb-4d4d-a93d-484a9b3caa33 None None] MFA Rules not processed for user `5693f186c6ad4d9394f02ee3477cdcd3`. Rule list: `[]` (Enabled: `True`). {{(pid=87955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:39:56.950010 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-f85364b9-eceb-4d4d-a93d-484a9b3caa33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:39:56.974278 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=100 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:39:57.040931 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 485/987] 10.222.0.42 () {58 vars in 1062 bytes} [Sun Oct 30 00:39:56 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:39:57.051937 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bf61c4-ba65-4359-b9c7-bf1ec61dfcee None None] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:39:57.053770 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-40bf61c4-ba65-4359-b9c7-bf1ec61dfcee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:39:57.179440 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bf61c4-ba65-4359-b9c7-bf1ec61dfcee None None] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:39:57.260715 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2b55c5-ae27-4ac6-9162-67bf309a15be service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5693f186c6ad4d9394f02ee3477cdcd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d2387fdf794d4eaef07bbcd7b39f2a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:39:57.261328 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2b55c5-ae27-4ac6-9162-67bf309a15be service neutron] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:39:57.261596 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2b55c5-ae27-4ac6-9162-67bf309a15be service neutron] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:39:57.261842 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2b55c5-ae27-4ac6-9162-67bf309a15be service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:39:57.263494 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-0c2b55c5-ae27-4ac6-9162-67bf309a15be service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:39:57.322421 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=100 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:39:57.384852 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2b55c5-ae27-4ac6-9162-67bf309a15be service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:39:57.386363 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2b55c5-ae27-4ac6-9162-67bf309a15be service neutron] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:39:57.406803 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 503/988] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 30 00:39:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 00:39:59.807950 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b652712e-a125-4127-ab33-f3843b4a891c None None] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:39:59.808511 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b652712e-a125-4127-ab33-f3843b4a891c None None] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:39:59.808605 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b652712e-a125-4127-ab33-f3843b4a891c None None] PATH_INFO: `/` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:39:59.810016 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 486/989] 10.222.0.42 () {54 vars in 927 bytes} [Sun Oct 30 00:39:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:39:59.815528 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcda139-3ebf-4ef8-9700-efe716b1657a None None] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:39:59.816019 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcda139-3ebf-4ef8-9700-efe716b1657a None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:39:59.816111 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcda139-3ebf-4ef8-9700-efe716b1657a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:39:59.889947 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.auth.core [None req-1dcda139-3ebf-4ef8-9700-efe716b1657a None None] MFA Rules not processed for user `eb55b6cbca4945abb21b0e49eb745e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=87956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:39:59.891286 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-1dcda139-3ebf-4ef8-9700-efe716b1657a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:39:59.995267 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 504/990] 10.222.0.42 () {58 vars in 1024 bytes} [Sun Oct 30 00:39:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:40:00.286262 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ceafe4-63ed-478e-a5b6-423ffa6f3829 None None] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:40:00.286602 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ceafe4-63ed-478e-a5b6-423ffa6f3829 None None] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:40:00.286874 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ceafe4-63ed-478e-a5b6-423ffa6f3829 None None] PATH_INFO: `/` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:40:00.288325 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 487/991] 10.222.0.42 () {54 vars in 965 bytes} [Sun Oct 30 00:40:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:40:00.295006 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5a96eb-5c5f-498d-a36a-514c3e433058 None None] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:40:00.295324 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5a96eb-5c5f-498d-a36a-514c3e433058 None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:40:00.295597 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5a96eb-5c5f-498d-a36a-514c3e433058 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:40:00.307851 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=100 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:40:00.375768 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.auth.core [None req-4b5a96eb-5c5f-498d-a36a-514c3e433058 None None] MFA Rules not processed for user `5693f186c6ad4d9394f02ee3477cdcd3`. Rule list: `[]` (Enabled: `True`). {{(pid=87956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:40:00.376999 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-4b5a96eb-5c5f-498d-a36a-514c3e433058 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:40:00.454479 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 505/992] 10.222.0.42 () {58 vars in 1062 bytes} [Sun Oct 30 00:40:00 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:40:00.463602 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ceafe4-63ed-478e-a5b6-423ffa6f3829 None None] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:40:00.465221 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-33ceafe4-63ed-478e-a5b6-423ffa6f3829 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:40:00.571691 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ceafe4-63ed-478e-a5b6-423ffa6f3829 None None] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:40:00.643995 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=100 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:40:00.646682 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3cb91a-9270-4b0d-a80a-840f4402b496 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5693f186c6ad4d9394f02ee3477cdcd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d2387fdf794d4eaef07bbcd7b39f2a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:40:00.647324 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3cb91a-9270-4b0d-a80a-840f4402b496 service neutron] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:40:00.647608 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3cb91a-9270-4b0d-a80a-840f4402b496 service neutron] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:40:00.647881 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3cb91a-9270-4b0d-a80a-840f4402b496 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:40:00.649957 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-3b3cb91a-9270-4b0d-a80a-840f4402b496 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:40:00.760508 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3cb91a-9270-4b0d-a80a-840f4402b496 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:40:00.761851 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3cb91a-9270-4b0d-a80a-840f4402b496 service neutron] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:40:00.779852 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 488/993] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 30 00:40:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 00:40:03.460383 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc1a239-6fce-46d6-936d-90b93de382f8 None None] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:40:03.461227 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc1a239-6fce-46d6-936d-90b93de382f8 None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:40:03.461227 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc1a239-6fce-46d6-936d-90b93de382f8 None None] PATH_INFO: `/` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:40:03.463169 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 506/994] 10.222.0.42 () {54 vars in 927 bytes} [Sun Oct 30 00:40:03 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:40:03.468760 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399dfdab-bee8-4733-9269-08b54957e8f9 None None] REQUEST_METHOD: `POST` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:40:03.469195 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399dfdab-bee8-4733-9269-08b54957e8f9 None None] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:40:03.469391 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399dfdab-bee8-4733-9269-08b54957e8f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:40:03.538265 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.auth.core [None req-399dfdab-bee8-4733-9269-08b54957e8f9 None None] MFA Rules not processed for user `da70f1c161a64061818e8e4c38b75efc`. Rule list: `[]` (Enabled: `True`). {{(pid=87955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:40:03.539515 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-399dfdab-bee8-4733-9269-08b54957e8f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:40:03.594069 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=100 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:40:03.651546 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 489/995] 10.222.0.42 () {58 vars in 1024 bytes} [Sun Oct 30 00:40:03 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:40:03.934023 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc1a239-6fce-46d6-936d-90b93de382f8 None None] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:40:03.936467 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-afc1a239-6fce-46d6-936d-90b93de382f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:40:04.042818 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc1a239-6fce-46d6-936d-90b93de382f8 None None] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:40:04.045618 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=100 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:40:04.129121 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea952408-34fe-48b4-88de-02396060f6f3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5693f186c6ad4d9394f02ee3477cdcd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d2387fdf794d4eaef07bbcd7b39f2a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:40:04.129952 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea952408-34fe-48b4-88de-02396060f6f3 service neutron] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:40:04.130231 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea952408-34fe-48b4-88de-02396060f6f3 service neutron] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:40:04.130497 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea952408-34fe-48b4-88de-02396060f6f3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:40:04.132987 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-ea952408-34fe-48b4-88de-02396060f6f3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:40:04.259294 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea952408-34fe-48b4-88de-02396060f6f3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:40:04.260645 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea952408-34fe-48b4-88de-02396060f6f3 service neutron] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:40:04.280201 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 507/996] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 30 00:40:03 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 00:40:06.896485 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7483fc9a-3fb3-46f6-9f0c-3658b54b70e8 None None] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:40:06.897112 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7483fc9a-3fb3-46f6-9f0c-3658b54b70e8 None None] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:40:06.897112 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7483fc9a-3fb3-46f6-9f0c-3658b54b70e8 None None] PATH_INFO: `/` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:40:06.898358 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 490/997] 10.222.0.42 () {54 vars in 927 bytes} [Sun Oct 30 00:40:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:40:06.904797 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e96df7-efc5-4ae6-a8da-2904103b6738 None None] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:40:06.905255 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e96df7-efc5-4ae6-a8da-2904103b6738 None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:40:06.905348 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e96df7-efc5-4ae6-a8da-2904103b6738 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:40:06.952624 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=100 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:40:06.978324 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.auth.core [None req-e6e96df7-efc5-4ae6-a8da-2904103b6738 None None] MFA Rules not processed for user `eb55b6cbca4945abb21b0e49eb745e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=87956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:40:06.979559 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-e6e96df7-efc5-4ae6-a8da-2904103b6738 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:40:07.077517 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 508/998] 10.222.0.42 () {58 vars in 1024 bytes} [Sun Oct 30 00:40:06 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:40:07.361898 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7483fc9a-3fb3-46f6-9f0c-3658b54b70e8 None None] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:40:07.364394 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-7483fc9a-3fb3-46f6-9f0c-3658b54b70e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:40:07.497086 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7483fc9a-3fb3-46f6-9f0c-3658b54b70e8 None None] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:40:07.582689 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68be4410-7923-4d7e-bb90-8852863b6832 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5693f186c6ad4d9394f02ee3477cdcd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d2387fdf794d4eaef07bbcd7b39f2a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:40:07.583455 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68be4410-7923-4d7e-bb90-8852863b6832 service neutron] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:40:07.583760 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68be4410-7923-4d7e-bb90-8852863b6832 service neutron] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:40:07.584089 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68be4410-7923-4d7e-bb90-8852863b6832 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:40:07.585919 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-68be4410-7923-4d7e-bb90-8852863b6832 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:40:07.596410 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=100 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:40:07.708955 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68be4410-7923-4d7e-bb90-8852863b6832 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:40:07.710307 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68be4410-7923-4d7e-bb90-8852863b6832 service neutron] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:40:07.728722 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 491/999] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 30 00:40:07 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 00:40:10.528058 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28483311-af3e-4d53-ba05-2fa301b9c67c None None] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:40:10.528615 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28483311-af3e-4d53-ba05-2fa301b9c67c None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:40:10.528615 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28483311-af3e-4d53-ba05-2fa301b9c67c None None] PATH_INFO: `/` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:40:10.529915 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 509/1000] 10.222.0.42 () {54 vars in 927 bytes} [Sun Oct 30 00:40:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:40:10.535350 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3432a960-7940-4ec6-880c-00460166c3fe None None] REQUEST_METHOD: `POST` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:40:10.535770 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3432a960-7940-4ec6-880c-00460166c3fe None None] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:40:10.535885 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3432a960-7940-4ec6-880c-00460166c3fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:40:10.610023 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.auth.core [None req-3432a960-7940-4ec6-880c-00460166c3fe None None] MFA Rules not processed for user `eb55b6cbca4945abb21b0e49eb745e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=87955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:40:10.611325 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-3432a960-7940-4ec6-880c-00460166c3fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:40:10.675870 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=100 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:40:10.719983 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 492/1001] 10.222.0.42 () {58 vars in 1024 bytes} [Sun Oct 30 00:40:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:40:10.993687 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28483311-af3e-4d53-ba05-2fa301b9c67c None None] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:40:10.995322 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-28483311-af3e-4d53-ba05-2fa301b9c67c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:40:11.102694 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28483311-af3e-4d53-ba05-2fa301b9c67c None None] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:40:11.116097 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=100 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:40:11.177617 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d64bf4f-eafe-4780-822e-193b08ea632c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5693f186c6ad4d9394f02ee3477cdcd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d2387fdf794d4eaef07bbcd7b39f2a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:40:11.178225 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d64bf4f-eafe-4780-822e-193b08ea632c service neutron] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:40:11.178490 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d64bf4f-eafe-4780-822e-193b08ea632c service neutron] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:40:11.178749 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d64bf4f-eafe-4780-822e-193b08ea632c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:40:11.180358 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-7d64bf4f-eafe-4780-822e-193b08ea632c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:40:11.292375 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d64bf4f-eafe-4780-822e-193b08ea632c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:40:11.293826 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d64bf4f-eafe-4780-822e-193b08ea632c service neutron] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:40:11.314833 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 510/1002] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 30 00:40:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 00:40:13.523230 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfaf00ad-7b13-4726-9352-297276adee9e None None] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:40:13.523809 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfaf00ad-7b13-4726-9352-297276adee9e None None] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:40:13.523809 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfaf00ad-7b13-4726-9352-297276adee9e None None] PATH_INFO: `/` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:40:13.525129 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 493/1003] 10.222.0.42 () {54 vars in 927 bytes} [Sun Oct 30 00:40:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:40:13.530441 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c88d7e-d3f0-43a1-9555-d1f833453425 None None] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:40:13.530988 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c88d7e-d3f0-43a1-9555-d1f833453425 None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:40:13.530988 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c88d7e-d3f0-43a1-9555-d1f833453425 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:40:13.583910 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=100 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:40:13.609179 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.auth.core [None req-b5c88d7e-d3f0-43a1-9555-d1f833453425 None None] MFA Rules not processed for user `eb55b6cbca4945abb21b0e49eb745e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=87956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:40:13.610445 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-b5c88d7e-d3f0-43a1-9555-d1f833453425 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:40:13.718981 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 511/1004] 10.222.0.42 () {58 vars in 1024 bytes} [Sun Oct 30 00:40:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:40:13.997815 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfaf00ad-7b13-4726-9352-297276adee9e None None] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:40:13.999402 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-dfaf00ad-7b13-4726-9352-297276adee9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:40:14.110466 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfaf00ad-7b13-4726-9352-297276adee9e None None] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:40:14.185296 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d858092c-11bb-4b45-b01f-916016cc4b1f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5693f186c6ad4d9394f02ee3477cdcd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d2387fdf794d4eaef07bbcd7b39f2a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:40:14.185813 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d858092c-11bb-4b45-b01f-916016cc4b1f service neutron] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:40:14.186091 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d858092c-11bb-4b45-b01f-916016cc4b1f service neutron] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:40:14.186363 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d858092c-11bb-4b45-b01f-916016cc4b1f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:40:14.188025 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-d858092c-11bb-4b45-b01f-916016cc4b1f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:40:14.207106 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=100 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:40:14.303763 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d858092c-11bb-4b45-b01f-916016cc4b1f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:40:14.305194 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d858092c-11bb-4b45-b01f-916016cc4b1f service neutron] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:40:14.323507 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 494/1005] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 30 00:40:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 00:40:16.516028 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae9da38-9373-4f56-84bb-0667c64b167b None None] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:40:16.516502 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae9da38-9373-4f56-84bb-0667c64b167b None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:40:16.516502 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae9da38-9373-4f56-84bb-0667c64b167b None None] PATH_INFO: `/` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:40:16.517910 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 512/1006] 10.222.0.42 () {54 vars in 927 bytes} [Sun Oct 30 00:40:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:40:16.523518 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d465bf33-8339-4045-aad6-da0371391973 None None] REQUEST_METHOD: `POST` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:40:16.524009 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d465bf33-8339-4045-aad6-da0371391973 None None] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:40:16.524009 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d465bf33-8339-4045-aad6-da0371391973 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:40:16.601054 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.auth.core [None req-d465bf33-8339-4045-aad6-da0371391973 None None] MFA Rules not processed for user `da70f1c161a64061818e8e4c38b75efc`. Rule list: `[]` (Enabled: `True`). {{(pid=87955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:40:16.602275 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-d465bf33-8339-4045-aad6-da0371391973 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:40:16.669991 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=100 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:40:16.701734 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 495/1007] 10.222.0.42 () {58 vars in 1024 bytes} [Sun Oct 30 00:40:16 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:40:16.984353 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae9da38-9373-4f56-84bb-0667c64b167b None None] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:40:16.985922 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-eae9da38-9373-4f56-84bb-0667c64b167b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:40:17.098854 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae9da38-9373-4f56-84bb-0667c64b167b None None] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:40:17.120351 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=100 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:40:17.174020 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b03f3a-74b7-4735-8772-44ff93785070 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5693f186c6ad4d9394f02ee3477cdcd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d2387fdf794d4eaef07bbcd7b39f2a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:40:17.174636 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b03f3a-74b7-4735-8772-44ff93785070 service neutron] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:40:17.174902 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b03f3a-74b7-4735-8772-44ff93785070 service neutron] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:40:17.175170 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b03f3a-74b7-4735-8772-44ff93785070 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:40:17.176791 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-75b03f3a-74b7-4735-8772-44ff93785070 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:40:17.288081 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b03f3a-74b7-4735-8772-44ff93785070 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:40:17.289524 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b03f3a-74b7-4735-8772-44ff93785070 service neutron] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:40:17.307714 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 513/1008] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 30 00:40:16 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 00:40:19.761746 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580574ed-95f1-4aa5-ba14-35aa499f12c3 None None] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:40:19.762597 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580574ed-95f1-4aa5-ba14-35aa499f12c3 None None] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:40:19.762597 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580574ed-95f1-4aa5-ba14-35aa499f12c3 None None] PATH_INFO: `/` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:40:19.764964 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 496/1009] 10.222.0.42 () {54 vars in 927 bytes} [Sun Oct 30 00:40:19 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:40:19.770534 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2d5326-52b4-4b1c-b1a3-833816acdb8b None None] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:40:19.770982 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2d5326-52b4-4b1c-b1a3-833816acdb8b None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:40:19.771081 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2d5326-52b4-4b1c-b1a3-833816acdb8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:40:19.843927 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=100 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:40:19.847566 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.auth.core [None req-ce2d5326-52b4-4b1c-b1a3-833816acdb8b None None] MFA Rules not processed for user `eb55b6cbca4945abb21b0e49eb745e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=87956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:40:19.849553 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-ce2d5326-52b4-4b1c-b1a3-833816acdb8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:40:19.951366 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 514/1010] 10.222.0.42 () {58 vars in 1024 bytes} [Sun Oct 30 00:40:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:40:20.228353 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580574ed-95f1-4aa5-ba14-35aa499f12c3 None None] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:40:20.230795 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-580574ed-95f1-4aa5-ba14-35aa499f12c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:40:20.346467 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580574ed-95f1-4aa5-ba14-35aa499f12c3 None None] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:40:20.421337 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c55047-df95-4e85-a680-95d2fc1c0422 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5693f186c6ad4d9394f02ee3477cdcd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d2387fdf794d4eaef07bbcd7b39f2a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:40:20.421930 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c55047-df95-4e85-a680-95d2fc1c0422 service neutron] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:40:20.422204 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c55047-df95-4e85-a680-95d2fc1c0422 service neutron] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:40:20.422615 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c55047-df95-4e85-a680-95d2fc1c0422 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:40:20.424238 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-e7c55047-df95-4e85-a680-95d2fc1c0422 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:40:20.450779 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=100 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:40:20.534087 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c55047-df95-4e85-a680-95d2fc1c0422 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:40:20.535518 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c55047-df95-4e85-a680-95d2fc1c0422 service neutron] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:40:20.555442 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 497/1011] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 30 00:40:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 00:40:22.719737 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8e2879-65d4-4361-9691-6670a80778da None None] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:40:22.720351 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8e2879-65d4-4361-9691-6670a80778da None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:40:22.720351 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8e2879-65d4-4361-9691-6670a80778da None None] PATH_INFO: `/` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:40:22.721684 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 515/1012] 10.222.0.42 () {54 vars in 927 bytes} [Sun Oct 30 00:40:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:40:22.728105 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e51d09b-644d-4eba-b84f-5debb3a409c0 None None] REQUEST_METHOD: `POST` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:40:22.728835 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e51d09b-644d-4eba-b84f-5debb3a409c0 None None] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:40:22.728984 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e51d09b-644d-4eba-b84f-5debb3a409c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:40:22.797717 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.auth.core [None req-2e51d09b-644d-4eba-b84f-5debb3a409c0 None None] MFA Rules not processed for user `eb55b6cbca4945abb21b0e49eb745e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=87955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:40:22.798952 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-2e51d09b-644d-4eba-b84f-5debb3a409c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:40:22.875171 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=100 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:40:22.904616 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 498/1013] 10.222.0.42 () {58 vars in 1024 bytes} [Sun Oct 30 00:40:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:40:23.185872 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8e2879-65d4-4361-9691-6670a80778da None None] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:40:23.188396 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-de8e2879-65d4-4361-9691-6670a80778da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:40:23.312007 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8e2879-65d4-4361-9691-6670a80778da None None] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:40:23.348007 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=100 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:40:23.395603 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cca252f-1867-46c3-a872-86870218a9b7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5693f186c6ad4d9394f02ee3477cdcd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d2387fdf794d4eaef07bbcd7b39f2a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:40:23.396203 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cca252f-1867-46c3-a872-86870218a9b7 service neutron] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:40:23.396474 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cca252f-1867-46c3-a872-86870218a9b7 service neutron] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:40:23.396735 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cca252f-1867-46c3-a872-86870218a9b7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:40:23.398300 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-7cca252f-1867-46c3-a872-86870218a9b7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:40:23.509996 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cca252f-1867-46c3-a872-86870218a9b7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:40:23.511501 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cca252f-1867-46c3-a872-86870218a9b7 service neutron] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:40:23.530101 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 516/1014] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 30 00:40:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 00:40:25.996292 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb436fa-b38b-4bae-bcd9-9cbd45fffc1b None None] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:40:25.996871 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb436fa-b38b-4bae-bcd9-9cbd45fffc1b None None] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:40:25.996871 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb436fa-b38b-4bae-bcd9-9cbd45fffc1b None None] PATH_INFO: `/` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:40:25.998813 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 499/1015] 10.222.0.42 () {54 vars in 927 bytes} [Sun Oct 30 00:40:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:40:26.004055 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c0a1d1-e129-4123-8737-c4744a933d6d None None] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:40:26.004491 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c0a1d1-e129-4123-8737-c4744a933d6d None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:40:26.004582 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c0a1d1-e129-4123-8737-c4744a933d6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:40:26.077262 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.auth.core [None req-94c0a1d1-e129-4123-8737-c4744a933d6d None None] MFA Rules not processed for user `eb55b6cbca4945abb21b0e49eb745e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=87956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:40:26.078495 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-94c0a1d1-e129-4123-8737-c4744a933d6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:40:26.087187 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=100 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:40:26.185930 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 517/1016] 10.222.0.42 () {58 vars in 1024 bytes} [Sun Oct 30 00:40:26 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:40:26.467010 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb436fa-b38b-4bae-bcd9-9cbd45fffc1b None None] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:40:26.469411 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-bfb436fa-b38b-4bae-bcd9-9cbd45fffc1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:40:26.581005 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb436fa-b38b-4bae-bcd9-9cbd45fffc1b None None] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:40:26.664977 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be24b146-0ab1-48f5-860b-e258fc1e90bd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5693f186c6ad4d9394f02ee3477cdcd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d2387fdf794d4eaef07bbcd7b39f2a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:40:26.665572 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be24b146-0ab1-48f5-860b-e258fc1e90bd service neutron] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:40:26.665848 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be24b146-0ab1-48f5-860b-e258fc1e90bd service neutron] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:40:26.666115 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be24b146-0ab1-48f5-860b-e258fc1e90bd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:40:26.667743 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-be24b146-0ab1-48f5-860b-e258fc1e90bd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:40:26.707593 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=100 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:40:26.794069 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be24b146-0ab1-48f5-860b-e258fc1e90bd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:40:26.795575 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be24b146-0ab1-48f5-860b-e258fc1e90bd service neutron] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:40:26.815773 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 500/1017] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 30 00:40:26 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 00:40:30.904232 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90cb447-9968-4161-9af4-47934a517344 None None] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:40:30.904913 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90cb447-9968-4161-9af4-47934a517344 None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:40:30.904913 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90cb447-9968-4161-9af4-47934a517344 None None] PATH_INFO: `/` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:40:30.906095 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 518/1018] 10.222.0.42 () {54 vars in 927 bytes} [Sun Oct 30 00:40:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:40:30.911571 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68653dcc-7d4c-4a41-a151-10c22ee8888e None None] REQUEST_METHOD: `POST` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:40:30.912063 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68653dcc-7d4c-4a41-a151-10c22ee8888e None None] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:40:30.912063 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68653dcc-7d4c-4a41-a151-10c22ee8888e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:40:30.981404 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.auth.core [None req-68653dcc-7d4c-4a41-a151-10c22ee8888e None None] MFA Rules not processed for user `eb55b6cbca4945abb21b0e49eb745e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=87955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:40:30.982496 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-68653dcc-7d4c-4a41-a151-10c22ee8888e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:40:31.073119 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=100 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:40:31.085563 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 501/1019] 10.222.0.42 () {58 vars in 1024 bytes} [Sun Oct 30 00:40:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:40:31.367716 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90cb447-9968-4161-9af4-47934a517344 None None] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:40:31.369298 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-a90cb447-9968-4161-9af4-47934a517344 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:40:31.477150 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90cb447-9968-4161-9af4-47934a517344 None None] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:40:31.514513 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=100 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:40:31.551641 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1395c1b0-3a29-46a3-9b17-64e5f3bbb255 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5693f186c6ad4d9394f02ee3477cdcd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d2387fdf794d4eaef07bbcd7b39f2a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:40:31.552245 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1395c1b0-3a29-46a3-9b17-64e5f3bbb255 service neutron] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:40:31.552544 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1395c1b0-3a29-46a3-9b17-64e5f3bbb255 service neutron] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:40:31.552787 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1395c1b0-3a29-46a3-9b17-64e5f3bbb255 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:40:31.554372 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-1395c1b0-3a29-46a3-9b17-64e5f3bbb255 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:40:31.669196 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1395c1b0-3a29-46a3-9b17-64e5f3bbb255 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:40:31.670543 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1395c1b0-3a29-46a3-9b17-64e5f3bbb255 service neutron] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:40:31.688687 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 519/1020] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 30 00:40:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 00:40:34.467007 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bb8687-b16e-4c37-9b1d-cde69befca0e None None] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:40:34.467660 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bb8687-b16e-4c37-9b1d-cde69befca0e None None] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:40:34.467660 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bb8687-b16e-4c37-9b1d-cde69befca0e None None] PATH_INFO: `/` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:40:34.468929 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 502/1021] 10.222.0.42 () {54 vars in 927 bytes} [Sun Oct 30 00:40:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:40:34.474312 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d794f10c-0e21-4360-a9fd-f925e0639e29 None None] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:40:34.474761 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d794f10c-0e21-4360-a9fd-f925e0639e29 None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:40:34.474853 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d794f10c-0e21-4360-a9fd-f925e0639e29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:40:34.541523 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.auth.core [None req-d794f10c-0e21-4360-a9fd-f925e0639e29 None None] MFA Rules not processed for user `eb55b6cbca4945abb21b0e49eb745e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=87956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:40:34.542744 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-d794f10c-0e21-4360-a9fd-f925e0639e29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:40:34.561481 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=100 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:40:34.653046 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 520/1022] 10.222.0.42 () {58 vars in 1024 bytes} [Sun Oct 30 00:40:34 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:40:34.933195 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bb8687-b16e-4c37-9b1d-cde69befca0e None None] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:40:34.934799 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-b6bb8687-b16e-4c37-9b1d-cde69befca0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:40:35.046624 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bb8687-b16e-4c37-9b1d-cde69befca0e None None] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:40:35.127808 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d3c896-96eb-4fd7-a640-e9332f8a7110 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5693f186c6ad4d9394f02ee3477cdcd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d2387fdf794d4eaef07bbcd7b39f2a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:40:35.128327 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d3c896-96eb-4fd7-a640-e9332f8a7110 service neutron] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:40:35.128599 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d3c896-96eb-4fd7-a640-e9332f8a7110 service neutron] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:40:35.128864 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d3c896-96eb-4fd7-a640-e9332f8a7110 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:40:35.130449 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-73d3c896-96eb-4fd7-a640-e9332f8a7110 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:40:35.176794 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=100 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:40:35.249176 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d3c896-96eb-4fd7-a640-e9332f8a7110 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:40:35.250616 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d3c896-96eb-4fd7-a640-e9332f8a7110 service neutron] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:40:35.269515 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 503/1023] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 30 00:40:34 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 00:40:39.385814 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decccb10-1a05-46ec-9688-913b1a4ffad8 None None] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:40:39.386345 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decccb10-1a05-46ec-9688-913b1a4ffad8 None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:40:39.386345 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decccb10-1a05-46ec-9688-913b1a4ffad8 None None] PATH_INFO: `/` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:40:39.387824 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 521/1024] 10.222.0.42 () {54 vars in 927 bytes} [Sun Oct 30 00:40:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:40:39.393187 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5d6095-2c4f-4a20-8951-cad9e8a006c6 None None] REQUEST_METHOD: `POST` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:40:39.393622 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5d6095-2c4f-4a20-8951-cad9e8a006c6 None None] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:40:39.393733 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5d6095-2c4f-4a20-8951-cad9e8a006c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:40:39.465038 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.auth.core [None req-7a5d6095-2c4f-4a20-8951-cad9e8a006c6 None None] MFA Rules not processed for user `eb55b6cbca4945abb21b0e49eb745e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=87955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:40:39.466284 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-7a5d6095-2c4f-4a20-8951-cad9e8a006c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:40:39.565596 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=100 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:40:39.567895 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 504/1025] 10.222.0.42 () {58 vars in 1024 bytes} [Sun Oct 30 00:40:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:40:39.864139 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decccb10-1a05-46ec-9688-913b1a4ffad8 None None] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:40:39.866569 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-decccb10-1a05-46ec-9688-913b1a4ffad8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:40:39.982899 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decccb10-1a05-46ec-9688-913b1a4ffad8 None None] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:40:40.035623 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=100 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:40:40.064878 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9a12b2-9e94-4052-af44-376f4dcde3f0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5693f186c6ad4d9394f02ee3477cdcd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d2387fdf794d4eaef07bbcd7b39f2a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:40:40.065500 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9a12b2-9e94-4052-af44-376f4dcde3f0 service neutron] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:40:40.065784 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9a12b2-9e94-4052-af44-376f4dcde3f0 service neutron] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:40:40.066057 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9a12b2-9e94-4052-af44-376f4dcde3f0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:40:40.067746 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-db9a12b2-9e94-4052-af44-376f4dcde3f0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:40:40.179616 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9a12b2-9e94-4052-af44-376f4dcde3f0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:40:40.181062 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9a12b2-9e94-4052-af44-376f4dcde3f0 service neutron] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:40:40.199859 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 522/1026] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 30 00:40:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 00:40:45.105159 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d82e6ce-f91e-41cf-8525-b75c5ed9b58d None None] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:40:45.105581 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d82e6ce-f91e-41cf-8525-b75c5ed9b58d None None] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:40:45.105715 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d82e6ce-f91e-41cf-8525-b75c5ed9b58d None None] PATH_INFO: `/` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:40:45.107500 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 505/1027] 10.222.0.42 () {54 vars in 921 bytes} [Sun Oct 30 00:40:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:40:45.112288 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4eec166-543f-434b-8d71-0ac68c809358 None None] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:40:45.112695 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4eec166-543f-434b-8d71-0ac68c809358 None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:40:45.112771 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4eec166-543f-434b-8d71-0ac68c809358 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:40:45.248109 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.auth.core [None req-c4eec166-543f-434b-8d71-0ac68c809358 None None] MFA Rules not processed for user `202b8b2c0f454297bfb97c1ac4033625`. Rule list: `[]` (Enabled: `True`). {{(pid=87956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:40:45.249323 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-c4eec166-543f-434b-8d71-0ac68c809358 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:40:45.271447 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=100 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:40:45.371242 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 523/1028] 10.222.0.42 () {58 vars in 1018 bytes} [Sun Oct 30 00:40:45 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:40:49.511091 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5277ec72-f2c8-4d01-837c-bc10c9f512c4 None None] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:40:49.512007 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5277ec72-f2c8-4d01-837c-bc10c9f512c4 None None] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:40:49.512285 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5277ec72-f2c8-4d01-837c-bc10c9f512c4 None None] PATH_INFO: `/` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:40:49.514067 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 506/1029] 10.222.0.42 () {54 vars in 921 bytes} [Sun Oct 30 00:40:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:40:49.518904 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5681f416-5f80-4dd8-82f0-e38f269e6335 None None] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:40:49.519485 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5681f416-5f80-4dd8-82f0-e38f269e6335 None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:40:49.519571 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5681f416-5f80-4dd8-82f0-e38f269e6335 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:40:49.601955 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.auth.core [None req-5681f416-5f80-4dd8-82f0-e38f269e6335 None None] MFA Rules not processed for user `202b8b2c0f454297bfb97c1ac4033625`. Rule list: `[]` (Enabled: `True`). {{(pid=87956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:40:49.603243 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-5681f416-5f80-4dd8-82f0-e38f269e6335 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:40:49.678530 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=100 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:40:49.722972 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 524/1030] 10.222.0.42 () {58 vars in 1018 bytes} [Sun Oct 30 00:40:49 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:40:50.991915 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958206bb-483f-43ef-8fa7-3a00a5c20112 None None] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:40:50.992451 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958206bb-483f-43ef-8fa7-3a00a5c20112 None None] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:40:50.992451 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958206bb-483f-43ef-8fa7-3a00a5c20112 None None] PATH_INFO: `/` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:40:50.993807 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 507/1031] 10.222.0.42 () {54 vars in 921 bytes} [Sun Oct 30 00:40:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:40:50.998851 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4cb31e-ad6e-490c-938d-3377c8dac3fd None None] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:40:50.999315 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4cb31e-ad6e-490c-938d-3377c8dac3fd None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:40:50.999736 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4cb31e-ad6e-490c-938d-3377c8dac3fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:40:51.082564 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.auth.core [None req-5e4cb31e-ad6e-490c-938d-3377c8dac3fd None None] MFA Rules not processed for user `202b8b2c0f454297bfb97c1ac4033625`. Rule list: `[]` (Enabled: `True`). {{(pid=87956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:40:51.083906 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-5e4cb31e-ad6e-490c-938d-3377c8dac3fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:40:51.195438 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 525/1032] 10.222.0.42 () {58 vars in 1018 bytes} [Sun Oct 30 00:40:50 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:40:54.763748 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457e5fc2-4a06-49fb-8253-95b302ce8334 None None] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:40:54.764288 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457e5fc2-4a06-49fb-8253-95b302ce8334 None None] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:40:54.764288 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457e5fc2-4a06-49fb-8253-95b302ce8334 None None] PATH_INFO: `/` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:40:54.765841 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 508/1033] 10.222.0.42 () {54 vars in 927 bytes} [Sun Oct 30 00:40:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:40:54.771705 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94955745-7396-4c74-b5c3-6ffbc3ccd645 None None] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:40:54.772165 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94955745-7396-4c74-b5c3-6ffbc3ccd645 None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:40:54.772258 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94955745-7396-4c74-b5c3-6ffbc3ccd645 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:40:54.813333 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=100 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:40:54.845507 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.auth.core [None req-94955745-7396-4c74-b5c3-6ffbc3ccd645 None None] MFA Rules not processed for user `eb55b6cbca4945abb21b0e49eb745e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=87956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:40:54.846799 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-94955745-7396-4c74-b5c3-6ffbc3ccd645 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:40:54.947599 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 526/1034] 10.222.0.42 () {58 vars in 1024 bytes} [Sun Oct 30 00:40:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:40:55.270086 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739caf06-308c-4c27-baf7-1a46a86fc5ae None None] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:40:55.271080 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739caf06-308c-4c27-baf7-1a46a86fc5ae None None] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:40:55.271663 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739caf06-308c-4c27-baf7-1a46a86fc5ae None None] PATH_INFO: `/` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:40:55.273660 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 509/1035] 10.222.0.42 () {54 vars in 961 bytes} [Sun Oct 30 00:40:55 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:40:55.282132 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99964f5-6339-4336-91a1-f929af9be409 None None] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:40:55.282571 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99964f5-6339-4336-91a1-f929af9be409 None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:40:55.282844 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99964f5-6339-4336-91a1-f929af9be409 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:40:55.365588 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.auth.core [None req-c99964f5-6339-4336-91a1-f929af9be409 None None] MFA Rules not processed for user `fde877b6ddc74f4a87baf21471eb31d2`. Rule list: `[]` (Enabled: `True`). {{(pid=87956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:40:55.366813 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-c99964f5-6339-4336-91a1-f929af9be409 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:40:55.418946 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=100 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:40:55.488830 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 527/1036] 10.222.0.42 () {58 vars in 1058 bytes} [Sun Oct 30 00:40:55 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:40:55.496410 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739caf06-308c-4c27-baf7-1a46a86fc5ae None None] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:40:55.497942 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-739caf06-308c-4c27-baf7-1a46a86fc5ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:40:55.653305 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739caf06-308c-4c27-baf7-1a46a86fc5ae None None] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:40:55.729412 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=100 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:40:55.772089 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77f269e-f421-4c89-a37e-c3a6c10ac1c2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fde877b6ddc74f4a87baf21471eb31d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d2387fdf794d4eaef07bbcd7b39f2a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:40:55.772089 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77f269e-f421-4c89-a37e-c3a6c10ac1c2 service nova] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:40:55.772089 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77f269e-f421-4c89-a37e-c3a6c10ac1c2 service nova] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:40:55.772089 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77f269e-f421-4c89-a37e-c3a6c10ac1c2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:40:55.773577 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-f77f269e-f421-4c89-a37e-c3a6c10ac1c2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:40:55.878041 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77f269e-f421-4c89-a37e-c3a6c10ac1c2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:40:55.879733 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77f269e-f421-4c89-a37e-c3a6c10ac1c2 service nova] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:40:55.899015 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 510/1037] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 30 00:40:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 00:40:58.276949 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa08196a-6daa-4797-8c04-1596dbd69a73 None None] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:40:58.277581 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa08196a-6daa-4797-8c04-1596dbd69a73 None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:40:58.277581 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa08196a-6daa-4797-8c04-1596dbd69a73 None None] PATH_INFO: `/` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:40:58.286157 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7413ff6c-34d1-4671-a0dc-90cf42a12aee None None] REQUEST_METHOD: `POST` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:40:58.286777 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7413ff6c-34d1-4671-a0dc-90cf42a12aee None None] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:40:58.286777 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7413ff6c-34d1-4671-a0dc-90cf42a12aee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:40:58.289138 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 528/1038] 10.222.0.42 () {54 vars in 927 bytes} [Sun Oct 30 00:40:58 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:40:58.364013 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.auth.core [None req-7413ff6c-34d1-4671-a0dc-90cf42a12aee None None] MFA Rules not processed for user `eb55b6cbca4945abb21b0e49eb745e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=87955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:40:58.365409 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-7413ff6c-34d1-4671-a0dc-90cf42a12aee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:40:58.405062 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=100 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:40:58.471505 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 511/1039] 10.222.0.42 () {58 vars in 1024 bytes} [Sun Oct 30 00:40:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:40:58.757890 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa08196a-6daa-4797-8c04-1596dbd69a73 None None] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:40:58.759439 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-fa08196a-6daa-4797-8c04-1596dbd69a73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:40:58.937889 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa08196a-6daa-4797-8c04-1596dbd69a73 None None] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:40:58.949264 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=100 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:40:59.073499 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b06300-6b29-4cb4-9b86-965580d60ca5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fde877b6ddc74f4a87baf21471eb31d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d2387fdf794d4eaef07bbcd7b39f2a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:40:59.074117 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b06300-6b29-4cb4-9b86-965580d60ca5 service nova] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:40:59.074398 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b06300-6b29-4cb4-9b86-965580d60ca5 service nova] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:40:59.074669 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b06300-6b29-4cb4-9b86-965580d60ca5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:40:59.076769 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-31b06300-6b29-4cb4-9b86-965580d60ca5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:40:59.168013 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b06300-6b29-4cb4-9b86-965580d60ca5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:40:59.169652 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b06300-6b29-4cb4-9b86-965580d60ca5 service nova] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:40:59.188950 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 529/1040] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 30 00:40:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 431 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 00:41:01.668682 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2791efa5-5198-474c-b758-6b271db638bc None None] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:41:01.669221 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2791efa5-5198-474c-b758-6b271db638bc None None] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:41:01.669221 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2791efa5-5198-474c-b758-6b271db638bc None None] PATH_INFO: `/` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:41:01.670799 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 512/1041] 10.222.0.42 () {54 vars in 927 bytes} [Sun Oct 30 00:41:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:41:01.676435 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e541a1d-77c8-469a-8204-573096b92795 None None] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:41:01.677523 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e541a1d-77c8-469a-8204-573096b92795 None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:41:01.678071 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e541a1d-77c8-469a-8204-573096b92795 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:41:01.696229 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=100 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:41:01.758626 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.auth.core [None req-7e541a1d-77c8-469a-8204-573096b92795 None None] MFA Rules not processed for user `eb55b6cbca4945abb21b0e49eb745e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=87956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:41:01.760042 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-7e541a1d-77c8-469a-8204-573096b92795 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:41:01.877549 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 530/1042] 10.222.0.42 () {58 vars in 1024 bytes} [Sun Oct 30 00:41:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:41:02.156111 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f5e60c-1b61-4a84-98cc-094a1f1e840b None None] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:41:02.156389 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f5e60c-1b61-4a84-98cc-094a1f1e840b None None] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:41:02.156658 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f5e60c-1b61-4a84-98cc-094a1f1e840b None None] PATH_INFO: `/` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:41:02.158133 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 513/1043] 10.222.0.42 () {54 vars in 961 bytes} [Sun Oct 30 00:41:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:41:02.163656 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dddf061-ecc3-4099-97e8-f704c1ff28d6 None None] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:41:02.164028 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dddf061-ecc3-4099-97e8-f704c1ff28d6 None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:41:02.164390 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dddf061-ecc3-4099-97e8-f704c1ff28d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:41:02.245800 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.auth.core [None req-6dddf061-ecc3-4099-97e8-f704c1ff28d6 None None] MFA Rules not processed for user `fde877b6ddc74f4a87baf21471eb31d2`. Rule list: `[]` (Enabled: `True`). {{(pid=87956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:41:02.246947 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-6dddf061-ecc3-4099-97e8-f704c1ff28d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:41:02.285057 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=100 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:41:02.371894 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 531/1044] 10.222.0.42 () {58 vars in 1058 bytes} [Sun Oct 30 00:41:02 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:41:02.380494 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f5e60c-1b61-4a84-98cc-094a1f1e840b None None] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:41:02.382176 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-a0f5e60c-1b61-4a84-98cc-094a1f1e840b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:41:02.533945 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f5e60c-1b61-4a84-98cc-094a1f1e840b None None] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:41:02.554944 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=100 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:41:02.654533 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9491925-8d23-43b6-9269-bb88526a2d01 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fde877b6ddc74f4a87baf21471eb31d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d2387fdf794d4eaef07bbcd7b39f2a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:41:02.655415 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9491925-8d23-43b6-9269-bb88526a2d01 service nova] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:41:02.655785 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9491925-8d23-43b6-9269-bb88526a2d01 service nova] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:41:02.656167 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9491925-8d23-43b6-9269-bb88526a2d01 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:41:02.657841 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-e9491925-8d23-43b6-9269-bb88526a2d01 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:41:02.757902 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9491925-8d23-43b6-9269-bb88526a2d01 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:41:02.759552 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9491925-8d23-43b6-9269-bb88526a2d01 service nova] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:41:02.778619 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 514/1045] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 30 00:41:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 00:41:02.819922 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c0693c-c92a-4595-baf5-e84875f0d7e2 None None] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:41:02.820522 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c0693c-c92a-4595-baf5-e84875f0d7e2 None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:41:02.820522 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c0693c-c92a-4595-baf5-e84875f0d7e2 None None] PATH_INFO: `/` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:41:02.821989 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 532/1046] 10.222.0.42 () {54 vars in 927 bytes} [Sun Oct 30 00:41:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:41:02.827838 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c1b8d1-8a8b-4301-97ea-2aff3799c4da None None] REQUEST_METHOD: `POST` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:41:02.828214 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c1b8d1-8a8b-4301-97ea-2aff3799c4da None None] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:41:02.828582 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c1b8d1-8a8b-4301-97ea-2aff3799c4da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:41:02.864179 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=100 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:41:02.906547 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.auth.core [None req-24c1b8d1-8a8b-4301-97ea-2aff3799c4da None None] MFA Rules not processed for user `eb55b6cbca4945abb21b0e49eb745e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=87955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:41:02.907822 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-24c1b8d1-8a8b-4301-97ea-2aff3799c4da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:41:03.025906 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 515/1047] 10.222.0.42 () {58 vars in 1024 bytes} [Sun Oct 30 00:41:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:41:03.353705 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da46d96-448b-4732-8593-b8d50df0ce7c None None] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:41:03.353705 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da46d96-448b-4732-8593-b8d50df0ce7c None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:41:03.353952 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da46d96-448b-4732-8593-b8d50df0ce7c None None] PATH_INFO: `/` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:41:03.355733 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 533/1048] 10.222.0.42 () {54 vars in 963 bytes} [Sun Oct 30 00:41:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:41:03.360439 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b57d81f-3540-4eb2-8156-569423e8cd2d None None] REQUEST_METHOD: `POST` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:41:03.360716 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b57d81f-3540-4eb2-8156-569423e8cd2d None None] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:41:03.360984 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b57d81f-3540-4eb2-8156-569423e8cd2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:41:03.439254 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.auth.core [None req-5b57d81f-3540-4eb2-8156-569423e8cd2d None None] MFA Rules not processed for user `48d928ff7fe24348ac900f09c56acc20`. Rule list: `[]` (Enabled: `True`). {{(pid=87955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:41:03.440732 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-5b57d81f-3540-4eb2-8156-569423e8cd2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:41:03.494159 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=100 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:41:03.526801 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 516/1049] 10.222.0.42 () {58 vars in 1060 bytes} [Sun Oct 30 00:41:03 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:41:03.534737 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da46d96-448b-4732-8593-b8d50df0ce7c None None] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:41:03.536344 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-5da46d96-448b-4732-8593-b8d50df0ce7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:41:03.649792 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da46d96-448b-4732-8593-b8d50df0ce7c None None] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:41:03.690831 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=100 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:41:03.732812 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d828a3-eb85-430d-8e65-9e2eb773fc69 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48d928ff7fe24348ac900f09c56acc20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d2387fdf794d4eaef07bbcd7b39f2a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:41:03.733503 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d828a3-eb85-430d-8e65-9e2eb773fc69 service cinder] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:41:03.733858 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d828a3-eb85-430d-8e65-9e2eb773fc69 service cinder] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:41:03.734223 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d828a3-eb85-430d-8e65-9e2eb773fc69 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:41:03.735938 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-61d828a3-eb85-430d-8e65-9e2eb773fc69 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:41:03.868851 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d828a3-eb85-430d-8e65-9e2eb773fc69 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:41:03.870644 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d828a3-eb85-430d-8e65-9e2eb773fc69 service cinder] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:41:03.895587 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 534/1050] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 30 00:41:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 00:41:05.034281 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09421f19-9c1c-4fb7-8b12-bc07b28099a4 None None] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:41:05.034882 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09421f19-9c1c-4fb7-8b12-bc07b28099a4 None None] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:41:05.034882 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09421f19-9c1c-4fb7-8b12-bc07b28099a4 None None] PATH_INFO: `/` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:41:05.036242 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 517/1051] 10.222.0.42 () {54 vars in 927 bytes} [Sun Oct 30 00:41:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:41:05.041832 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6eeeec-b4ea-449c-b430-fc60b0f50994 None None] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:41:05.042236 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6eeeec-b4ea-449c-b430-fc60b0f50994 None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:41:05.042509 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6eeeec-b4ea-449c-b430-fc60b0f50994 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:41:05.112084 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.auth.core [None req-1f6eeeec-b4ea-449c-b430-fc60b0f50994 None None] MFA Rules not processed for user `eb55b6cbca4945abb21b0e49eb745e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=87956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:41:05.113337 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-1f6eeeec-b4ea-449c-b430-fc60b0f50994 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:41:05.134832 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=100 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:41:05.216019 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 535/1052] 10.222.0.42 () {58 vars in 1024 bytes} [Sun Oct 30 00:41:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:41:05.507129 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09421f19-9c1c-4fb7-8b12-bc07b28099a4 None None] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:41:05.508734 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-09421f19-9c1c-4fb7-8b12-bc07b28099a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:41:05.662354 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09421f19-9c1c-4fb7-8b12-bc07b28099a4 None None] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:41:05.718930 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=100 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:41:05.780942 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5434b41-35ca-42f0-bd45-e9a0db164a15 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fde877b6ddc74f4a87baf21471eb31d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d2387fdf794d4eaef07bbcd7b39f2a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:41:05.781548 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5434b41-35ca-42f0-bd45-e9a0db164a15 service nova] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:41:05.781815 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5434b41-35ca-42f0-bd45-e9a0db164a15 service nova] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:41:05.782078 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5434b41-35ca-42f0-bd45-e9a0db164a15 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:41:05.783677 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-e5434b41-35ca-42f0-bd45-e9a0db164a15 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:41:05.875894 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5434b41-35ca-42f0-bd45-e9a0db164a15 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:41:05.877471 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5434b41-35ca-42f0-bd45-e9a0db164a15 service nova] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:41:05.897069 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 518/1053] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 30 00:41:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 00:41:08.124657 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a680e7b4-2c8f-422f-87f8-803c1c807af2 None None] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:41:08.125215 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a680e7b4-2c8f-422f-87f8-803c1c807af2 None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:41:08.125215 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a680e7b4-2c8f-422f-87f8-803c1c807af2 None None] PATH_INFO: `/` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:41:08.126738 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 536/1054] 10.222.0.42 () {54 vars in 927 bytes} [Sun Oct 30 00:41:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:41:08.132025 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567f3cc6-8426-45b5-a8e1-d351e1f7c879 None None] REQUEST_METHOD: `POST` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:41:08.132464 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567f3cc6-8426-45b5-a8e1-d351e1f7c879 None None] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:41:08.132546 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567f3cc6-8426-45b5-a8e1-d351e1f7c879 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:41:08.202310 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.auth.core [None req-567f3cc6-8426-45b5-a8e1-d351e1f7c879 None None] MFA Rules not processed for user `eb55b6cbca4945abb21b0e49eb745e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=87955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:41:08.203677 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-567f3cc6-8426-45b5-a8e1-d351e1f7c879 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:41:08.211331 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=100 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:41:08.307046 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 519/1055] 10.222.0.42 () {58 vars in 1024 bytes} [Sun Oct 30 00:41:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:41:08.590873 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a680e7b4-2c8f-422f-87f8-803c1c807af2 None None] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:41:08.592927 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-a680e7b4-2c8f-422f-87f8-803c1c807af2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:41:08.752341 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a680e7b4-2c8f-422f-87f8-803c1c807af2 None None] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:41:08.757056 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=100 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:41:08.878723 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b43e9d8-afdd-46eb-b393-1cd88845e399 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fde877b6ddc74f4a87baf21471eb31d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d2387fdf794d4eaef07bbcd7b39f2a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:41:08.879442 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b43e9d8-afdd-46eb-b393-1cd88845e399 service nova] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:41:08.879811 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b43e9d8-afdd-46eb-b393-1cd88845e399 service nova] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:41:08.880182 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b43e9d8-afdd-46eb-b393-1cd88845e399 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:41:08.881899 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-3b43e9d8-afdd-46eb-b393-1cd88845e399 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:41:08.980079 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b43e9d8-afdd-46eb-b393-1cd88845e399 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:41:08.981738 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b43e9d8-afdd-46eb-b393-1cd88845e399 service nova] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:41:09.000535 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 537/1056] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 30 00:41:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 00:41:11.208085 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc32a4a8-2b67-4222-b22c-69056aa770df None None] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:41:11.208753 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc32a4a8-2b67-4222-b22c-69056aa770df None None] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:41:11.208753 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc32a4a8-2b67-4222-b22c-69056aa770df None None] PATH_INFO: `/` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:41:11.217024 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 520/1057] 10.222.0.42 () {54 vars in 927 bytes} [Sun Oct 30 00:41:11 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:41:11.217330 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcf71ac-bf22-4c18-95ed-0ee73f7049a9 None None] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:41:11.217330 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcf71ac-bf22-4c18-95ed-0ee73f7049a9 None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:41:11.217330 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcf71ac-bf22-4c18-95ed-0ee73f7049a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:41:11.232369 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=100 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:41:11.311742 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.auth.core [None req-dfcf71ac-bf22-4c18-95ed-0ee73f7049a9 None None] MFA Rules not processed for user `eb55b6cbca4945abb21b0e49eb745e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=87956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:41:11.312970 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-dfcf71ac-bf22-4c18-95ed-0ee73f7049a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:41:11.411822 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 538/1058] 10.222.0.42 () {58 vars in 1024 bytes} [Sun Oct 30 00:41:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:41:11.695292 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc32a4a8-2b67-4222-b22c-69056aa770df None None] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:41:11.697530 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-cc32a4a8-2b67-4222-b22c-69056aa770df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:41:11.848810 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=100 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:41:11.859654 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc32a4a8-2b67-4222-b22c-69056aa770df None None] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:41:11.975046 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479d013c-9271-401c-90ee-00f79e5c1d77 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fde877b6ddc74f4a87baf21471eb31d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d2387fdf794d4eaef07bbcd7b39f2a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:41:11.975678 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479d013c-9271-401c-90ee-00f79e5c1d77 service nova] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:41:11.975952 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479d013c-9271-401c-90ee-00f79e5c1d77 service nova] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:41:11.976215 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479d013c-9271-401c-90ee-00f79e5c1d77 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:41:11.977789 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-479d013c-9271-401c-90ee-00f79e5c1d77 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:41:12.073501 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479d013c-9271-401c-90ee-00f79e5c1d77 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:41:12.075118 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479d013c-9271-401c-90ee-00f79e5c1d77 service nova] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:41:12.086024 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=100 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:41:12.094784 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 521/1059] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 30 00:41:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 00:41:14.233942 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2aa9a1c-ad75-4582-b275-1dece0a1caf9 None None] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:41:14.234479 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2aa9a1c-ad75-4582-b275-1dece0a1caf9 None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:41:14.234479 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2aa9a1c-ad75-4582-b275-1dece0a1caf9 None None] PATH_INFO: `/` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:41:14.235773 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 539/1060] 10.222.0.42 () {54 vars in 927 bytes} [Sun Oct 30 00:41:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:41:14.241320 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2695784c-ee2d-43d9-98b6-689f6faa5336 None None] REQUEST_METHOD: `POST` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:41:14.241758 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2695784c-ee2d-43d9-98b6-689f6faa5336 None None] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:41:14.241990 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2695784c-ee2d-43d9-98b6-689f6faa5336 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:41:14.316407 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.auth.core [None req-2695784c-ee2d-43d9-98b6-689f6faa5336 None None] MFA Rules not processed for user `eb55b6cbca4945abb21b0e49eb745e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=87955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:41:14.317728 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-2695784c-ee2d-43d9-98b6-689f6faa5336 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:41:14.420043 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 522/1061] 10.222.0.42 () {58 vars in 1024 bytes} [Sun Oct 30 00:41:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:41:14.703140 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2aa9a1c-ad75-4582-b275-1dece0a1caf9 None None] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:41:14.704746 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-b2aa9a1c-ad75-4582-b275-1dece0a1caf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:41:14.790662 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=100 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:41:14.861152 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2aa9a1c-ad75-4582-b275-1dece0a1caf9 None None] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:41:14.977027 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28503070-7120-42e8-91b0-f073dfc74583 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fde877b6ddc74f4a87baf21471eb31d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d2387fdf794d4eaef07bbcd7b39f2a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:41:14.977659 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28503070-7120-42e8-91b0-f073dfc74583 service nova] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:41:14.978032 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28503070-7120-42e8-91b0-f073dfc74583 service nova] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:41:14.978369 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28503070-7120-42e8-91b0-f073dfc74583 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:41:14.980367 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-28503070-7120-42e8-91b0-f073dfc74583 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:41:15.042083 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=100 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:41:15.084610 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28503070-7120-42e8-91b0-f073dfc74583 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:41:15.086232 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28503070-7120-42e8-91b0-f073dfc74583 service nova] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:41:15.104037 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 540/1062] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 30 00:41:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 00:41:17.220782 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83380cb1-1b76-47b9-9ad2-6f561ff9314c None None] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:41:17.221317 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83380cb1-1b76-47b9-9ad2-6f561ff9314c None None] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:41:17.221749 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83380cb1-1b76-47b9-9ad2-6f561ff9314c None None] PATH_INFO: `/` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:41:17.223637 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 523/1063] 10.222.0.42 () {54 vars in 927 bytes} [Sun Oct 30 00:41:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:41:17.230225 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf76353-e200-49ad-a4d1-9fbc30574d4d None None] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:41:17.230656 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf76353-e200-49ad-a4d1-9fbc30574d4d None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:41:17.230748 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf76353-e200-49ad-a4d1-9fbc30574d4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:41:17.297874 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.auth.core [None req-5bf76353-e200-49ad-a4d1-9fbc30574d4d None None] MFA Rules not processed for user `eb55b6cbca4945abb21b0e49eb745e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=87956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:41:17.299094 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-5bf76353-e200-49ad-a4d1-9fbc30574d4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:41:17.404765 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 541/1064] 10.222.0.42 () {58 vars in 1024 bytes} [Sun Oct 30 00:41:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:41:17.783462 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83380cb1-1b76-47b9-9ad2-6f561ff9314c None None] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:41:17.785405 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-83380cb1-1b76-47b9-9ad2-6f561ff9314c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:41:17.873396 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=100 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:41:17.957473 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83380cb1-1b76-47b9-9ad2-6f561ff9314c None None] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:41:18.105986 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c18ca7-246f-44d4-bb0c-b63cfa7fedb2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fde877b6ddc74f4a87baf21471eb31d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d2387fdf794d4eaef07bbcd7b39f2a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:41:18.106608 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c18ca7-246f-44d4-bb0c-b63cfa7fedb2 service nova] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:41:18.106882 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c18ca7-246f-44d4-bb0c-b63cfa7fedb2 service nova] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:41:18.107149 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c18ca7-246f-44d4-bb0c-b63cfa7fedb2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:41:18.108826 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-98c18ca7-246f-44d4-bb0c-b63cfa7fedb2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:41:18.151829 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=100 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:41:18.217810 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c18ca7-246f-44d4-bb0c-b63cfa7fedb2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:41:18.219955 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c18ca7-246f-44d4-bb0c-b63cfa7fedb2 service nova] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:41:18.244061 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 524/1065] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 30 00:41:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 461 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 00:41:20.534619 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f78f83-0663-478a-9cea-493a2cdba6e2 None None] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:41:20.535275 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f78f83-0663-478a-9cea-493a2cdba6e2 None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:41:20.535275 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f78f83-0663-478a-9cea-493a2cdba6e2 None None] PATH_INFO: `/` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:41:20.536614 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 542/1066] 10.222.0.42 () {54 vars in 927 bytes} [Sun Oct 30 00:41:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:41:20.542334 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee1e391-f3b0-4abe-b9dc-b51583230c7c None None] REQUEST_METHOD: `POST` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:41:20.542790 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee1e391-f3b0-4abe-b9dc-b51583230c7c None None] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:41:20.542893 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee1e391-f3b0-4abe-b9dc-b51583230c7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:41:20.612287 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.auth.core [None req-1ee1e391-f3b0-4abe-b9dc-b51583230c7c None None] MFA Rules not processed for user `eb55b6cbca4945abb21b0e49eb745e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=87955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:41:20.613612 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-1ee1e391-f3b0-4abe-b9dc-b51583230c7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:41:20.710570 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 525/1067] 10.222.0.42 () {58 vars in 1024 bytes} [Sun Oct 30 00:41:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:41:20.997115 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f78f83-0663-478a-9cea-493a2cdba6e2 None None] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:41:20.998779 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-e0f78f83-0663-478a-9cea-493a2cdba6e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:41:21.031441 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=100 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:41:21.155331 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f78f83-0663-478a-9cea-493a2cdba6e2 None None] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:41:21.257667 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=100 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:41:21.269922 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2229870a-072a-44eb-946e-f5cec1f8ebf3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fde877b6ddc74f4a87baf21471eb31d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d2387fdf794d4eaef07bbcd7b39f2a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:41:21.270532 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2229870a-072a-44eb-946e-f5cec1f8ebf3 service nova] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:41:21.270800 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2229870a-072a-44eb-946e-f5cec1f8ebf3 service nova] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:41:21.271058 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2229870a-072a-44eb-946e-f5cec1f8ebf3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:41:21.272661 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-2229870a-072a-44eb-946e-f5cec1f8ebf3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:41:21.367453 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2229870a-072a-44eb-946e-f5cec1f8ebf3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:41:21.369035 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2229870a-072a-44eb-946e-f5cec1f8ebf3 service nova] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:41:21.387714 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 543/1068] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 30 00:41:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 00:41:22.575572 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63eb538-ac60-42d3-9ed2-f12d7d1b3e65 None None] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:41:22.576492 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63eb538-ac60-42d3-9ed2-f12d7d1b3e65 None None] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:41:22.576492 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63eb538-ac60-42d3-9ed2-f12d7d1b3e65 None None] PATH_INFO: `/` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:41:22.577807 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 526/1069] 10.222.0.42 () {54 vars in 927 bytes} [Sun Oct 30 00:41:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:41:22.583260 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c842bc-781d-48a8-ac92-86c09d50185e None None] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:41:22.583707 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c842bc-781d-48a8-ac92-86c09d50185e None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:41:22.583809 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c842bc-781d-48a8-ac92-86c09d50185e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:41:22.650259 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.auth.core [None req-c2c842bc-781d-48a8-ac92-86c09d50185e None None] MFA Rules not processed for user `eb55b6cbca4945abb21b0e49eb745e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=87956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:41:22.651492 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-c2c842bc-781d-48a8-ac92-86c09d50185e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:41:22.710477 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=100 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:41:22.748060 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 544/1070] 10.222.0.42 () {58 vars in 1024 bytes} [Sun Oct 30 00:41:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:41:23.043045 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37638674-49a3-4585-8de6-dabc205eef56 None None] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:41:23.043452 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37638674-49a3-4585-8de6-dabc205eef56 None None] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:41:23.043793 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37638674-49a3-4585-8de6-dabc205eef56 None None] PATH_INFO: `/` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:41:23.045288 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 527/1071] 10.222.0.42 () {54 vars in 962 bytes} [Sun Oct 30 00:41:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:41:23.050823 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f8a4c9-b609-4d45-9799-640b638b2ddc None None] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:41:23.051079 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f8a4c9-b609-4d45-9799-640b638b2ddc None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:41:23.051378 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f8a4c9-b609-4d45-9799-640b638b2ddc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:41:23.136139 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.auth.core [None req-23f8a4c9-b609-4d45-9799-640b638b2ddc None None] MFA Rules not processed for user `36a86cf3eaf24b369737b65046142593`. Rule list: `[]` (Enabled: `True`). {{(pid=87956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:41:23.137364 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-23f8a4c9-b609-4d45-9799-640b638b2ddc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:41:23.218216 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 545/1072] 10.222.0.42 () {58 vars in 1059 bytes} [Sun Oct 30 00:41:23 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:41:23.226015 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37638674-49a3-4585-8de6-dabc205eef56 None None] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:41:23.227779 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-37638674-49a3-4585-8de6-dabc205eef56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:41:23.242286 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=100 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:41:23.339296 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37638674-49a3-4585-8de6-dabc205eef56 None None] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:41:23.413630 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c6a9d7-bd7a-4c95-9140-ccd0eea9fc55 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36a86cf3eaf24b369737b65046142593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d2387fdf794d4eaef07bbcd7b39f2a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:41:23.414230 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c6a9d7-bd7a-4c95-9140-ccd0eea9fc55 service glance] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:41:23.414501 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c6a9d7-bd7a-4c95-9140-ccd0eea9fc55 service glance] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:41:23.414739 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c6a9d7-bd7a-4c95-9140-ccd0eea9fc55 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:41:23.416346 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-60c6a9d7-bd7a-4c95-9140-ccd0eea9fc55 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:41:23.490686 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=100 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:41:23.535021 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c6a9d7-bd7a-4c95-9140-ccd0eea9fc55 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:41:23.536499 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c6a9d7-bd7a-4c95-9140-ccd0eea9fc55 service glance] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:41:23.555675 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 528/1073] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 30 00:41:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 00:41:23.563223 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a1bbd7-84ef-4bd0-bc25-fc3392fa8de2 None None] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:41:23.563516 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a1bbd7-84ef-4bd0-bc25-fc3392fa8de2 None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:41:23.563787 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a1bbd7-84ef-4bd0-bc25-fc3392fa8de2 None None] PATH_INFO: `/` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:41:23.565277 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 546/1074] 10.222.0.42 () {54 vars in 927 bytes} [Sun Oct 30 00:41:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:41:23.570488 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfca064-2784-4b5b-858f-b60fe9471508 None None] REQUEST_METHOD: `POST` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:41:23.570769 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfca064-2784-4b5b-858f-b60fe9471508 None None] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:41:23.571060 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfca064-2784-4b5b-858f-b60fe9471508 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:41:23.638615 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.auth.core [None req-2dfca064-2784-4b5b-858f-b60fe9471508 None None] MFA Rules not processed for user `eb55b6cbca4945abb21b0e49eb745e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=87955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:41:23.639757 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-2dfca064-2784-4b5b-858f-b60fe9471508 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:41:23.736939 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 529/1075] 10.222.0.42 () {58 vars in 1024 bytes} [Sun Oct 30 00:41:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 30 00:41:24.025661 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a1bbd7-84ef-4bd0-bc25-fc3392fa8de2 None None] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:41:24.027178 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-b9a1bbd7-84ef-4bd0-bc25-fc3392fa8de2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:41:24.093990 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=100 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:41:24.190979 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a1bbd7-84ef-4bd0-bc25-fc3392fa8de2 None None] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:41:24.300416 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235f7990-dc93-47d0-a839-cf6ee1ffdb7c None None] REQUEST_METHOD: `POST` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:41:24.300773 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235f7990-dc93-47d0-a839-cf6ee1ffdb7c None None] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:41:24.301112 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235f7990-dc93-47d0-a839-cf6ee1ffdb7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:41:24.319094 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8663256b-5775-45f2-a4f8-90df3b62b049 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fde877b6ddc74f4a87baf21471eb31d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d2387fdf794d4eaef07bbcd7b39f2a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:41:24.319737 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8663256b-5775-45f2-a4f8-90df3b62b049 service nova] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:41:24.320014 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8663256b-5775-45f2-a4f8-90df3b62b049 service nova] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:41:24.320306 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8663256b-5775-45f2-a4f8-90df3b62b049 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:41:24.321913 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-8663256b-5775-45f2-a4f8-90df3b62b049 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:41:24.328225 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=100 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:41:24.345560 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=100 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:41:24.370524 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.auth.core [None req-235f7990-dc93-47d0-a839-cf6ee1ffdb7c None None] MFA Rules not processed for user `3e7b21b55fb84a6cad507a8954492d48`. Rule list: `[]` (Enabled: `True`). {{(pid=87955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:41:24.371777 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-235f7990-dc93-47d0-a839-cf6ee1ffdb7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:41:24.418085 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8663256b-5775-45f2-a4f8-90df3b62b049 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:41:24.419702 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8663256b-5775-45f2-a4f8-90df3b62b049 service nova] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:41:24.437863 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 547/1076] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 30 00:41:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 00:41:24.459788 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 530/1077] 10.222.0.42 () {58 vars in 1009 bytes} [Sun Oct 30 00:41:24 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 30 00:41:24.504351 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a028e138-03b3-4316-8edd-a6444f8412d7 None None] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:41:24.504642 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a028e138-03b3-4316-8edd-a6444f8412d7 None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:41:24.504914 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a028e138-03b3-4316-8edd-a6444f8412d7 None None] PATH_INFO: `/` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:41:24.506232 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 548/1078] 10.222.0.42 () {54 vars in 943 bytes} [Sun Oct 30 00:41:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:41:24.512767 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95de628c-af53-4c6c-a08c-0018e6835b05 None None] REQUEST_METHOD: `POST` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:41:24.513081 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95de628c-af53-4c6c-a08c-0018e6835b05 None None] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:41:24.513350 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95de628c-af53-4c6c-a08c-0018e6835b05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:41:24.603619 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.auth.core [None req-95de628c-af53-4c6c-a08c-0018e6835b05 None None] MFA Rules not processed for user `b6d6e884a8104a428e4de6be1cfa467c`. Rule list: `[]` (Enabled: `True`). {{(pid=87955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:41:24.604921 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-95de628c-af53-4c6c-a08c-0018e6835b05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:41:24.663070 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=100 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:41:24.718261 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 531/1079] 10.222.0.42 () {58 vars in 1040 bytes} [Sun Oct 30 00:41:24 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:41:24.727467 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a028e138-03b3-4316-8edd-a6444f8412d7 None None] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:41:24.728999 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-a028e138-03b3-4316-8edd-a6444f8412d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:41:24.870376 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a028e138-03b3-4316-8edd-a6444f8412d7 None None] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:41:24.883168 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=100 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:41:24.975506 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b76779a-d856-4bf3-882f-745d4ca14f5f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6d6e884a8104a428e4de6be1cfa467c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d2387fdf794d4eaef07bbcd7b39f2a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:41:24.976056 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b76779a-d856-4bf3-882f-745d4ca14f5f service swift] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:41:24.976327 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b76779a-d856-4bf3-882f-745d4ca14f5f service swift] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:41:24.976600 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b76779a-d856-4bf3-882f-745d4ca14f5f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:41:24.978211 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-7b76779a-d856-4bf3-882f-745d4ca14f5f service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:41:25.065802 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b76779a-d856-4bf3-882f-745d4ca14f5f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:41:25.067832 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b76779a-d856-4bf3-882f-745d4ca14f5f service swift] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:41:25.077053 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 549/1080] 10.222.0.42 () {60 vars in 1384 bytes} [Sun Oct 30 00:41:24 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 30 00:41:26.616748 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5eda9f5-d85d-4db2-a532-edb5e0f4a9d3 None None] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:41:26.617281 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5eda9f5-d85d-4db2-a532-edb5e0f4a9d3 None None] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:41:26.617281 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5eda9f5-d85d-4db2-a532-edb5e0f4a9d3 None None] PATH_INFO: `/` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:41:26.618621 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 532/1081] 10.222.0.42 () {54 vars in 927 bytes} [Sun Oct 30 00:41:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 30 00:41:26.624116 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce242978-da87-488c-942c-303c2687b733 None None] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:41:26.627134 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce242978-da87-488c-942c-303c2687b733 None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:41:26.627466 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce242978-da87-488c-942c-303c2687b733 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:41:26.684303 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=100 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:41:26.705919 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.auth.core [None req-ce242978-da87-488c-942c-303c2687b733 None None] MFA Rules not processed for user `eb55b6cbca4945abb21b0e49eb745e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=87956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:41:26.707483 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-ce242978-da87-488c-942c-303c2687b733 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:41:26.819372 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 550/1082] 10.222.0.42 () {58 vars in 1024 bytes} [Sun Oct 30 00:41:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:41:27.101398 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5eda9f5-d85d-4db2-a532-edb5e0f4a9d3 None None] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:41:27.102931 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-e5eda9f5-d85d-4db2-a532-edb5e0f4a9d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:41:27.262035 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5eda9f5-d85d-4db2-a532-edb5e0f4a9d3 None None] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:41:27.291477 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=100 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:41:27.394710 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cd7971-5cf6-4728-953e-da21402a3227 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fde877b6ddc74f4a87baf21471eb31d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d2387fdf794d4eaef07bbcd7b39f2a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:41:27.395921 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cd7971-5cf6-4728-953e-da21402a3227 service nova] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:41:27.396351 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cd7971-5cf6-4728-953e-da21402a3227 service nova] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:41:27.396751 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cd7971-5cf6-4728-953e-da21402a3227 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:41:27.398569 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-d3cd7971-5cf6-4728-953e-da21402a3227 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:41:27.498916 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3cd7971-5cf6-4728-953e-da21402a3227 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:41:27.500549 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3cd7971-5cf6-4728-953e-da21402a3227 service nova] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:41:27.519273 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 533/1083] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 30 00:41:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 00:41:29.759428 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075096ed-9ee8-4d77-b679-a981e686fec0 None None] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:41:29.760041 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075096ed-9ee8-4d77-b679-a981e686fec0 None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:41:29.760041 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075096ed-9ee8-4d77-b679-a981e686fec0 None None] PATH_INFO: `/` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:41:29.761470 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 551/1084] 10.222.0.42 () {54 vars in 927 bytes} [Sun Oct 30 00:41:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:41:29.766981 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0755c9-62cd-4475-a4fd-52037151a231 None None] REQUEST_METHOD: `POST` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:41:29.767660 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0755c9-62cd-4475-a4fd-52037151a231 None None] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:41:29.767941 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0755c9-62cd-4475-a4fd-52037151a231 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:41:29.810687 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=100 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:41:29.839701 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.auth.core [None req-8d0755c9-62cd-4475-a4fd-52037151a231 None None] MFA Rules not processed for user `eb55b6cbca4945abb21b0e49eb745e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=87955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:41:29.840929 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-8d0755c9-62cd-4475-a4fd-52037151a231 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:41:29.941603 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 534/1085] 10.222.0.42 () {58 vars in 1024 bytes} [Sun Oct 30 00:41:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:41:30.239483 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075096ed-9ee8-4d77-b679-a981e686fec0 None None] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:41:30.241349 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-075096ed-9ee8-4d77-b679-a981e686fec0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:41:30.373602 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=100 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:41:30.405223 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075096ed-9ee8-4d77-b679-a981e686fec0 None None] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:41:30.525790 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9607b9e0-e87c-44c8-be07-01e6c6ddf750 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fde877b6ddc74f4a87baf21471eb31d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d2387fdf794d4eaef07bbcd7b39f2a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:41:30.526460 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9607b9e0-e87c-44c8-be07-01e6c6ddf750 service nova] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:41:30.526733 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9607b9e0-e87c-44c8-be07-01e6c6ddf750 service nova] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:41:30.526995 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9607b9e0-e87c-44c8-be07-01e6c6ddf750 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:41:30.528622 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-9607b9e0-e87c-44c8-be07-01e6c6ddf750 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:41:30.613115 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=100 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:41:30.623451 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9607b9e0-e87c-44c8-be07-01e6c6ddf750 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:41:30.625102 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9607b9e0-e87c-44c8-be07-01e6c6ddf750 service nova] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:41:30.647314 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 552/1086] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 30 00:41:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 00:41:39.940300 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=51 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:41:40.645082 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=8 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:41:47.738848 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c043376b-0f12-498b-8a43-d42a7b202dff None None] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:41:47.739478 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c043376b-0f12-498b-8a43-d42a7b202dff None None] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:41:47.739478 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c043376b-0f12-498b-8a43-d42a7b202dff None None] PATH_INFO: `/` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:41:47.740775 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 535/1087] 10.222.0.42 () {54 vars in 918 bytes} [Sun Oct 30 00:41:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:41:47.746521 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c1a16e-c821-45bf-87e4-b62d00819674 None None] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:41:47.746967 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c1a16e-c821-45bf-87e4-b62d00819674 None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:41:47.747063 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c1a16e-c821-45bf-87e4-b62d00819674 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:41:47.822512 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.auth.core [None req-b5c1a16e-c821-45bf-87e4-b62d00819674 None None] MFA Rules not processed for user `202b8b2c0f454297bfb97c1ac4033625`. Rule list: `[]` (Enabled: `True`). {{(pid=87956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:41:47.823745 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-b5c1a16e-c821-45bf-87e4-b62d00819674 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:41:47.933001 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 553/1088] 10.222.0.42 () {58 vars in 1015 bytes} [Sun Oct 30 00:41:47 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:41:47.947505 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a107ebf-9995-4851-8778-d9dce3716831 None None] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:41:47.947781 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a107ebf-9995-4851-8778-d9dce3716831 None None] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:41:47.948052 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a107ebf-9995-4851-8778-d9dce3716831 None None] PATH_INFO: `/` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:41:47.949382 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 536/1089] 10.222.0.42 () {54 vars in 918 bytes} [Sun Oct 30 00:41:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:41:47.954366 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfc12b9-c237-46d9-9c1b-7d430dddb642 None None] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:41:47.954649 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfc12b9-c237-46d9-9c1b-7d430dddb642 None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:41:47.954920 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfc12b9-c237-46d9-9c1b-7d430dddb642 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:41:48.028914 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=100 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:41:48.032581 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.auth.core [None req-bdfc12b9-c237-46d9-9c1b-7d430dddb642 None None] MFA Rules not processed for user `fde877b6ddc74f4a87baf21471eb31d2`. Rule list: `[]` (Enabled: `True`). {{(pid=87956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:41:48.034515 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-bdfc12b9-c237-46d9-9c1b-7d430dddb642 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:41:48.161509 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 554/1090] 10.222.0.42 () {58 vars in 1015 bytes} [Sun Oct 30 00:41:47 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:41:50.724559 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3ffa25-cffc-4e7e-b374-6a19c6cbfd32 None None] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:41:50.725422 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3ffa25-cffc-4e7e-b374-6a19c6cbfd32 None None] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:41:50.725422 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3ffa25-cffc-4e7e-b374-6a19c6cbfd32 None None] PATH_INFO: `/` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:41:50.727533 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 537/1091] 127.0.0.1 () {54 vars in 917 bytes} [Sun Oct 30 00:41:50 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:41:50.735601 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29d714b-5edd-48d7-bb4f-7e7615bf3148 None None] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:41:50.736048 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29d714b-5edd-48d7-bb4f-7e7615bf3148 None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:41:50.736145 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29d714b-5edd-48d7-bb4f-7e7615bf3148 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:41:50.805593 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.auth.core [None req-c29d714b-5edd-48d7-bb4f-7e7615bf3148 None None] MFA Rules not processed for user `eb55b6cbca4945abb21b0e49eb745e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=87956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:41:50.806792 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-c29d714b-5edd-48d7-bb4f-7e7615bf3148 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:41:50.864041 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=100 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:41:50.915915 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 555/1092] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Oct 30 00:41:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 30 00:41:51.207345 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3ffa25-cffc-4e7e-b374-6a19c6cbfd32 None None] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:41:51.208946 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-ba3ffa25-cffc-4e7e-b374-6a19c6cbfd32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:41:51.360656 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3ffa25-cffc-4e7e-b374-6a19c6cbfd32 None None] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:41:51.439458 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=100 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:41:51.481151 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03000a77-7a06-4d64-92e8-4abf02c5e74e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fde877b6ddc74f4a87baf21471eb31d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d2387fdf794d4eaef07bbcd7b39f2a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:41:51.481749 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03000a77-7a06-4d64-92e8-4abf02c5e74e service nova] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:41:51.482022 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03000a77-7a06-4d64-92e8-4abf02c5e74e service nova] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:41:51.482296 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03000a77-7a06-4d64-92e8-4abf02c5e74e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:41:51.483920 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-03000a77-7a06-4d64-92e8-4abf02c5e74e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:41:51.579541 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03000a77-7a06-4d64-92e8-4abf02c5e74e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:41:51.581121 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03000a77-7a06-4d64-92e8-4abf02c5e74e service nova] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:41:51.599846 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 538/1093] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 30 00:41:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 00:41:52.732783 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3736ecb3-68a6-48d9-b904-97c357642ee2 None None] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:41:52.733689 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3736ecb3-68a6-48d9-b904-97c357642ee2 None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:41:52.733689 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3736ecb3-68a6-48d9-b904-97c357642ee2 None None] PATH_INFO: `/` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:41:52.735964 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 556/1094] 127.0.0.1 () {54 vars in 901 bytes} [Sun Oct 30 00:41:52 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:41:52.741754 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f90b987-ac56-44f2-a5bb-62376f3836a1 None None] REQUEST_METHOD: `POST` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:41:52.742622 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f90b987-ac56-44f2-a5bb-62376f3836a1 None None] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:41:52.742622 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f90b987-ac56-44f2-a5bb-62376f3836a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:41:52.831462 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.auth.core [None req-0f90b987-ac56-44f2-a5bb-62376f3836a1 None None] MFA Rules not processed for user `eb55b6cbca4945abb21b0e49eb745e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=87955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:41:52.832703 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-0f90b987-ac56-44f2-a5bb-62376f3836a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:41:52.861967 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=100 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:41:52.939294 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 539/1095] 127.0.0.1 () {58 vars in 998 bytes} [Sun Oct 30 00:41:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:41:53.101205 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3736ecb3-68a6-48d9-b904-97c357642ee2 None None] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:41:53.103711 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-3736ecb3-68a6-48d9-b904-97c357642ee2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:41:53.273460 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3736ecb3-68a6-48d9-b904-97c357642ee2 None None] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:41:53.316093 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=100 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:41:53.393017 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0a1bd0-398f-4b25-a6cf-598cc3dcf49f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fde877b6ddc74f4a87baf21471eb31d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d2387fdf794d4eaef07bbcd7b39f2a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:41:53.393629 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0a1bd0-398f-4b25-a6cf-598cc3dcf49f service nova] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:41:53.393906 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0a1bd0-398f-4b25-a6cf-598cc3dcf49f service nova] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:41:53.394170 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0a1bd0-398f-4b25-a6cf-598cc3dcf49f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:41:53.395844 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-ea0a1bd0-398f-4b25-a6cf-598cc3dcf49f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:41:53.490422 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0a1bd0-398f-4b25-a6cf-598cc3dcf49f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:41:53.492038 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0a1bd0-398f-4b25-a6cf-598cc3dcf49f service nova] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:41:53.510590 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 557/1096] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 30 00:41:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 00:41:54.629566 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60c8b7f-fd67-4565-8eb3-96c1e104364d None None] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:41:54.630506 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60c8b7f-fd67-4565-8eb3-96c1e104364d None None] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:41:54.630506 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60c8b7f-fd67-4565-8eb3-96c1e104364d None None] PATH_INFO: `/` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:41:54.632721 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 540/1097] 127.0.0.1 () {54 vars in 901 bytes} [Sun Oct 30 00:41:54 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:41:54.637861 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98488868-96d8-4a7d-9db4-d38cb6855007 None None] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:41:54.638335 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98488868-96d8-4a7d-9db4-d38cb6855007 None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:41:54.638437 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98488868-96d8-4a7d-9db4-d38cb6855007 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:41:54.693201 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=100 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:41:54.717061 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.auth.core [None req-98488868-96d8-4a7d-9db4-d38cb6855007 None None] MFA Rules not processed for user `eb55b6cbca4945abb21b0e49eb745e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=87956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:41:54.718393 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-98488868-96d8-4a7d-9db4-d38cb6855007 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:41:54.818184 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 558/1098] 127.0.0.1 () {58 vars in 998 bytes} [Sun Oct 30 00:41:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:41:54.972452 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60c8b7f-fd67-4565-8eb3-96c1e104364d None None] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:41:54.974192 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-a60c8b7f-fd67-4565-8eb3-96c1e104364d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:41:55.133540 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60c8b7f-fd67-4565-8eb3-96c1e104364d None None] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:41:55.145706 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=100 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:41:55.256472 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1cd7e8-6b12-40bc-a617-72bd081f8f4c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fde877b6ddc74f4a87baf21471eb31d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d2387fdf794d4eaef07bbcd7b39f2a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:41:55.257001 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1cd7e8-6b12-40bc-a617-72bd081f8f4c service nova] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:41:55.257277 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1cd7e8-6b12-40bc-a617-72bd081f8f4c service nova] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:41:55.257549 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1cd7e8-6b12-40bc-a617-72bd081f8f4c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:41:55.259165 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-ac1cd7e8-6b12-40bc-a617-72bd081f8f4c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:41:55.350321 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1cd7e8-6b12-40bc-a617-72bd081f8f4c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:41:55.351946 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1cd7e8-6b12-40bc-a617-72bd081f8f4c service nova] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:41:55.370858 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 541/1099] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 30 00:41:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 00:41:56.466677 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f0e886-0291-4c39-b89d-2417f50a14f0 None None] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:41:56.467395 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f0e886-0291-4c39-b89d-2417f50a14f0 None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:41:56.467395 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f0e886-0291-4c39-b89d-2417f50a14f0 None None] PATH_INFO: `/` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:41:56.468659 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 559/1100] 127.0.0.1 () {54 vars in 901 bytes} [Sun Oct 30 00:41:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:41:56.474371 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d209097b-fbed-4dfe-9a75-cf18a874e412 None None] REQUEST_METHOD: `POST` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:41:56.474872 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d209097b-fbed-4dfe-9a75-cf18a874e412 None None] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:41:56.475075 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d209097b-fbed-4dfe-9a75-cf18a874e412 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:41:56.503664 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=100 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:41:56.565835 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.auth.core [None req-d209097b-fbed-4dfe-9a75-cf18a874e412 None None] MFA Rules not processed for user `eb55b6cbca4945abb21b0e49eb745e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=87955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:41:56.567193 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-d209097b-fbed-4dfe-9a75-cf18a874e412 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:41:56.667814 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 542/1101] 127.0.0.1 () {58 vars in 998 bytes} [Sun Oct 30 00:41:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:41:56.821185 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f0e886-0291-4c39-b89d-2417f50a14f0 None None] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:41:56.823759 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-99f0e886-0291-4c39-b89d-2417f50a14f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:41:56.944179 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=100 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:41:56.983455 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f0e886-0291-4c39-b89d-2417f50a14f0 None None] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:41:57.111332 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc91e20-40a7-4597-ad0a-19dc50081aed service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fde877b6ddc74f4a87baf21471eb31d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d2387fdf794d4eaef07bbcd7b39f2a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:41:57.111948 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc91e20-40a7-4597-ad0a-19dc50081aed service nova] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:41:57.112222 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc91e20-40a7-4597-ad0a-19dc50081aed service nova] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:41:57.112489 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc91e20-40a7-4597-ad0a-19dc50081aed service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:41:57.114199 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-ccc91e20-40a7-4597-ad0a-19dc50081aed service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:41:57.193104 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=100 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:41:57.207536 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc91e20-40a7-4597-ad0a-19dc50081aed service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:41:57.209124 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc91e20-40a7-4597-ad0a-19dc50081aed service nova] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:41:57.228913 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 560/1102] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 30 00:41:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 00:41:58.332755 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818bbaeb-4cf6-47dc-acd1-8feb59012e1d None None] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:41:58.333262 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818bbaeb-4cf6-47dc-acd1-8feb59012e1d None None] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:41:58.333262 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818bbaeb-4cf6-47dc-acd1-8feb59012e1d None None] PATH_INFO: `/` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:41:58.334672 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 543/1103] 127.0.0.1 () {54 vars in 901 bytes} [Sun Oct 30 00:41:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:41:58.340042 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d9a7bf-7d1b-4f8a-b2a9-e87718c095ca None None] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:41:58.340492 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d9a7bf-7d1b-4f8a-b2a9-e87718c095ca None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:41:58.340610 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d9a7bf-7d1b-4f8a-b2a9-e87718c095ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:41:58.423532 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.auth.core [None req-d6d9a7bf-7d1b-4f8a-b2a9-e87718c095ca None None] MFA Rules not processed for user `eb55b6cbca4945abb21b0e49eb745e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=87956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:41:58.424737 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-d6d9a7bf-7d1b-4f8a-b2a9-e87718c095ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:41:58.528050 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 561/1104] 127.0.0.1 () {58 vars in 998 bytes} [Sun Oct 30 00:41:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:41:58.687636 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818bbaeb-4cf6-47dc-acd1-8feb59012e1d None None] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:41:58.690076 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-818bbaeb-4cf6-47dc-acd1-8feb59012e1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:41:58.782784 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=100 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:41:58.848930 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818bbaeb-4cf6-47dc-acd1-8feb59012e1d None None] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:41:58.969537 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34954a8-f482-4fd5-8b7c-1f64ea1060ff service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fde877b6ddc74f4a87baf21471eb31d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d2387fdf794d4eaef07bbcd7b39f2a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:41:58.970142 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34954a8-f482-4fd5-8b7c-1f64ea1060ff service nova] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:41:58.970416 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34954a8-f482-4fd5-8b7c-1f64ea1060ff service nova] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:41:58.970688 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34954a8-f482-4fd5-8b7c-1f64ea1060ff service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:41:58.972287 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-e34954a8-f482-4fd5-8b7c-1f64ea1060ff service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:41:59.030452 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=100 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:41:59.075229 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34954a8-f482-4fd5-8b7c-1f64ea1060ff service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:41:59.076842 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34954a8-f482-4fd5-8b7c-1f64ea1060ff service nova] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:41:59.096622 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 544/1105] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 30 00:41:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 00:42:00.162528 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1163f979-4a11-4537-b6f0-422433ac7ba4 None None] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:42:00.163160 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1163f979-4a11-4537-b6f0-422433ac7ba4 None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:42:00.163160 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1163f979-4a11-4537-b6f0-422433ac7ba4 None None] PATH_INFO: `/` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:42:00.164497 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 562/1106] 127.0.0.1 () {54 vars in 901 bytes} [Sun Oct 30 00:42:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:42:00.170613 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c93611-2d3d-449e-86df-1938033f5263 None None] REQUEST_METHOD: `POST` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:42:00.171340 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c93611-2d3d-449e-86df-1938033f5263 None None] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:42:00.171577 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c93611-2d3d-449e-86df-1938033f5263 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:42:00.259838 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.auth.core [None req-81c93611-2d3d-449e-86df-1938033f5263 None None] MFA Rules not processed for user `eb55b6cbca4945abb21b0e49eb745e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=87955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:42:00.260986 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-81c93611-2d3d-449e-86df-1938033f5263 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:42:00.364209 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 545/1107] 127.0.0.1 () {58 vars in 998 bytes} [Sun Oct 30 00:42:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:42:00.519833 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1163f979-4a11-4537-b6f0-422433ac7ba4 None None] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:42:00.523459 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-1163f979-4a11-4537-b6f0-422433ac7ba4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:42:00.606852 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=100 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:42:00.710515 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1163f979-4a11-4537-b6f0-422433ac7ba4 None None] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:42:00.838452 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d56710a-0a5f-4481-a57e-cc39f2d8cd0e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fde877b6ddc74f4a87baf21471eb31d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d2387fdf794d4eaef07bbcd7b39f2a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:42:00.839049 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d56710a-0a5f-4481-a57e-cc39f2d8cd0e service nova] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:42:00.839356 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d56710a-0a5f-4481-a57e-cc39f2d8cd0e service nova] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:42:00.839631 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d56710a-0a5f-4481-a57e-cc39f2d8cd0e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:42:00.841247 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-8d56710a-0a5f-4481-a57e-cc39f2d8cd0e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:42:00.848283 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=100 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:42:00.933675 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d56710a-0a5f-4481-a57e-cc39f2d8cd0e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:42:00.935313 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d56710a-0a5f-4481-a57e-cc39f2d8cd0e service nova] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:42:00.954221 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 563/1108] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 30 00:42:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 436 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 00:42:02.004760 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f3c61c-e665-43c0-97ba-a4b4c52f7fde None None] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:42:02.005240 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f3c61c-e665-43c0-97ba-a4b4c52f7fde None None] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:42:02.005240 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f3c61c-e665-43c0-97ba-a4b4c52f7fde None None] PATH_INFO: `/` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:42:02.006646 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 546/1109] 127.0.0.1 () {54 vars in 901 bytes} [Sun Oct 30 00:42:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:42:02.011887 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b8c946-c8a7-485c-8b0b-af292c921687 None None] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:42:02.012369 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b8c946-c8a7-485c-8b0b-af292c921687 None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:42:02.012478 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b8c946-c8a7-485c-8b0b-af292c921687 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:42:02.092247 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.auth.core [None req-81b8c946-c8a7-485c-8b0b-af292c921687 None None] MFA Rules not processed for user `eb55b6cbca4945abb21b0e49eb745e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=87956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:42:02.093481 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-81b8c946-c8a7-485c-8b0b-af292c921687 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:42:02.166259 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=100 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:42:02.197334 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 564/1110] 127.0.0.1 () {58 vars in 998 bytes} [Sun Oct 30 00:42:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:42:02.351262 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f3c61c-e665-43c0-97ba-a4b4c52f7fde None None] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:42:02.353721 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-82f3c61c-e665-43c0-97ba-a4b4c52f7fde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:42:02.375674 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=100 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:42:02.512427 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f3c61c-e665-43c0-97ba-a4b4c52f7fde None None] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:42:02.617665 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=100 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:42:02.645662 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82e5bf8-4345-4fc8-9e6b-b5b46bdf4047 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fde877b6ddc74f4a87baf21471eb31d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d2387fdf794d4eaef07bbcd7b39f2a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:42:02.646301 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82e5bf8-4345-4fc8-9e6b-b5b46bdf4047 service nova] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:42:02.646590 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82e5bf8-4345-4fc8-9e6b-b5b46bdf4047 service nova] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:42:02.646845 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82e5bf8-4345-4fc8-9e6b-b5b46bdf4047 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:42:02.648506 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-b82e5bf8-4345-4fc8-9e6b-b5b46bdf4047 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:42:02.755356 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82e5bf8-4345-4fc8-9e6b-b5b46bdf4047 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:42:02.756934 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82e5bf8-4345-4fc8-9e6b-b5b46bdf4047 service nova] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:42:02.774823 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 547/1111] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 30 00:42:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 00:42:03.811606 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01265acc-6bdb-480e-bfc5-a1f573bfccfd None None] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:42:03.812520 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01265acc-6bdb-480e-bfc5-a1f573bfccfd None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:42:03.812520 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01265acc-6bdb-480e-bfc5-a1f573bfccfd None None] PATH_INFO: `/` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:42:03.814673 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 565/1112] 127.0.0.1 () {54 vars in 901 bytes} [Sun Oct 30 00:42:03 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:42:03.820676 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dbe731-939f-4e7a-9100-8e9e45caae20 None None] REQUEST_METHOD: `POST` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:42:03.821555 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dbe731-939f-4e7a-9100-8e9e45caae20 None None] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:42:03.821555 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dbe731-939f-4e7a-9100-8e9e45caae20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:42:03.904265 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.auth.core [None req-35dbe731-939f-4e7a-9100-8e9e45caae20 None None] MFA Rules not processed for user `eb55b6cbca4945abb21b0e49eb745e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=87955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:42:03.905465 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-35dbe731-939f-4e7a-9100-8e9e45caae20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:42:03.948889 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=100 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:42:04.014269 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 548/1113] 127.0.0.1 () {58 vars in 998 bytes} [Sun Oct 30 00:42:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:42:04.165468 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01265acc-6bdb-480e-bfc5-a1f573bfccfd None None] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:42:04.167049 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-01265acc-6bdb-480e-bfc5-a1f573bfccfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:42:04.322321 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01265acc-6bdb-480e-bfc5-a1f573bfccfd None None] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:42:04.381074 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=100 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:42:04.446900 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604176b3-837b-47a5-bc2d-7a7291b0c014 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fde877b6ddc74f4a87baf21471eb31d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d2387fdf794d4eaef07bbcd7b39f2a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:42:04.447535 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604176b3-837b-47a5-bc2d-7a7291b0c014 service nova] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:42:04.447807 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604176b3-837b-47a5-bc2d-7a7291b0c014 service nova] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:42:04.448099 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604176b3-837b-47a5-bc2d-7a7291b0c014 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:42:04.449668 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-604176b3-837b-47a5-bc2d-7a7291b0c014 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:42:04.551995 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604176b3-837b-47a5-bc2d-7a7291b0c014 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:42:04.553585 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604176b3-837b-47a5-bc2d-7a7291b0c014 service nova] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:42:04.572312 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 566/1114] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 30 00:42:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 00:42:05.603247 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ee37df-7488-4937-81d4-4ecd955d5a85 None None] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:42:05.603850 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ee37df-7488-4937-81d4-4ecd955d5a85 None None] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:42:05.603850 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ee37df-7488-4937-81d4-4ecd955d5a85 None None] PATH_INFO: `/` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:42:05.605818 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 549/1115] 127.0.0.1 () {54 vars in 901 bytes} [Sun Oct 30 00:42:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:42:05.613784 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25eb176-33d1-443b-a085-6e19014d83c9 None None] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:42:05.614236 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25eb176-33d1-443b-a085-6e19014d83c9 None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:42:05.614674 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25eb176-33d1-443b-a085-6e19014d83c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:42:05.698544 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.auth.core [None req-b25eb176-33d1-443b-a085-6e19014d83c9 None None] MFA Rules not processed for user `eb55b6cbca4945abb21b0e49eb745e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=87956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:42:05.699792 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-b25eb176-33d1-443b-a085-6e19014d83c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:42:05.701857 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=100 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:42:05.815163 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 567/1116] 127.0.0.1 () {58 vars in 998 bytes} [Sun Oct 30 00:42:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:42:05.968745 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ee37df-7488-4937-81d4-4ecd955d5a85 None None] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:42:05.970724 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-92ee37df-7488-4937-81d4-4ecd955d5a85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:42:06.129727 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ee37df-7488-4937-81d4-4ecd955d5a85 None None] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:42:06.156930 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=100 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:42:06.245690 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634908f4-8d12-4314-829b-43f06255bc2e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fde877b6ddc74f4a87baf21471eb31d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d2387fdf794d4eaef07bbcd7b39f2a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:42:06.246207 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634908f4-8d12-4314-829b-43f06255bc2e service nova] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:42:06.246480 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634908f4-8d12-4314-829b-43f06255bc2e service nova] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:42:06.246744 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634908f4-8d12-4314-829b-43f06255bc2e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:42:06.248385 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-634908f4-8d12-4314-829b-43f06255bc2e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:42:06.348294 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634908f4-8d12-4314-829b-43f06255bc2e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:42:06.349877 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634908f4-8d12-4314-829b-43f06255bc2e service nova] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:42:06.368852 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 550/1117] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 30 00:42:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 00:42:08.391520 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391fa14b-35d5-4afb-9b13-08c79fd8c43b None None] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:42:08.392127 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391fa14b-35d5-4afb-9b13-08c79fd8c43b None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:42:08.392127 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391fa14b-35d5-4afb-9b13-08c79fd8c43b None None] PATH_INFO: `/` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:42:08.393387 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 568/1118] 127.0.0.1 () {54 vars in 917 bytes} [Sun Oct 30 00:42:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:42:08.399864 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258696f8-9360-4f5e-b626-561072fd0418 None None] REQUEST_METHOD: `POST` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:42:08.400556 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258696f8-9360-4f5e-b626-561072fd0418 None None] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:42:08.400719 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258696f8-9360-4f5e-b626-561072fd0418 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:42:08.446292 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=100 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:42:08.472869 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.auth.core [None req-258696f8-9360-4f5e-b626-561072fd0418 None None] MFA Rules not processed for user `eb55b6cbca4945abb21b0e49eb745e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=87955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:42:08.474078 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-258696f8-9360-4f5e-b626-561072fd0418 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:42:08.573986 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 551/1119] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Oct 30 00:42:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:42:08.883049 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391fa14b-35d5-4afb-9b13-08c79fd8c43b None None] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:42:08.885581 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-391fa14b-35d5-4afb-9b13-08c79fd8c43b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:42:08.998377 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391fa14b-35d5-4afb-9b13-08c79fd8c43b None None] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:42:09.032811 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=100 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:42:09.076373 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f6427b-42ac-491d-9494-2d47b1e678c8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5693f186c6ad4d9394f02ee3477cdcd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d2387fdf794d4eaef07bbcd7b39f2a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:42:09.076978 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f6427b-42ac-491d-9494-2d47b1e678c8 service neutron] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:42:09.077249 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f6427b-42ac-491d-9494-2d47b1e678c8 service neutron] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:42:09.077514 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f6427b-42ac-491d-9494-2d47b1e678c8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:42:09.079440 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-d3f6427b-42ac-491d-9494-2d47b1e678c8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:42:09.198584 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f6427b-42ac-491d-9494-2d47b1e678c8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:42:09.199966 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f6427b-42ac-491d-9494-2d47b1e678c8 service neutron] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:42:09.219309 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 569/1120] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 30 00:42:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 00:42:11.505320 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e1d576-42a2-4bd6-9402-c47c0c9215d4 None None] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:42:11.506197 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e1d576-42a2-4bd6-9402-c47c0c9215d4 None None] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:42:11.506197 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e1d576-42a2-4bd6-9402-c47c0c9215d4 None None] PATH_INFO: `/` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:42:11.507556 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 552/1121] 127.0.0.1 () {54 vars in 917 bytes} [Sun Oct 30 00:42:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:42:11.513967 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d993369-1548-4a05-9806-1d06acc8722b None None] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:42:11.514403 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d993369-1548-4a05-9806-1d06acc8722b None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:42:11.514522 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d993369-1548-4a05-9806-1d06acc8722b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:42:11.588186 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.auth.core [None req-5d993369-1548-4a05-9806-1d06acc8722b None None] MFA Rules not processed for user `eb55b6cbca4945abb21b0e49eb745e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=87956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:42:11.589408 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-5d993369-1548-4a05-9806-1d06acc8722b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:42:11.604145 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=100 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:42:11.701250 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 570/1122] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Oct 30 00:42:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:42:11.983351 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e1d576-42a2-4bd6-9402-c47c0c9215d4 None None] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:42:11.984950 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-d9e1d576-42a2-4bd6-9402-c47c0c9215d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:42:12.102479 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e1d576-42a2-4bd6-9402-c47c0c9215d4 None None] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:42:12.116358 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=100 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:42:12.180367 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c778f5ff-47be-47c5-9423-c97f513efac7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5693f186c6ad4d9394f02ee3477cdcd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d2387fdf794d4eaef07bbcd7b39f2a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:42:12.180969 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c778f5ff-47be-47c5-9423-c97f513efac7 service neutron] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:42:12.181245 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c778f5ff-47be-47c5-9423-c97f513efac7 service neutron] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:42:12.181514 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c778f5ff-47be-47c5-9423-c97f513efac7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:42:12.183121 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-c778f5ff-47be-47c5-9423-c97f513efac7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:42:12.302239 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c778f5ff-47be-47c5-9423-c97f513efac7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:42:12.303803 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c778f5ff-47be-47c5-9423-c97f513efac7 service neutron] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:42:12.325405 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 553/1123] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 30 00:42:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 00:42:14.796343 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547d815d-2cef-4b27-95b4-8830c01c1afd None None] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:42:14.797232 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547d815d-2cef-4b27-95b4-8830c01c1afd None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:42:14.797232 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547d815d-2cef-4b27-95b4-8830c01c1afd None None] PATH_INFO: `/` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:42:14.799469 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 571/1124] 127.0.0.1 () {54 vars in 917 bytes} [Sun Oct 30 00:42:14 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:42:14.805092 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8983c5-d476-465a-a89f-7c6a5a6eda50 None None] REQUEST_METHOD: `POST` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:42:14.805546 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8983c5-d476-465a-a89f-7c6a5a6eda50 None None] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:42:14.805652 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8983c5-d476-465a-a89f-7c6a5a6eda50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:42:14.856080 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=100 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:42:14.874895 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.auth.core [None req-0c8983c5-d476-465a-a89f-7c6a5a6eda50 None None] MFA Rules not processed for user `eb55b6cbca4945abb21b0e49eb745e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=87955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:42:14.876131 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-0c8983c5-d476-465a-a89f-7c6a5a6eda50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:42:14.986624 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 554/1125] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Oct 30 00:42:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:42:15.268615 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547d815d-2cef-4b27-95b4-8830c01c1afd None None] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:42:15.270220 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-547d815d-2cef-4b27-95b4-8830c01c1afd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:42:15.385685 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547d815d-2cef-4b27-95b4-8830c01c1afd None None] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:42:15.432119 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=100 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:42:15.468828 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b085c37b-d8fe-4b06-ba62-fda6bb9917dc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5693f186c6ad4d9394f02ee3477cdcd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d2387fdf794d4eaef07bbcd7b39f2a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:42:15.469429 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b085c37b-d8fe-4b06-ba62-fda6bb9917dc service neutron] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:42:15.469701 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b085c37b-d8fe-4b06-ba62-fda6bb9917dc service neutron] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:42:15.469968 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b085c37b-d8fe-4b06-ba62-fda6bb9917dc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:42:15.471604 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-b085c37b-d8fe-4b06-ba62-fda6bb9917dc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:42:15.590684 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b085c37b-d8fe-4b06-ba62-fda6bb9917dc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:42:15.592146 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b085c37b-d8fe-4b06-ba62-fda6bb9917dc service neutron] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:42:15.610669 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 572/1126] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 30 00:42:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 00:42:17.855490 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58541eea-0a4b-4526-9b29-e48077e1c7a3 None None] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:42:17.856379 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58541eea-0a4b-4526-9b29-e48077e1c7a3 None None] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:42:17.856379 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58541eea-0a4b-4526-9b29-e48077e1c7a3 None None] PATH_INFO: `/` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:42:17.858629 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 555/1127] 127.0.0.1 () {54 vars in 917 bytes} [Sun Oct 30 00:42:17 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:42:17.865108 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a884c0b1-f283-498c-a8e5-71adb2185eb1 None None] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:42:17.865832 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a884c0b1-f283-498c-a8e5-71adb2185eb1 None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:42:17.865944 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a884c0b1-f283-498c-a8e5-71adb2185eb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:42:17.933468 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.auth.core [None req-a884c0b1-f283-498c-a8e5-71adb2185eb1 None None] MFA Rules not processed for user `eb55b6cbca4945abb21b0e49eb745e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=87956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:42:17.934661 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-a884c0b1-f283-498c-a8e5-71adb2185eb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:42:17.955884 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=100 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:42:18.033592 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 573/1128] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Oct 30 00:42:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:42:18.311909 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58541eea-0a4b-4526-9b29-e48077e1c7a3 None None] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:42:18.315958 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-58541eea-0a4b-4526-9b29-e48077e1c7a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:42:18.428225 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58541eea-0a4b-4526-9b29-e48077e1c7a3 None None] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:42:18.449093 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=100 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:42:18.503795 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c15b4c-4cd8-4679-ba36-d1c257403ef0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5693f186c6ad4d9394f02ee3477cdcd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d2387fdf794d4eaef07bbcd7b39f2a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:42:18.504385 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c15b4c-4cd8-4679-ba36-d1c257403ef0 service neutron] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:42:18.504656 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c15b4c-4cd8-4679-ba36-d1c257403ef0 service neutron] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:42:18.504950 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c15b4c-4cd8-4679-ba36-d1c257403ef0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:42:18.506609 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-a7c15b4c-4cd8-4679-ba36-d1c257403ef0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:42:18.635994 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c15b4c-4cd8-4679-ba36-d1c257403ef0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:42:18.637339 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c15b4c-4cd8-4679-ba36-d1c257403ef0 service neutron] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:42:18.656256 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 556/1129] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 30 00:42:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 00:42:20.979223 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35031e4c-b3e9-4dca-a6bf-a00508a9b3be None None] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:42:20.979823 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35031e4c-b3e9-4dca-a6bf-a00508a9b3be None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:42:20.979823 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35031e4c-b3e9-4dca-a6bf-a00508a9b3be None None] PATH_INFO: `/` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:42:20.981148 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 574/1130] 127.0.0.1 () {54 vars in 917 bytes} [Sun Oct 30 00:42:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:42:20.987902 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc296823-b6e2-429f-b2c2-54e1626ee096 None None] REQUEST_METHOD: `POST` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:42:20.988617 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc296823-b6e2-429f-b2c2-54e1626ee096 None None] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:42:20.988793 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc296823-b6e2-429f-b2c2-54e1626ee096 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:42:21.055878 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=100 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:42:21.059333 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.auth.core [None req-cc296823-b6e2-429f-b2c2-54e1626ee096 None None] MFA Rules not processed for user `eb55b6cbca4945abb21b0e49eb745e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=87955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:42:21.061070 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-cc296823-b6e2-429f-b2c2-54e1626ee096 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:42:21.160970 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 557/1131] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Oct 30 00:42:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:42:21.446441 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35031e4c-b3e9-4dca-a6bf-a00508a9b3be None None] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:42:21.448033 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-35031e4c-b3e9-4dca-a6bf-a00508a9b3be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:42:21.558732 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35031e4c-b3e9-4dca-a6bf-a00508a9b3be None None] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:42:21.611922 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=100 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:42:21.637112 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6207c526-22fa-471f-b150-ac10b316d41c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5693f186c6ad4d9394f02ee3477cdcd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d2387fdf794d4eaef07bbcd7b39f2a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:42:21.637716 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6207c526-22fa-471f-b150-ac10b316d41c service neutron] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:42:21.637960 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6207c526-22fa-471f-b150-ac10b316d41c service neutron] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:42:21.638258 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6207c526-22fa-471f-b150-ac10b316d41c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:42:21.639873 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-6207c526-22fa-471f-b150-ac10b316d41c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:42:21.758105 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6207c526-22fa-471f-b150-ac10b316d41c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:42:21.758105 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6207c526-22fa-471f-b150-ac10b316d41c service neutron] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:42:21.780021 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 575/1132] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 30 00:42:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 00:42:24.029418 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5a7952-b794-4449-a4df-b2cf9ad6fd05 None None] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:42:24.029944 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5a7952-b794-4449-a4df-b2cf9ad6fd05 None None] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:42:24.029944 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5a7952-b794-4449-a4df-b2cf9ad6fd05 None None] PATH_INFO: `/` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:42:24.031871 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 558/1133] 127.0.0.1 () {54 vars in 917 bytes} [Sun Oct 30 00:42:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:42:24.039302 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3dc8cc-26e5-484b-900d-18500658df38 None None] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:42:24.039756 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3dc8cc-26e5-484b-900d-18500658df38 None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:42:24.039851 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3dc8cc-26e5-484b-900d-18500658df38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:42:24.109636 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.auth.core [None req-2c3dc8cc-26e5-484b-900d-18500658df38 None None] MFA Rules not processed for user `eb55b6cbca4945abb21b0e49eb745e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=87956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:42:24.110852 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-2c3dc8cc-26e5-484b-900d-18500658df38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:42:24.140750 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=100 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:42:24.210527 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 576/1134] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Oct 30 00:42:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:42:24.500121 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5a7952-b794-4449-a4df-b2cf9ad6fd05 None None] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:42:24.501696 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-af5a7952-b794-4449-a4df-b2cf9ad6fd05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:42:24.612999 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5a7952-b794-4449-a4df-b2cf9ad6fd05 None None] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:42:24.644649 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=100 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:42:24.702021 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402d19e4-4af1-4db3-bf6e-d0edd36be944 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5693f186c6ad4d9394f02ee3477cdcd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d2387fdf794d4eaef07bbcd7b39f2a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:42:24.702719 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402d19e4-4af1-4db3-bf6e-d0edd36be944 service neutron] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:42:24.702997 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402d19e4-4af1-4db3-bf6e-d0edd36be944 service neutron] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:42:24.703287 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402d19e4-4af1-4db3-bf6e-d0edd36be944 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:42:24.705213 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-402d19e4-4af1-4db3-bf6e-d0edd36be944 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:42:24.826026 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402d19e4-4af1-4db3-bf6e-d0edd36be944 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:42:24.827501 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402d19e4-4af1-4db3-bf6e-d0edd36be944 service neutron] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:42:24.846976 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 559/1135] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 30 00:42:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 30 00:42:27.038445 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c775145b-4ccf-446a-8b3d-1b7c1bbb75a9 None None] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:42:27.039336 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c775145b-4ccf-446a-8b3d-1b7c1bbb75a9 None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:42:27.039336 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c775145b-4ccf-446a-8b3d-1b7c1bbb75a9 None None] PATH_INFO: `/` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:42:27.041522 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 577/1136] 127.0.0.1 () {54 vars in 917 bytes} [Sun Oct 30 00:42:27 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:42:27.047168 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184491f7-5729-448a-b5b3-b978b2c98d47 None None] REQUEST_METHOD: `POST` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:42:27.047645 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184491f7-5729-448a-b5b3-b978b2c98d47 None None] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:42:27.047740 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184491f7-5729-448a-b5b3-b978b2c98d47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:42:27.116561 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.auth.core [None req-184491f7-5729-448a-b5b3-b978b2c98d47 None None] MFA Rules not processed for user `eb55b6cbca4945abb21b0e49eb745e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=87955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:42:27.117787 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-184491f7-5729-448a-b5b3-b978b2c98d47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:42:27.126493 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=100 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:42:27.217067 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 560/1137] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Oct 30 00:42:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:42:27.504735 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c775145b-4ccf-446a-8b3d-1b7c1bbb75a9 None None] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:42:27.507106 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-c775145b-4ccf-446a-8b3d-1b7c1bbb75a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:42:27.627722 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c775145b-4ccf-446a-8b3d-1b7c1bbb75a9 None None] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:42:27.685806 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=100 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:42:27.705352 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f15734e-4fba-460b-8d71-dda4a6b22a6a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5693f186c6ad4d9394f02ee3477cdcd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d2387fdf794d4eaef07bbcd7b39f2a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:42:27.705962 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f15734e-4fba-460b-8d71-dda4a6b22a6a service neutron] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:42:27.706222 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f15734e-4fba-460b-8d71-dda4a6b22a6a service neutron] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:42:27.706499 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f15734e-4fba-460b-8d71-dda4a6b22a6a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:42:27.708122 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-5f15734e-4fba-460b-8d71-dda4a6b22a6a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:42:27.838586 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f15734e-4fba-460b-8d71-dda4a6b22a6a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:42:27.840071 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f15734e-4fba-460b-8d71-dda4a6b22a6a service neutron] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:42:27.859740 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 578/1138] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 30 00:42:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 00:42:30.049265 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae7d094-acaa-4b91-8c45-b58b4d78a283 None None] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:42:30.049858 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae7d094-acaa-4b91-8c45-b58b4d78a283 None None] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:42:30.049858 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae7d094-acaa-4b91-8c45-b58b4d78a283 None None] PATH_INFO: `/` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:42:30.051147 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 561/1139] 127.0.0.1 () {54 vars in 917 bytes} [Sun Oct 30 00:42:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:42:30.057879 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8255bda-bd47-4835-886e-ee410605da2e None None] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:42:30.058350 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8255bda-bd47-4835-886e-ee410605da2e None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:42:30.058571 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8255bda-bd47-4835-886e-ee410605da2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:42:30.135148 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.auth.core [None req-e8255bda-bd47-4835-886e-ee410605da2e None None] MFA Rules not processed for user `eb55b6cbca4945abb21b0e49eb745e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=87956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:42:30.136403 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-e8255bda-bd47-4835-886e-ee410605da2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:42:30.181462 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=100 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:42:30.244940 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 579/1140] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Oct 30 00:42:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:42:30.536215 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae7d094-acaa-4b91-8c45-b58b4d78a283 None None] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:42:30.537775 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-5ae7d094-acaa-4b91-8c45-b58b4d78a283 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:42:30.647794 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae7d094-acaa-4b91-8c45-b58b4d78a283 None None] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:42:30.686284 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=100 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:42:30.725328 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f488d7-a70b-4547-a20b-eb031c68d430 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5693f186c6ad4d9394f02ee3477cdcd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d2387fdf794d4eaef07bbcd7b39f2a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:42:30.725928 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f488d7-a70b-4547-a20b-eb031c68d430 service neutron] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:42:30.726206 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f488d7-a70b-4547-a20b-eb031c68d430 service neutron] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:42:30.726476 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f488d7-a70b-4547-a20b-eb031c68d430 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:42:30.728125 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-c3f488d7-a70b-4547-a20b-eb031c68d430 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:42:30.851030 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f488d7-a70b-4547-a20b-eb031c68d430 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:42:30.852422 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f488d7-a70b-4547-a20b-eb031c68d430 service neutron] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:42:30.874252 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 562/1141] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 30 00:42:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 00:42:33.030599 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd596ee-e7d9-45d4-a536-276711c4b03e None None] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:42:33.031246 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd596ee-e7d9-45d4-a536-276711c4b03e None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:42:33.031246 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd596ee-e7d9-45d4-a536-276711c4b03e None None] PATH_INFO: `/` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:42:33.032522 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 580/1142] 127.0.0.1 () {54 vars in 917 bytes} [Sun Oct 30 00:42:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:42:33.038952 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d24fac-59f0-469a-ab61-f5b6e1980f34 None None] REQUEST_METHOD: `POST` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:42:33.039473 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d24fac-59f0-469a-ab61-f5b6e1980f34 None None] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:42:33.039573 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d24fac-59f0-469a-ab61-f5b6e1980f34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:42:33.115098 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.auth.core [None req-b6d24fac-59f0-469a-ab61-f5b6e1980f34 None None] MFA Rules not processed for user `eb55b6cbca4945abb21b0e49eb745e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=87955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:42:33.116350 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-b6d24fac-59f0-469a-ab61-f5b6e1980f34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:42:33.134511 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=100 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:42:33.214682 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 563/1143] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Oct 30 00:42:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:42:33.490724 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd596ee-e7d9-45d4-a536-276711c4b03e None None] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:42:33.492391 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-6cd596ee-e7d9-45d4-a536-276711c4b03e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:42:33.598493 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd596ee-e7d9-45d4-a536-276711c4b03e None None] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:42:33.665855 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=100 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:42:33.673915 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fe1920-b520-4e08-b480-6c51f115f7c0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5693f186c6ad4d9394f02ee3477cdcd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d2387fdf794d4eaef07bbcd7b39f2a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:42:33.674529 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fe1920-b520-4e08-b480-6c51f115f7c0 service neutron] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:42:33.674801 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fe1920-b520-4e08-b480-6c51f115f7c0 service neutron] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:42:33.675072 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fe1920-b520-4e08-b480-6c51f115f7c0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:42:33.676724 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-e1fe1920-b520-4e08-b480-6c51f115f7c0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:42:33.798375 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1fe1920-b520-4e08-b480-6c51f115f7c0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:42:33.799873 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1fe1920-b520-4e08-b480-6c51f115f7c0 service neutron] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:42:33.819079 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 581/1144] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 30 00:42:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 00:42:35.960707 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e31d85-e918-4fe7-9ad7-f0ef96e62111 None None] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:42:35.961609 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e31d85-e918-4fe7-9ad7-f0ef96e62111 None None] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:42:35.961748 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e31d85-e918-4fe7-9ad7-f0ef96e62111 None None] PATH_INFO: `/` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:42:35.963920 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 564/1145] 127.0.0.1 () {54 vars in 917 bytes} [Sun Oct 30 00:42:35 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:42:35.970547 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6ac30f-b465-4353-8c22-81edb2a9c389 None None] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:42:35.971010 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6ac30f-b465-4353-8c22-81edb2a9c389 None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:42:35.971113 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6ac30f-b465-4353-8c22-81edb2a9c389 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:42:36.048511 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.auth.core [None req-0b6ac30f-b465-4353-8c22-81edb2a9c389 None None] MFA Rules not processed for user `eb55b6cbca4945abb21b0e49eb745e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=87956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:42:36.049738 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-0b6ac30f-b465-4353-8c22-81edb2a9c389 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:42:36.100690 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=100 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:42:36.150636 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 582/1146] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Oct 30 00:42:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:42:36.438881 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e31d85-e918-4fe7-9ad7-f0ef96e62111 None None] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:42:36.441407 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-d0e31d85-e918-4fe7-9ad7-f0ef96e62111 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:42:36.550184 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e31d85-e918-4fe7-9ad7-f0ef96e62111 None None] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:42:36.600274 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=100 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:42:36.627453 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897a234d-76c7-4ffc-b88a-a0d64ce6be11 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5693f186c6ad4d9394f02ee3477cdcd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d2387fdf794d4eaef07bbcd7b39f2a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:42:36.628067 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897a234d-76c7-4ffc-b88a-a0d64ce6be11 service neutron] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:42:36.628345 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897a234d-76c7-4ffc-b88a-a0d64ce6be11 service neutron] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:42:36.628617 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897a234d-76c7-4ffc-b88a-a0d64ce6be11 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:42:36.630271 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-897a234d-76c7-4ffc-b88a-a0d64ce6be11 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:42:36.743279 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897a234d-76c7-4ffc-b88a-a0d64ce6be11 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:42:36.744630 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897a234d-76c7-4ffc-b88a-a0d64ce6be11 service neutron] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:42:36.764128 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 565/1147] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 30 00:42:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 00:42:46.148887 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=22 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:42:46.761489 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=66 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:42:56.660200 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efddc77-4d8f-495d-ad2d-fa2f7c7d8a37 None None] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:42:56.661016 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efddc77-4d8f-495d-ad2d-fa2f7c7d8a37 None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:42:56.661016 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efddc77-4d8f-495d-ad2d-fa2f7c7d8a37 None None] PATH_INFO: `/` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:42:56.662959 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 583/1148] 10.222.0.42 () {54 vars in 927 bytes} [Sun Oct 30 00:42:56 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:42:56.669094 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72eb3199-704f-4bce-987c-1761dffd294f None None] REQUEST_METHOD: `POST` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:42:56.669657 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72eb3199-704f-4bce-987c-1761dffd294f None None] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:42:56.669657 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72eb3199-704f-4bce-987c-1761dffd294f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:42:56.737789 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.auth.core [None req-72eb3199-704f-4bce-987c-1761dffd294f None None] MFA Rules not processed for user `eb55b6cbca4945abb21b0e49eb745e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=87955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:42:56.738976 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-72eb3199-704f-4bce-987c-1761dffd294f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:42:56.837339 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 566/1149] 10.222.0.42 () {58 vars in 1024 bytes} [Sun Oct 30 00:42:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 30 00:42:57.155363 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440a512d-fa71-4a75-8178-bbfc1a64945d None None] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:42:57.155636 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440a512d-fa71-4a75-8178-bbfc1a64945d None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:42:57.155904 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440a512d-fa71-4a75-8178-bbfc1a64945d None None] PATH_INFO: `/` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:42:57.157261 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 584/1150] 10.222.0.42 () {54 vars in 962 bytes} [Sun Oct 30 00:42:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 30 00:42:57.162315 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327ac767-7411-466d-bf00-adff63c2ddd0 None None] REQUEST_METHOD: `POST` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:42:57.162597 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327ac767-7411-466d-bf00-adff63c2ddd0 None None] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:42:57.162868 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327ac767-7411-466d-bf00-adff63c2ddd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:42:57.242176 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.auth.core [None req-327ac767-7411-466d-bf00-adff63c2ddd0 None None] MFA Rules not processed for user `36a86cf3eaf24b369737b65046142593`. Rule list: `[]` (Enabled: `True`). {{(pid=87955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:42:57.243424 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-327ac767-7411-466d-bf00-adff63c2ddd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:42:57.265276 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=100 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:42:57.320751 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 567/1151] 10.222.0.42 () {58 vars in 1059 bytes} [Sun Oct 30 00:42:57 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:42:57.329065 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440a512d-fa71-4a75-8178-bbfc1a64945d None None] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:42:57.330515 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-440a512d-fa71-4a75-8178-bbfc1a64945d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:42:57.438097 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440a512d-fa71-4a75-8178-bbfc1a64945d None None] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:42:57.517422 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faed4013-6724-4d30-b403-0a8161fe1652 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36a86cf3eaf24b369737b65046142593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d2387fdf794d4eaef07bbcd7b39f2a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:42:57.518033 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faed4013-6724-4d30-b403-0a8161fe1652 service glance] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:42:57.518306 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faed4013-6724-4d30-b403-0a8161fe1652 service glance] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:42:57.518577 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faed4013-6724-4d30-b403-0a8161fe1652 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:42:57.520205 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-faed4013-6724-4d30-b403-0a8161fe1652 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:42:57.576454 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=100 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:42:57.634267 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faed4013-6724-4d30-b403-0a8161fe1652 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:42:57.635636 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faed4013-6724-4d30-b403-0a8161fe1652 service glance] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:42:57.654161 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 585/1152] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 30 00:42:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 00:42:59.911273 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26bb866-74bd-464c-8f8a-13931a385a26 None None] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:42:59.911909 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26bb866-74bd-464c-8f8a-13931a385a26 None None] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:42:59.911909 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26bb866-74bd-464c-8f8a-13931a385a26 None None] PATH_INFO: `/` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:42:59.913045 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 568/1153] 10.222.0.42 () {54 vars in 927 bytes} [Sun Oct 30 00:42:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:42:59.918842 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47e7ae5-6277-41ac-aeb5-08d63b6ecd6c None None] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:42:59.919349 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47e7ae5-6277-41ac-aeb5-08d63b6ecd6c None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:42:59.919456 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47e7ae5-6277-41ac-aeb5-08d63b6ecd6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:42:59.986566 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.auth.core [None req-d47e7ae5-6277-41ac-aeb5-08d63b6ecd6c None None] MFA Rules not processed for user `eb55b6cbca4945abb21b0e49eb745e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=87956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:42:59.987794 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-d47e7ae5-6277-41ac-aeb5-08d63b6ecd6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:43:00.087042 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 586/1154] 10.222.0.42 () {58 vars in 1024 bytes} [Sun Oct 30 00:42:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:43:00.362840 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26bb866-74bd-464c-8f8a-13931a385a26 None None] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:43:00.364471 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-e26bb866-74bd-464c-8f8a-13931a385a26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:43:00.499919 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26bb866-74bd-464c-8f8a-13931a385a26 None None] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:43:00.558646 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=100 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:43:00.607735 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f388463a-0a79-4a5b-93ac-8246325fabc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:43:00.608337 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f388463a-0a79-4a5b-93ac-8246325fabc3 admin admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:00.608634 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f388463a-0a79-4a5b-93ac-8246325fabc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:00.608897 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f388463a-0a79-4a5b-93ac-8246325fabc3 admin admin] PATH_INFO: `/v3/projects` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:00.609576 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f388463a-0a79-4a5b-93ac-8246325fabc3 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:43:00.610676 dv-cinder-861491-6-smb devstack@keystone.service[87955]: WARNING py.warnings [None req-f388463a-0a79-4a5b-93ac-8246325fabc3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 30 00:43:00.610676 dv-cinder-861491-6-smb devstack@keystone.service[87955]: warnings.warn(msg) Oct 30 00:43:00.610676 dv-cinder-861491-6-smb devstack@keystone.service[87955]: Oct 30 00:43:00.611834 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f388463a-0a79-4a5b-93ac-8246325fabc3 admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:43:00.632465 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 569/1155] 10.222.0.42 () {56 vars in 1108 bytes} [Sun Oct 30 00:43:00 2022] GET /identity/v3/projects => generated 2553 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 00:43:02.785768 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e99f58a-f6e0-4999-a9eb-d69678f69bef None None] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:02.786664 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e99f58a-f6e0-4999-a9eb-d69678f69bef None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:02.786664 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e99f58a-f6e0-4999-a9eb-d69678f69bef None None] PATH_INFO: `/` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:02.788845 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 587/1156] 10.222.0.42 () {54 vars in 927 bytes} [Sun Oct 30 00:43:02 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:43:02.795091 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbbd3c1-71eb-4165-a04a-aa1c6c4d5b5c None None] REQUEST_METHOD: `POST` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:02.795587 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbbd3c1-71eb-4165-a04a-aa1c6c4d5b5c None None] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:02.795682 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbbd3c1-71eb-4165-a04a-aa1c6c4d5b5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:02.865637 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.auth.core [None req-6fbbd3c1-71eb-4165-a04a-aa1c6c4d5b5c None None] MFA Rules not processed for user `eb55b6cbca4945abb21b0e49eb745e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=87955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:43:02.866841 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-6fbbd3c1-71eb-4165-a04a-aa1c6c4d5b5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:43:02.970311 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 570/1157] 10.222.0.42 () {58 vars in 1024 bytes} [Sun Oct 30 00:43:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:43:03.275769 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e99f58a-f6e0-4999-a9eb-d69678f69bef None None] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:43:03.277702 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-1e99f58a-f6e0-4999-a9eb-d69678f69bef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:43:03.288574 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=100 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:43:03.430314 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e99f58a-f6e0-4999-a9eb-d69678f69bef None None] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:43:03.510676 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=100 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:43:03.544298 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60125a3-8a71-407e-badb-f10f9ecdcfff service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fde877b6ddc74f4a87baf21471eb31d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d2387fdf794d4eaef07bbcd7b39f2a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:43:03.544899 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60125a3-8a71-407e-badb-f10f9ecdcfff service nova] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:03.545168 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60125a3-8a71-407e-badb-f10f9ecdcfff service nova] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:03.545434 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60125a3-8a71-407e-badb-f10f9ecdcfff service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:03.547024 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-e60125a3-8a71-407e-badb-f10f9ecdcfff service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:43:03.649844 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60125a3-8a71-407e-badb-f10f9ecdcfff service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:43:03.651472 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60125a3-8a71-407e-badb-f10f9ecdcfff service nova] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:43:03.669940 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 588/1158] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 30 00:43:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 00:43:05.990637 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314d9978-e3e9-4d0a-aeb4-3b71d939826c None None] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:05.991514 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314d9978-e3e9-4d0a-aeb4-3b71d939826c None None] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:05.991706 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314d9978-e3e9-4d0a-aeb4-3b71d939826c None None] PATH_INFO: `/` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:05.993446 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 571/1159] 10.222.0.42 () {54 vars in 927 bytes} [Sun Oct 30 00:43:05 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:43:05.999080 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783d0880-12b0-4fe6-ae32-ed85ab9af5c6 None None] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:05.999585 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783d0880-12b0-4fe6-ae32-ed85ab9af5c6 None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:05.999683 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783d0880-12b0-4fe6-ae32-ed85ab9af5c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:06.070609 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.auth.core [None req-783d0880-12b0-4fe6-ae32-ed85ab9af5c6 None None] MFA Rules not processed for user `eb55b6cbca4945abb21b0e49eb745e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=87956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:43:06.071909 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-783d0880-12b0-4fe6-ae32-ed85ab9af5c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:43:06.119998 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=100 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:43:06.172785 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 589/1160] 10.222.0.42 () {58 vars in 1024 bytes} [Sun Oct 30 00:43:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:43:06.464221 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314d9978-e3e9-4d0a-aeb4-3b71d939826c None None] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:43:06.466614 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-314d9978-e3e9-4d0a-aeb4-3b71d939826c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:43:06.495874 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=100 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:43:06.579591 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314d9978-e3e9-4d0a-aeb4-3b71d939826c None None] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:43:06.658697 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf68c8d-aba2-4f6e-9801-b5e9081c9194 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5693f186c6ad4d9394f02ee3477cdcd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d2387fdf794d4eaef07bbcd7b39f2a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:43:06.659327 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf68c8d-aba2-4f6e-9801-b5e9081c9194 service neutron] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:06.659607 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf68c8d-aba2-4f6e-9801-b5e9081c9194 service neutron] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:06.659880 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf68c8d-aba2-4f6e-9801-b5e9081c9194 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:06.661486 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-3cf68c8d-aba2-4f6e-9801-b5e9081c9194 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:43:06.742610 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=100 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:43:06.781158 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf68c8d-aba2-4f6e-9801-b5e9081c9194 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:43:06.782618 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf68c8d-aba2-4f6e-9801-b5e9081c9194 service neutron] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:43:06.803837 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 572/1161] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 30 00:43:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 00:43:08.973382 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2f406b-9336-453e-acf5-5c7f33b19858 None None] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:08.974307 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2f406b-9336-453e-acf5-5c7f33b19858 None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:08.974307 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2f406b-9336-453e-acf5-5c7f33b19858 None None] PATH_INFO: `/` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:08.976479 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 590/1162] 10.222.0.42 () {54 vars in 927 bytes} [Sun Oct 30 00:43:08 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:43:08.982817 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5318139c-b655-4c37-acdb-b5cce40c208f None None] REQUEST_METHOD: `POST` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:08.983547 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5318139c-b655-4c37-acdb-b5cce40c208f None None] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:08.983699 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5318139c-b655-4c37-acdb-b5cce40c208f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:09.063978 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.auth.core [None req-5318139c-b655-4c37-acdb-b5cce40c208f None None] MFA Rules not processed for user `eb55b6cbca4945abb21b0e49eb745e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=87955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:43:09.065142 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-5318139c-b655-4c37-acdb-b5cce40c208f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:43:09.180280 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 573/1163] 10.222.0.42 () {58 vars in 1024 bytes} [Sun Oct 30 00:43:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:43:09.466671 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2f406b-9336-453e-acf5-5c7f33b19858 None None] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:43:09.469141 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-6e2f406b-9336-453e-acf5-5c7f33b19858 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:43:09.578511 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2f406b-9336-453e-acf5-5c7f33b19858 None None] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:43:09.650837 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=100 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:43:09.652840 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6907d25-55ed-4db1-bb9e-624b7730ced9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5693f186c6ad4d9394f02ee3477cdcd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d2387fdf794d4eaef07bbcd7b39f2a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:43:09.653555 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6907d25-55ed-4db1-bb9e-624b7730ced9 service neutron] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:09.654073 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6907d25-55ed-4db1-bb9e-624b7730ced9 service neutron] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:09.654355 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6907d25-55ed-4db1-bb9e-624b7730ced9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:09.656544 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-c6907d25-55ed-4db1-bb9e-624b7730ced9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:43:09.777350 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6907d25-55ed-4db1-bb9e-624b7730ced9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:43:09.778791 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6907d25-55ed-4db1-bb9e-624b7730ced9 service neutron] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:43:09.798461 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 591/1164] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 30 00:43:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 00:43:12.121237 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a557c74-aa18-4108-9d25-560e19b6add6 None None] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:12.121790 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a557c74-aa18-4108-9d25-560e19b6add6 None None] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:12.121790 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a557c74-aa18-4108-9d25-560e19b6add6 None None] PATH_INFO: `/` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:12.123118 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 574/1165] 10.222.0.42 () {54 vars in 927 bytes} [Sun Oct 30 00:43:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:43:12.132039 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015036f0-3433-4fa6-8c1e-379a0e1fc9d7 None None] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:12.132765 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015036f0-3433-4fa6-8c1e-379a0e1fc9d7 None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:12.132935 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015036f0-3433-4fa6-8c1e-379a0e1fc9d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:12.207243 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.auth.core [None req-015036f0-3433-4fa6-8c1e-379a0e1fc9d7 None None] MFA Rules not processed for user `eb55b6cbca4945abb21b0e49eb745e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=87956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:43:12.208487 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-015036f0-3433-4fa6-8c1e-379a0e1fc9d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:43:12.266949 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=100 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:43:12.311124 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 592/1166] 10.222.0.42 () {58 vars in 1024 bytes} [Sun Oct 30 00:43:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:43:12.597921 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a557c74-aa18-4108-9d25-560e19b6add6 None None] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:43:12.599542 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-5a557c74-aa18-4108-9d25-560e19b6add6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:43:12.638556 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=100 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:43:12.708547 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a557c74-aa18-4108-9d25-560e19b6add6 None None] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:43:12.785870 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f95cde1-a6f3-4da7-862b-a8135d3bfb30 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5693f186c6ad4d9394f02ee3477cdcd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d2387fdf794d4eaef07bbcd7b39f2a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:43:12.786719 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f95cde1-a6f3-4da7-862b-a8135d3bfb30 service neutron] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:12.787034 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f95cde1-a6f3-4da7-862b-a8135d3bfb30 service neutron] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:12.787425 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f95cde1-a6f3-4da7-862b-a8135d3bfb30 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:12.789959 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-4f95cde1-a6f3-4da7-862b-a8135d3bfb30 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:43:12.879398 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=100 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:43:12.908525 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f95cde1-a6f3-4da7-862b-a8135d3bfb30 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:43:12.909957 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f95cde1-a6f3-4da7-862b-a8135d3bfb30 service neutron] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:43:12.927982 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 575/1167] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 30 00:43:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 00:43:15.351652 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034b2879-4f48-4db6-9eb0-9d4286648251 None None] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:15.352535 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034b2879-4f48-4db6-9eb0-9d4286648251 None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:15.352535 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034b2879-4f48-4db6-9eb0-9d4286648251 None None] PATH_INFO: `/` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:15.353920 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 593/1168] 10.222.0.42 () {54 vars in 927 bytes} [Sun Oct 30 00:43:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:43:15.360007 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804210cf-2276-4c2c-b761-0251f6fe1ccb None None] REQUEST_METHOD: `POST` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:15.360480 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804210cf-2276-4c2c-b761-0251f6fe1ccb None None] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:15.360572 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804210cf-2276-4c2c-b761-0251f6fe1ccb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:15.448594 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.auth.core [None req-804210cf-2276-4c2c-b761-0251f6fe1ccb None None] MFA Rules not processed for user `eb55b6cbca4945abb21b0e49eb745e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=87955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:43:15.449821 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-804210cf-2276-4c2c-b761-0251f6fe1ccb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:43:15.554578 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 576/1169] 10.222.0.42 () {58 vars in 1024 bytes} [Sun Oct 30 00:43:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:43:15.854241 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034b2879-4f48-4db6-9eb0-9d4286648251 None None] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:43:15.856766 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-034b2879-4f48-4db6-9eb0-9d4286648251 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:43:15.966902 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034b2879-4f48-4db6-9eb0-9d4286648251 None None] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:43:16.048700 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d027249-ec6d-4019-a9c9-6f4903639382 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5693f186c6ad4d9394f02ee3477cdcd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d2387fdf794d4eaef07bbcd7b39f2a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:43:16.049316 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d027249-ec6d-4019-a9c9-6f4903639382 service neutron] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:43:16.049595 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d027249-ec6d-4019-a9c9-6f4903639382 service neutron] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:43:16.049866 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d027249-ec6d-4019-a9c9-6f4903639382 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:43:16.051510 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-7d027249-ec6d-4019-a9c9-6f4903639382 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:43:16.061186 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=100 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:43:16.170052 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d027249-ec6d-4019-a9c9-6f4903639382 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:43:16.171437 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d027249-ec6d-4019-a9c9-6f4903639382 service neutron] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:43:16.189973 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 594/1170] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 30 00:43:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 00:43:25.553005 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=82 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:43:26.187758 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=50 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:44:33.762127 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262257e7-c53c-47fc-9326-cd4b838eaa21 None None] REQUEST_METHOD: `POST` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:44:33.762755 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262257e7-c53c-47fc-9326-cd4b838eaa21 None None] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:44:33.762755 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262257e7-c53c-47fc-9326-cd4b838eaa21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:44:33.841352 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.auth.core [None req-262257e7-c53c-47fc-9326-cd4b838eaa21 None None] MFA Rules not processed for user `eb55b6cbca4945abb21b0e49eb745e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=87955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:44:33.842547 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-262257e7-c53c-47fc-9326-cd4b838eaa21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:44:33.946678 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 577/1171] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 30 00:44:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:44:33.959040 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b1e653-ab40-4b58-a1f5-ec1bd8239350 None None] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:44:33.959579 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b1e653-ab40-4b58-a1f5-ec1bd8239350 None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:44:33.959579 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b1e653-ab40-4b58-a1f5-ec1bd8239350 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:44:34.043759 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.auth.core [None req-49b1e653-ab40-4b58-a1f5-ec1bd8239350 None None] MFA Rules not processed for user `eb55b6cbca4945abb21b0e49eb745e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=87956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:44:34.045020 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-49b1e653-ab40-4b58-a1f5-ec1bd8239350 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:44:34.146397 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 595/1172] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 30 00:44:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:44:34.151285 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262257e7-c53c-47fc-9326-cd4b838eaa21 None None] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:44:34.152524 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-262257e7-c53c-47fc-9326-cd4b838eaa21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:44:34.164281 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262257e7-c53c-47fc-9326-cd4b838eaa21 None None] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:44:34.232630 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=100 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:44:34.268160 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438017e1-567a-4c4d-9ca3-8e97c929ff74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:44:34.268776 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438017e1-567a-4c4d-9ca3-8e97c929ff74 admin admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:44:34.269053 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438017e1-567a-4c4d-9ca3-8e97c929ff74 admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:44:34.269324 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438017e1-567a-4c4d-9ca3-8e97c929ff74 admin admin] PATH_INFO: `/v3/domains` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:44:34.270168 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438017e1-567a-4c4d-9ca3-8e97c929ff74 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:44:34.270471 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438017e1-567a-4c4d-9ca3-8e97c929ff74 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:44:34.271645 dv-cinder-861491-6-smb devstack@keystone.service[87955]: WARNING py.warnings [None req-438017e1-567a-4c4d-9ca3-8e97c929ff74 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 30 00:44:34.271645 dv-cinder-861491-6-smb devstack@keystone.service[87955]: warnings.warn(msg) Oct 30 00:44:34.271645 dv-cinder-861491-6-smb devstack@keystone.service[87955]: Oct 30 00:44:34.272532 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438017e1-567a-4c4d-9ca3-8e97c929ff74 admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:44:34.284716 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 578/1173] 10.222.0.42 () {58 vars in 1153 bytes} [Sun Oct 30 00:44:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:44:34.294477 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b1e653-ab40-4b58-a1f5-ec1bd8239350 None None] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:44:34.304143 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b1e653-ab40-4b58-a1f5-ec1bd8239350 None None] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:44:34.378230 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=100 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:44:34.412305 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab7da50-613b-4776-a4a3-0c377bf2ecc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:44:34.412928 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab7da50-613b-4776-a4a3-0c377bf2ecc7 admin admin] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:44:34.413208 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab7da50-613b-4776-a4a3-0c377bf2ecc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:44:34.413476 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab7da50-613b-4776-a4a3-0c377bf2ecc7 admin admin] PATH_INFO: `/v3/projects` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:44:34.414142 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab7da50-613b-4776-a4a3-0c377bf2ecc7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:44:34.415242 dv-cinder-861491-6-smb devstack@keystone.service[87956]: WARNING py.warnings [None req-9ab7da50-613b-4776-a4a3-0c377bf2ecc7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 30 00:44:34.415242 dv-cinder-861491-6-smb devstack@keystone.service[87956]: warnings.warn(msg) Oct 30 00:44:34.415242 dv-cinder-861491-6-smb devstack@keystone.service[87956]: Oct 30 00:44:34.416453 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab7da50-613b-4776-a4a3-0c377bf2ecc7 admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:44:34.475258 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 596/1174] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 30 00:44:34 2022] POST /identity/v3/projects => generated 377 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 00:44:34.479703 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438017e1-567a-4c4d-9ca3-8e97c929ff74 admin admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:44:34.481243 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-438017e1-567a-4c4d-9ca3-8e97c929ff74 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:44:34.515239 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438017e1-567a-4c4d-9ca3-8e97c929ff74 admin admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:44:34.613694 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e98968c-ecf1-4449-bd76-76983c6bf1cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:44:34.614280 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e98968c-ecf1-4449-bd76-76983c6bf1cd admin admin] REQUEST_METHOD: `POST` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:44:34.614586 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e98968c-ecf1-4449-bd76-76983c6bf1cd admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:44:34.614857 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e98968c-ecf1-4449-bd76-76983c6bf1cd admin admin] PATH_INFO: `/v3/users` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:44:34.615540 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e98968c-ecf1-4449-bd76-76983c6bf1cd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:44:34.616560 dv-cinder-861491-6-smb devstack@keystone.service[87955]: WARNING py.warnings [None req-1e98968c-ecf1-4449-bd76-76983c6bf1cd admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 30 00:44:34.616560 dv-cinder-861491-6-smb devstack@keystone.service[87955]: warnings.warn(msg) Oct 30 00:44:34.616560 dv-cinder-861491-6-smb devstack@keystone.service[87955]: Oct 30 00:44:34.617773 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e98968c-ecf1-4449-bd76-76983c6bf1cd admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:44:34.664127 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 579/1175] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 30 00:44:34 2022] POST /identity/v3/users => generated 289 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 00:44:34.668537 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab7da50-613b-4776-a4a3-0c377bf2ecc7 admin admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:44:34.670148 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-9ab7da50-613b-4776-a4a3-0c377bf2ecc7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:44:34.738387 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab7da50-613b-4776-a4a3-0c377bf2ecc7 admin admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:44:34.826980 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:44:34.839547 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b978db9-72ae-4825-9094-ac914a5c1c2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:44:34.840168 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b978db9-72ae-4825-9094-ac914a5c1c2d admin admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:44:34.840446 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b978db9-72ae-4825-9094-ac914a5c1c2d admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:44:34.840718 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b978db9-72ae-4825-9094-ac914a5c1c2d admin admin] PATH_INFO: `/v3/roles` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:44:34.841396 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b978db9-72ae-4825-9094-ac914a5c1c2d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:44:34.843024 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b978db9-72ae-4825-9094-ac914a5c1c2d admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:44:34.855948 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 597/1176] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 30 00:44:34 2022] GET /identity/v3/roles => generated 1420 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 00:44:34.862105 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e98968c-ecf1-4449-bd76-76983c6bf1cd admin admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:44:34.864410 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-1e98968c-ecf1-4449-bd76-76983c6bf1cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:44:34.881681 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e98968c-ecf1-4449-bd76-76983c6bf1cd admin admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:44:34.908966 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:44:34.982718 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb60429-fa4f-4020-a3dd-581cfc35f23c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:44:34.983344 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb60429-fa4f-4020-a3dd-581cfc35f23c admin admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:44:34.983619 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb60429-fa4f-4020-a3dd-581cfc35f23c admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:44:34.983885 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb60429-fa4f-4020-a3dd-581cfc35f23c admin admin] PATH_INFO: `/v3/roles` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:44:34.984523 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb60429-fa4f-4020-a3dd-581cfc35f23c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:44:34.986121 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb60429-fa4f-4020-a3dd-581cfc35f23c admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:44:34.998294 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 580/1177] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 30 00:44:34 2022] GET /identity/v3/roles => generated 1420 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 00:44:35.003264 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b978db9-72ae-4825-9094-ac914a5c1c2d admin admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:44:35.005432 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-9b978db9-72ae-4825-9094-ac914a5c1c2d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:44:35.043346 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b978db9-72ae-4825-9094-ac914a5c1c2d admin admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:44:35.140937 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec1f42b-2868-4ebd-9bd0-de8329906b39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:44:35.141510 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec1f42b-2868-4ebd-9bd0-de8329906b39 admin admin] REQUEST_METHOD: `PUT` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:44:35.141779 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec1f42b-2868-4ebd-9bd0-de8329906b39 admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:44:35.142018 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec1f42b-2868-4ebd-9bd0-de8329906b39 admin admin] PATH_INFO: `/v3/projects/0bc54c27fafd41588760f7f3820ed96b/users/b66f38f2179f472e9ad000d2655d105c/roles/1c93019874174c4b91118d9ce2347e47` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:44:35.164912 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec1f42b-2868-4ebd-9bd0-de8329906b39 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0bc54c27fafd41588760f7f3820ed96b, user_id=b66f38f2179f472e9ad000d2655d105c, role_id=1c93019874174c4b91118d9ce2347e47)` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:44:35.167579 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec1f42b-2868-4ebd-9bd0-de8329906b39 admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:44:35.194489 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 598/1178] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 30 00:44:35 2022] PUT /identity/v3/projects/0bc54c27fafd41588760f7f3820ed96b/users/b66f38f2179f472e9ad000d2655d105c/roles/1c93019874174c4b91118d9ce2347e47 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 00:44:35.205781 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49af557-a4fa-4c87-b15e-2eb30b70023e None None] REQUEST_METHOD: `POST` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:44:35.206062 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49af557-a4fa-4c87-b15e-2eb30b70023e None None] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:44:35.206334 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49af557-a4fa-4c87-b15e-2eb30b70023e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:44:35.268195 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.auth.core [None req-c49af557-a4fa-4c87-b15e-2eb30b70023e None None] MFA Rules not processed for user `b66f38f2179f472e9ad000d2655d105c`. Rule list: `[]` (Enabled: `True`). {{(pid=87955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:44:35.269387 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-c49af557-a4fa-4c87-b15e-2eb30b70023e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:44:35.353264 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 581/1179] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 30 00:44:35 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:44:35.367131 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c449633c-f17d-4ab2-add4-ae146e8d576a None None] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:44:35.367449 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c449633c-f17d-4ab2-add4-ae146e8d576a None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:44:35.367719 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c449633c-f17d-4ab2-add4-ae146e8d576a None None] PATH_INFO: `/` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:44:35.369083 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 599/1180] 10.222.0.42 () {54 vars in 963 bytes} [Sun Oct 30 00:44:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:44:35.374089 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bd415b-7ece-48f8-a593-b75f869cc9c7 None None] REQUEST_METHOD: `POST` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:44:35.374372 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bd415b-7ece-48f8-a593-b75f869cc9c7 None None] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:44:35.374650 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bd415b-7ece-48f8-a593-b75f869cc9c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:44:35.408522 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=100 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:44:35.452784 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.auth.core [None req-81bd415b-7ece-48f8-a593-b75f869cc9c7 None None] MFA Rules not processed for user `48d928ff7fe24348ac900f09c56acc20`. Rule list: `[]` (Enabled: `True`). {{(pid=87955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:44:35.453992 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-81bd415b-7ece-48f8-a593-b75f869cc9c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:44:35.531408 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 582/1181] 10.222.0.42 () {58 vars in 1060 bytes} [Sun Oct 30 00:44:35 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:44:35.539506 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c449633c-f17d-4ab2-add4-ae146e8d576a None None] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:44:35.541035 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-c449633c-f17d-4ab2-add4-ae146e8d576a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:44:35.597468 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:44:35.654311 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c449633c-f17d-4ab2-add4-ae146e8d576a None None] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:44:35.734337 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd868ef-545c-4440-83ac-ed3ef5b410f0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48d928ff7fe24348ac900f09c56acc20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d2387fdf794d4eaef07bbcd7b39f2a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:44:35.734887 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd868ef-545c-4440-83ac-ed3ef5b410f0 service cinder] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:44:35.735161 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd868ef-545c-4440-83ac-ed3ef5b410f0 service cinder] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:44:35.735466 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd868ef-545c-4440-83ac-ed3ef5b410f0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:44:35.737153 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-9bd868ef-545c-4440-83ac-ed3ef5b410f0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:44:35.853429 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd868ef-545c-4440-83ac-ed3ef5b410f0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:44:35.854875 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd868ef-545c-4440-83ac-ed3ef5b410f0 service cinder] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:44:35.858347 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=100 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:44:35.874430 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 600/1182] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 30 00:44:35 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 00:44:35.920924 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e7e82e-199c-4aa7-a144-5a8cdd96f417 None None] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:44:35.921387 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e7e82e-199c-4aa7-a144-5a8cdd96f417 None None] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:44:35.921493 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e7e82e-199c-4aa7-a144-5a8cdd96f417 None None] PATH_INFO: `/` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:44:35.923264 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 583/1183] 10.222.0.42 () {52 vars in 830 bytes} [Sun Oct 30 00:44:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:44:35.928387 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd868ef-545c-4440-83ac-ed3ef5b410f0 service cinder] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:44:35.929670 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-9bd868ef-545c-4440-83ac-ed3ef5b410f0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:44:36.045019 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd868ef-545c-4440-83ac-ed3ef5b410f0 service cinder] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:44:36.144199 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f549e5fd-fa77-4363-9f36-1f09b4e99352 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:44:36.144830 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f549e5fd-fa77-4363-9f36-1f09b4e99352 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:44:36.145102 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f549e5fd-fa77-4363-9f36-1f09b4e99352 admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:44:36.145366 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f549e5fd-fa77-4363-9f36-1f09b4e99352 admin admin] PATH_INFO: `/v3/users/b66f38f2179f472e9ad000d2655d105c` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:44:36.158509 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f549e5fd-fa77-4363-9f36-1f09b4e99352 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b66f38f2179f472e9ad000d2655d105c)` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:44:36.159579 dv-cinder-861491-6-smb devstack@keystone.service[87956]: WARNING py.warnings [None req-f549e5fd-fa77-4363-9f36-1f09b4e99352 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 30 00:44:36.159579 dv-cinder-861491-6-smb devstack@keystone.service[87956]: warnings.warn(msg) Oct 30 00:44:36.159579 dv-cinder-861491-6-smb devstack@keystone.service[87956]: Oct 30 00:44:36.160756 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f549e5fd-fa77-4363-9f36-1f09b4e99352 admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:44:36.170842 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=100 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:44:36.234544 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-f549e5fd-fa77-4363-9f36-1f09b4e99352 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b66f38f2179f472e9ad000d2655d105c'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:44:36.234968 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-f549e5fd-fa77-4363-9f36-1f09b4e99352 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b66f38f2179f472e9ad000d2655d105c'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:44:36.258042 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-f549e5fd-fa77-4363-9f36-1f09b4e99352 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b66f38f2179f472e9ad000d2655d105c'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:44:36.270360 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-f549e5fd-fa77-4363-9f36-1f09b4e99352 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b66f38f2179f472e9ad000d2655d105c'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:44:36.291163 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-f549e5fd-fa77-4363-9f36-1f09b4e99352 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b66f38f2179f472e9ad000d2655d105c'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:44:36.298773 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 601/1184] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 30 00:44:35 2022] DELETE /identity/v3/users/b66f38f2179f472e9ad000d2655d105c => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 00:44:36.303536 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08faa07f-c3c6-4825-ba41-bc43e7740c91 None None] REQUEST_METHOD: `POST` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:44:36.303887 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08faa07f-c3c6-4825-ba41-bc43e7740c91 None None] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:44:36.304162 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08faa07f-c3c6-4825-ba41-bc43e7740c91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:44:36.361256 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.auth.core [None req-08faa07f-c3c6-4825-ba41-bc43e7740c91 None None] MFA Rules not processed for user `eb55b6cbca4945abb21b0e49eb745e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=87955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:44:36.362463 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-08faa07f-c3c6-4825-ba41-bc43e7740c91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:44:36.438111 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=100 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:44:36.451255 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 584/1185] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 30 00:44:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:44:36.461293 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f549e5fd-fa77-4363-9f36-1f09b4e99352 admin admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:44:36.462598 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-f549e5fd-fa77-4363-9f36-1f09b4e99352 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:44:36.587194 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f549e5fd-fa77-4363-9f36-1f09b4e99352 admin admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:44:36.645921 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:44:36.668178 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c3f82c-0726-48e6-9df2-6c5de38fa5a9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5693f186c6ad4d9394f02ee3477cdcd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d2387fdf794d4eaef07bbcd7b39f2a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:44:36.668794 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c3f82c-0726-48e6-9df2-6c5de38fa5a9 service neutron] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:44:36.669064 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c3f82c-0726-48e6-9df2-6c5de38fa5a9 service neutron] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:44:36.669327 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c3f82c-0726-48e6-9df2-6c5de38fa5a9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:44:36.670948 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-37c3f82c-0726-48e6-9df2-6c5de38fa5a9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:44:36.785128 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c3f82c-0726-48e6-9df2-6c5de38fa5a9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:44:36.786568 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c3f82c-0726-48e6-9df2-6c5de38fa5a9 service neutron] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:44:36.806061 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 602/1186] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 30 00:44:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 00:44:37.177842 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08faa07f-c3c6-4825-ba41-bc43e7740c91 None None] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:44:37.179083 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-08faa07f-c3c6-4825-ba41-bc43e7740c91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:44:37.190874 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08faa07f-c3c6-4825-ba41-bc43e7740c91 None None] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:44:37.288207 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ec34f8-f9bd-4193-aa70-830740b7e4dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:44:37.288840 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ec34f8-f9bd-4193-aa70-830740b7e4dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:44:37.289114 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ec34f8-f9bd-4193-aa70-830740b7e4dc admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:44:37.289385 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ec34f8-f9bd-4193-aa70-830740b7e4dc admin admin] PATH_INFO: `/v3/projects/0bc54c27fafd41588760f7f3820ed96b` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:44:37.300040 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ec34f8-f9bd-4193-aa70-830740b7e4dc admin admin] RBAC: Authorizing `identity:delete_project(project_id=0bc54c27fafd41588760f7f3820ed96b)` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:44:37.301076 dv-cinder-861491-6-smb devstack@keystone.service[87955]: WARNING py.warnings [None req-b0ec34f8-f9bd-4193-aa70-830740b7e4dc admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 30 00:44:37.301076 dv-cinder-861491-6-smb devstack@keystone.service[87955]: warnings.warn(msg) Oct 30 00:44:37.301076 dv-cinder-861491-6-smb devstack@keystone.service[87955]: Oct 30 00:44:37.302273 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ec34f8-f9bd-4193-aa70-830740b7e4dc admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:44:37.365501 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-b0ec34f8-f9bd-4193-aa70-830740b7e4dc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0bc54c27fafd41588760f7f3820ed96b', 'request_id': 'req-b0ec34f8-f9bd-4193-aa70-830740b7e4dc'} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:44:37.373024 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-b0ec34f8-f9bd-4193-aa70-830740b7e4dc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0bc54c27fafd41588760f7f3820ed96b', 'request_id': 'req-b0ec34f8-f9bd-4193-aa70-830740b7e4dc'} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:44:37.384529 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-b0ec34f8-f9bd-4193-aa70-830740b7e4dc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0bc54c27fafd41588760f7f3820ed96b', 'request_id': 'req-b0ec34f8-f9bd-4193-aa70-830740b7e4dc'} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:44:37.415478 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-b0ec34f8-f9bd-4193-aa70-830740b7e4dc admin admin] The token cache is being invalidate because project 0bc54c27fafd41588760f7f3820ed96b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87955) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 00:44:37.415934 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-b0ec34f8-f9bd-4193-aa70-830740b7e4dc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:44:37.418107 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-b0ec34f8-f9bd-4193-aa70-830740b7e4dc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:44:37.418237 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 585/1187] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 30 00:44:37 2022] DELETE /identity/v3/projects/0bc54c27fafd41588760f7f3820ed96b => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 00:44:46.803454 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=62 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:44:47.413251 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:46:16.313777 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96f5008-3008-4957-8f95-ea6010b70f88 None None] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:46:16.314410 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96f5008-3008-4957-8f95-ea6010b70f88 None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:46:16.314410 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96f5008-3008-4957-8f95-ea6010b70f88 None None] PATH_INFO: `/` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:46:16.315742 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 603/1188] 127.0.0.1 () {54 vars in 901 bytes} [Sun Oct 30 00:46:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:46:16.321524 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd3e8e4-a7f7-499f-bda4-534176733c6d None None] REQUEST_METHOD: `POST` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:46:16.321973 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd3e8e4-a7f7-499f-bda4-534176733c6d None None] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:46:16.321973 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd3e8e4-a7f7-499f-bda4-534176733c6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:46:16.412119 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.auth.core [None req-dfd3e8e4-a7f7-499f-bda4-534176733c6d None None] MFA Rules not processed for user `eb55b6cbca4945abb21b0e49eb745e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=87955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:46:16.413339 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-dfd3e8e4-a7f7-499f-bda4-534176733c6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:46:16.526209 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 586/1189] 127.0.0.1 () {58 vars in 998 bytes} [Sun Oct 30 00:46:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:46:16.679902 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96f5008-3008-4957-8f95-ea6010b70f88 None None] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:46:16.682255 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-d96f5008-3008-4957-8f95-ea6010b70f88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:46:16.813885 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96f5008-3008-4957-8f95-ea6010b70f88 None None] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:46:16.819948 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8905c96-46b1-4021-96de-d05c18acc83e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fde877b6ddc74f4a87baf21471eb31d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d2387fdf794d4eaef07bbcd7b39f2a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:46:16.820554 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8905c96-46b1-4021-96de-d05c18acc83e service nova] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:46:16.820824 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8905c96-46b1-4021-96de-d05c18acc83e service nova] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:46:16.821091 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8905c96-46b1-4021-96de-d05c18acc83e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:46:16.829611 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8905c96-46b1-4021-96de-d05c18acc83e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:46:16.831216 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8905c96-46b1-4021-96de-d05c18acc83e service nova] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:46:16.840646 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 604/1190] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 30 00:46:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 00:46:17.744176 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e862ea-9d24-44c0-93d4-498ffe696ebc None None] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:46:17.744779 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e862ea-9d24-44c0-93d4-498ffe696ebc None None] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:46:17.744779 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e862ea-9d24-44c0-93d4-498ffe696ebc None None] PATH_INFO: `/v3` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:46:17.746417 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 587/1191] 10.222.0.45 () {54 vars in 925 bytes} [Sun Oct 30 00:46:17 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:46:17.752503 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c8a197-180c-45e4-841b-95e835702036 None None] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:46:17.752966 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c8a197-180c-45e4-841b-95e835702036 None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:46:17.753069 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c8a197-180c-45e4-841b-95e835702036 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:46:17.815024 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.auth.core [None req-43c8a197-180c-45e4-841b-95e835702036 None None] MFA Rules not processed for user `202b8b2c0f454297bfb97c1ac4033625`. Rule list: `[]` (Enabled: `True`). {{(pid=87956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:46:17.816241 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-43c8a197-180c-45e4-841b-95e835702036 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:46:17.889278 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=100 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:46:17.894526 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 605/1192] 10.222.0.45 () {58 vars in 1015 bytes} [Sun Oct 30 00:46:17 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:46:17.919841 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6480f5ca-c955-4f11-ba95-7383175310f9 None None] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:46:17.920119 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6480f5ca-c955-4f11-ba95-7383175310f9 None None] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:46:17.920383 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6480f5ca-c955-4f11-ba95-7383175310f9 None None] PATH_INFO: `/` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:46:17.921723 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 588/1193] 127.0.0.1 () {54 vars in 901 bytes} [Sun Oct 30 00:46:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:46:17.926298 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c34f72b-6d6c-4509-bdae-bfff5991a92b None None] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:46:17.926581 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c34f72b-6d6c-4509-bdae-bfff5991a92b None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:46:17.926850 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c34f72b-6d6c-4509-bdae-bfff5991a92b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:46:17.946666 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.auth.core [None req-5c34f72b-6d6c-4509-bdae-bfff5991a92b None None] MFA Rules not processed for user `eb55b6cbca4945abb21b0e49eb745e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=87956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:46:17.947888 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-5c34f72b-6d6c-4509-bdae-bfff5991a92b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:46:17.956178 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 606/1194] 127.0.0.1 () {58 vars in 998 bytes} [Sun Oct 30 00:46:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:46:18.108716 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6480f5ca-c955-4f11-ba95-7383175310f9 None None] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:46:18.127480 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6480f5ca-c955-4f11-ba95-7383175310f9 None None] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:46:18.134139 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484f0c68-b496-4c0c-83e7-6677f61a563c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fde877b6ddc74f4a87baf21471eb31d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d2387fdf794d4eaef07bbcd7b39f2a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:46:18.134734 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484f0c68-b496-4c0c-83e7-6677f61a563c service nova] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:46:18.135009 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484f0c68-b496-4c0c-83e7-6677f61a563c service nova] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:46:18.135311 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484f0c68-b496-4c0c-83e7-6677f61a563c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:46:18.143971 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484f0c68-b496-4c0c-83e7-6677f61a563c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:46:18.145554 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484f0c68-b496-4c0c-83e7-6677f61a563c service nova] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:46:18.155350 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 589/1195] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 30 00:46:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 00:46:27.941645 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=4 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:46:28.150909 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=75 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:46:28.751840 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc4eeb7-6f49-4a6e-89da-7ad7e2227db1 None None] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:46:28.752123 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc4eeb7-6f49-4a6e-89da-7ad7e2227db1 None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:46:28.752388 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc4eeb7-6f49-4a6e-89da-7ad7e2227db1 None None] PATH_INFO: `/` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:46:28.753739 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 607/1196] 10.222.0.42 () {54 vars in 961 bytes} [Sun Oct 30 00:46:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:46:28.758716 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780f1b60-7d33-4ec1-be29-e098bb01d044 None None] REQUEST_METHOD: `POST` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:46:28.759313 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780f1b60-7d33-4ec1-be29-e098bb01d044 None None] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:46:28.759585 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780f1b60-7d33-4ec1-be29-e098bb01d044 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:46:28.780198 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.auth.core [None req-780f1b60-7d33-4ec1-be29-e098bb01d044 None None] MFA Rules not processed for user `202b8b2c0f454297bfb97c1ac4033625`. Rule list: `[]` (Enabled: `True`). {{(pid=87955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:46:28.781438 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-780f1b60-7d33-4ec1-be29-e098bb01d044 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:46:28.791131 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 590/1197] 10.222.0.42 () {58 vars in 1058 bytes} [Sun Oct 30 00:46:28 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:46:28.798805 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc4eeb7-6f49-4a6e-89da-7ad7e2227db1 None None] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:46:28.813308 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc4eeb7-6f49-4a6e-89da-7ad7e2227db1 None None] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:46:28.818790 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c229e5de-6840-4453-babd-1dee9b39df5f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '202b8b2c0f454297bfb97c1ac4033625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d2387fdf794d4eaef07bbcd7b39f2a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:46:28.819418 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c229e5de-6840-4453-babd-1dee9b39df5f service placement] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:46:28.819693 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c229e5de-6840-4453-babd-1dee9b39df5f service placement] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:46:28.819964 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c229e5de-6840-4453-babd-1dee9b39df5f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:46:28.828917 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c229e5de-6840-4453-babd-1dee9b39df5f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:46:28.830496 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c229e5de-6840-4453-babd-1dee9b39df5f service placement] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:46:28.840676 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 608/1198] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 30 00:46:28 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 00:46:29.640701 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7b415e-2145-45e4-84ae-b1854080cae6 None None] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:46:29.641235 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7b415e-2145-45e4-84ae-b1854080cae6 None None] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:46:29.641235 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7b415e-2145-45e4-84ae-b1854080cae6 None None] PATH_INFO: `/` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:46:29.642538 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 591/1199] 127.0.0.1 () {54 vars in 901 bytes} [Sun Oct 30 00:46:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:46:29.647689 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf4a324-caf5-49e9-a884-270799b4912b None None] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:46:29.648107 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf4a324-caf5-49e9-a884-270799b4912b None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:46:29.648220 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf4a324-caf5-49e9-a884-270799b4912b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:46:29.669868 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.auth.core [None req-faf4a324-caf5-49e9-a884-270799b4912b None None] MFA Rules not processed for user `eb55b6cbca4945abb21b0e49eb745e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=87956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:46:29.671081 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-faf4a324-caf5-49e9-a884-270799b4912b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:46:29.680166 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 609/1200] 127.0.0.1 () {58 vars in 998 bytes} [Sun Oct 30 00:46:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:46:29.831224 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7b415e-2145-45e4-84ae-b1854080cae6 None None] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:46:29.847153 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7b415e-2145-45e4-84ae-b1854080cae6 None None] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:46:29.853547 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d09c59-bd03-42bd-b144-f2973d4abe57 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fde877b6ddc74f4a87baf21471eb31d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d2387fdf794d4eaef07bbcd7b39f2a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:46:29.854135 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d09c59-bd03-42bd-b144-f2973d4abe57 service nova] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:46:29.854406 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d09c59-bd03-42bd-b144-f2973d4abe57 service nova] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:46:29.854676 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d09c59-bd03-42bd-b144-f2973d4abe57 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:46:29.862616 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d09c59-bd03-42bd-b144-f2973d4abe57 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:46:29.864217 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d09c59-bd03-42bd-b144-f2973d4abe57 service nova] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:46:29.873400 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 592/1201] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 30 00:46:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 00:46:30.940798 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f824916-9843-4ece-abba-725755e5c60c None None] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:46:30.941671 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f824916-9843-4ece-abba-725755e5c60c None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:46:30.941671 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f824916-9843-4ece-abba-725755e5c60c None None] PATH_INFO: `/` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:46:30.943945 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 610/1202] 127.0.0.1 () {54 vars in 901 bytes} [Sun Oct 30 00:46:30 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:46:30.952104 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1027491-7f60-422d-97c6-dc9c7fd45b4c None None] REQUEST_METHOD: `POST` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:46:30.952795 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1027491-7f60-422d-97c6-dc9c7fd45b4c None None] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:46:30.952942 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1027491-7f60-422d-97c6-dc9c7fd45b4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:46:30.976792 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.auth.core [None req-e1027491-7f60-422d-97c6-dc9c7fd45b4c None None] MFA Rules not processed for user `eb55b6cbca4945abb21b0e49eb745e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=87955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:46:30.977997 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-e1027491-7f60-422d-97c6-dc9c7fd45b4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:46:30.986172 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 593/1203] 127.0.0.1 () {58 vars in 998 bytes} [Sun Oct 30 00:46:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:46:31.135886 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f824916-9843-4ece-abba-725755e5c60c None None] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:46:31.153193 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f824916-9843-4ece-abba-725755e5c60c None None] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:46:31.160001 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a781e7dd-0e51-4a0c-8021-c55437c1bed5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fde877b6ddc74f4a87baf21471eb31d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d2387fdf794d4eaef07bbcd7b39f2a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:46:31.160587 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a781e7dd-0e51-4a0c-8021-c55437c1bed5 service nova] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:46:31.160858 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a781e7dd-0e51-4a0c-8021-c55437c1bed5 service nova] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:46:31.161107 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a781e7dd-0e51-4a0c-8021-c55437c1bed5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:46:31.170102 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a781e7dd-0e51-4a0c-8021-c55437c1bed5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:46:31.171709 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a781e7dd-0e51-4a0c-8021-c55437c1bed5 service nova] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:46:31.181223 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 611/1204] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 30 00:46:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 00:46:35.397806 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f01f93-8399-4cc1-909a-dcd2b2c5adbb None None] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:46:35.398655 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f01f93-8399-4cc1-909a-dcd2b2c5adbb None None] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:46:35.398655 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f01f93-8399-4cc1-909a-dcd2b2c5adbb None None] PATH_INFO: `/` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:46:35.400500 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 594/1205] 127.0.0.1 () {54 vars in 917 bytes} [Sun Oct 30 00:46:35 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:46:35.406111 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ffa04d-b7ed-480a-99bb-686582f50731 None None] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:46:35.406564 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ffa04d-b7ed-480a-99bb-686582f50731 None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:46:35.406672 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ffa04d-b7ed-480a-99bb-686582f50731 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:46:35.427137 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.auth.core [None req-e3ffa04d-b7ed-480a-99bb-686582f50731 None None] MFA Rules not processed for user `eb55b6cbca4945abb21b0e49eb745e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=87956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:46:35.428350 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-e3ffa04d-b7ed-480a-99bb-686582f50731 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:46:35.436839 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 612/1206] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Oct 30 00:46:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:46:35.724295 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f01f93-8399-4cc1-909a-dcd2b2c5adbb None None] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:46:35.728009 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-65f01f93-8399-4cc1-909a-dcd2b2c5adbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:46:35.816107 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f01f93-8399-4cc1-909a-dcd2b2c5adbb None None] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:46:35.820015 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cfd4c8-ab29-4709-a87d-71e753faa610 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5693f186c6ad4d9394f02ee3477cdcd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d2387fdf794d4eaef07bbcd7b39f2a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:46:35.820612 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cfd4c8-ab29-4709-a87d-71e753faa610 service neutron] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:46:35.820885 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cfd4c8-ab29-4709-a87d-71e753faa610 service neutron] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:46:35.821146 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cfd4c8-ab29-4709-a87d-71e753faa610 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:46:35.830105 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16cfd4c8-ab29-4709-a87d-71e753faa610 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:46:35.831570 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16cfd4c8-ab29-4709-a87d-71e753faa610 service neutron] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:46:35.841080 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 595/1207] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 30 00:46:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 00:46:37.951708 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17f4ed2-05b4-4a29-9d17-81409ebb01f6 None None] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:46:37.952606 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17f4ed2-05b4-4a29-9d17-81409ebb01f6 None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:46:37.952606 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17f4ed2-05b4-4a29-9d17-81409ebb01f6 None None] PATH_INFO: `/` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:46:37.954763 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 613/1208] 127.0.0.1 () {54 vars in 917 bytes} [Sun Oct 30 00:46:37 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:46:37.960991 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a0c6d8-ab20-448c-aeca-84462fea111f None None] REQUEST_METHOD: `POST` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:46:37.961703 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a0c6d8-ab20-448c-aeca-84462fea111f None None] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:46:37.961855 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a0c6d8-ab20-448c-aeca-84462fea111f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:46:37.983349 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.auth.core [None req-f1a0c6d8-ab20-448c-aeca-84462fea111f None None] MFA Rules not processed for user `eb55b6cbca4945abb21b0e49eb745e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=87955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:46:37.984556 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-f1a0c6d8-ab20-448c-aeca-84462fea111f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:46:37.993589 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 596/1209] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Oct 30 00:46:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:46:38.279848 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17f4ed2-05b4-4a29-9d17-81409ebb01f6 None None] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:46:38.296038 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17f4ed2-05b4-4a29-9d17-81409ebb01f6 None None] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:46:38.300534 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140a3dd2-983f-417f-a435-943cd0d0e75e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5693f186c6ad4d9394f02ee3477cdcd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d2387fdf794d4eaef07bbcd7b39f2a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:46:38.300953 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140a3dd2-983f-417f-a435-943cd0d0e75e service neutron] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:46:38.301223 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140a3dd2-983f-417f-a435-943cd0d0e75e service neutron] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:46:38.301493 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140a3dd2-983f-417f-a435-943cd0d0e75e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:46:38.311051 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140a3dd2-983f-417f-a435-943cd0d0e75e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:46:38.312575 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140a3dd2-983f-417f-a435-943cd0d0e75e service neutron] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:46:38.321966 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 614/1210] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 30 00:46:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 00:46:42.297941 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34161a5-f43e-467e-bf16-6dc757bc8a3d None None] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:46:42.298885 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34161a5-f43e-467e-bf16-6dc757bc8a3d None None] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:46:42.298885 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34161a5-f43e-467e-bf16-6dc757bc8a3d None None] PATH_INFO: `/` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:46:42.301118 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 597/1211] 127.0.0.1 () {54 vars in 917 bytes} [Sun Oct 30 00:46:42 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:46:42.309742 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a81d04d-18b7-4dc0-83ff-2c70a82fedc9 None None] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:46:42.310226 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a81d04d-18b7-4dc0-83ff-2c70a82fedc9 None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:46:42.310226 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a81d04d-18b7-4dc0-83ff-2c70a82fedc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:46:42.339664 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.auth.core [None req-4a81d04d-18b7-4dc0-83ff-2c70a82fedc9 None None] MFA Rules not processed for user `eb55b6cbca4945abb21b0e49eb745e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=87956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:46:42.340776 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-4a81d04d-18b7-4dc0-83ff-2c70a82fedc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:46:42.350130 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 615/1212] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Oct 30 00:46:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 30 00:46:42.649279 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34161a5-f43e-467e-bf16-6dc757bc8a3d None None] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:46:42.652447 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-f34161a5-f43e-467e-bf16-6dc757bc8a3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:46:42.747521 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34161a5-f43e-467e-bf16-6dc757bc8a3d None None] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:46:42.752126 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e2567c-db7c-4e1a-8459-b3b0a078fc52 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48d928ff7fe24348ac900f09c56acc20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d2387fdf794d4eaef07bbcd7b39f2a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:46:42.752729 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e2567c-db7c-4e1a-8459-b3b0a078fc52 service cinder] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:46:42.752999 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e2567c-db7c-4e1a-8459-b3b0a078fc52 service cinder] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:46:42.753284 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e2567c-db7c-4e1a-8459-b3b0a078fc52 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:46:42.763407 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e2567c-db7c-4e1a-8459-b3b0a078fc52 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:46:42.764845 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e2567c-db7c-4e1a-8459-b3b0a078fc52 service cinder] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:46:42.774698 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 598/1213] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 30 00:46:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 00:46:44.900384 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6be59a-6130-4e33-987b-9a71874cbea9 None None] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:46:44.900953 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6be59a-6130-4e33-987b-9a71874cbea9 None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:46:44.900953 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6be59a-6130-4e33-987b-9a71874cbea9 None None] PATH_INFO: `/` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:46:44.902230 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 616/1214] 127.0.0.1 () {54 vars in 917 bytes} [Sun Oct 30 00:46:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:46:44.908521 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258f4b1f-d1a7-495c-ac52-26037a5c75ad None None] REQUEST_METHOD: `POST` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:46:44.909240 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258f4b1f-d1a7-495c-ac52-26037a5c75ad None None] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:46:44.909467 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258f4b1f-d1a7-495c-ac52-26037a5c75ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:46:44.932790 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.auth.core [None req-258f4b1f-d1a7-495c-ac52-26037a5c75ad None None] MFA Rules not processed for user `eb55b6cbca4945abb21b0e49eb745e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=87955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:46:44.933996 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-258f4b1f-d1a7-495c-ac52-26037a5c75ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:46:44.942942 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 599/1215] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Oct 30 00:46:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:46:45.238829 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6be59a-6130-4e33-987b-9a71874cbea9 None None] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:46:45.241675 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-cc6be59a-6130-4e33-987b-9a71874cbea9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:46:45.258174 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6be59a-6130-4e33-987b-9a71874cbea9 None None] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:46:45.262594 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c03c55-f771-4d59-8d75-87396970dc84 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48d928ff7fe24348ac900f09c56acc20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d2387fdf794d4eaef07bbcd7b39f2a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:46:45.263187 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c03c55-f771-4d59-8d75-87396970dc84 service cinder] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:46:45.263488 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c03c55-f771-4d59-8d75-87396970dc84 service cinder] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:46:45.263733 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c03c55-f771-4d59-8d75-87396970dc84 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:46:45.275066 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c03c55-f771-4d59-8d75-87396970dc84 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:46:45.276752 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c03c55-f771-4d59-8d75-87396970dc84 service cinder] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:46:45.287627 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 617/1216] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 30 00:46:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 00:46:54.927684 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=88 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:46:55.282272 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=33 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:48:13.180466 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899c18b6-bf65-4807-92b4-1f9adc0c2e66 None None] REQUEST_METHOD: `POST` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:48:13.181243 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899c18b6-bf65-4807-92b4-1f9adc0c2e66 None None] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:48:13.181243 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899c18b6-bf65-4807-92b4-1f9adc0c2e66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:48:13.208762 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.auth.core [None req-899c18b6-bf65-4807-92b4-1f9adc0c2e66 None None] MFA Rules not processed for user `eb55b6cbca4945abb21b0e49eb745e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=87955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:48:13.210337 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-899c18b6-bf65-4807-92b4-1f9adc0c2e66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:48:13.223106 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 600/1217] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 30 00:48:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:48:13.233373 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bdd887-f84e-46ec-81af-4a971e29a13e None None] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:48:13.233998 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bdd887-f84e-46ec-81af-4a971e29a13e None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:48:13.233998 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bdd887-f84e-46ec-81af-4a971e29a13e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:48:13.260269 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.auth.core [None req-e5bdd887-f84e-46ec-81af-4a971e29a13e None None] MFA Rules not processed for user `eb55b6cbca4945abb21b0e49eb745e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=87956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:48:13.261870 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-e5bdd887-f84e-46ec-81af-4a971e29a13e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:48:13.275124 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 618/1218] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 30 00:48:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:48:13.280038 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899c18b6-bf65-4807-92b4-1f9adc0c2e66 None None] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:48:13.293754 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899c18b6-bf65-4807-92b4-1f9adc0c2e66 None None] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:48:13.299573 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bca475f-e596-469d-ba63-606337e53540 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:48:13.300337 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bca475f-e596-469d-ba63-606337e53540 admin admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:48:13.300611 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bca475f-e596-469d-ba63-606337e53540 admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:48:13.300878 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bca475f-e596-469d-ba63-606337e53540 admin admin] PATH_INFO: `/v3/domains` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:48:13.301529 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bca475f-e596-469d-ba63-606337e53540 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:48:13.301823 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bca475f-e596-469d-ba63-606337e53540 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:48:13.303459 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bca475f-e596-469d-ba63-606337e53540 admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:48:13.306522 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffbd5b4-378a-40e2-bcf9-afe199b0a21f None None] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:48:13.307675 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffbd5b4-378a-40e2-bcf9-afe199b0a21f None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:48:13.308184 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffbd5b4-378a-40e2-bcf9-afe199b0a21f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:48:13.327270 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 601/1219] 10.222.0.42 () {58 vars in 1153 bytes} [Sun Oct 30 00:48:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:48:13.331237 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bca475f-e596-469d-ba63-606337e53540 admin admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:48:13.344018 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.auth.core [None req-9ffbd5b4-378a-40e2-bcf9-afe199b0a21f None None] MFA Rules not processed for user `eb55b6cbca4945abb21b0e49eb745e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=87956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:48:13.349780 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bca475f-e596-469d-ba63-606337e53540 admin admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:48:13.352627 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-9ffbd5b4-378a-40e2-bcf9-afe199b0a21f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:48:13.356232 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4bb908-af46-47bc-bd9e-a9068d4d2905 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:48:13.356855 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4bb908-af46-47bc-bd9e-a9068d4d2905 admin admin] REQUEST_METHOD: `POST` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:48:13.357132 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4bb908-af46-47bc-bd9e-a9068d4d2905 admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:48:13.357402 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4bb908-af46-47bc-bd9e-a9068d4d2905 admin admin] PATH_INFO: `/v3/projects` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:48:13.358058 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4bb908-af46-47bc-bd9e-a9068d4d2905 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:48:13.359062 dv-cinder-861491-6-smb devstack@keystone.service[87955]: WARNING py.warnings [None req-6f4bb908-af46-47bc-bd9e-a9068d4d2905 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 30 00:48:13.359062 dv-cinder-861491-6-smb devstack@keystone.service[87955]: warnings.warn(msg) Oct 30 00:48:13.359062 dv-cinder-861491-6-smb devstack@keystone.service[87955]: Oct 30 00:48:13.360771 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4bb908-af46-47bc-bd9e-a9068d4d2905 admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:48:13.383914 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 619/1220] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 30 00:48:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:48:13.385203 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cffa75-4f31-4152-9472-440681334b0f None None] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:48:13.385489 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cffa75-4f31-4152-9472-440681334b0f None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:48:13.385760 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cffa75-4f31-4152-9472-440681334b0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:48:13.433736 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.auth.core [None req-20cffa75-4f31-4152-9472-440681334b0f None None] MFA Rules not processed for user `eb55b6cbca4945abb21b0e49eb745e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=87956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:48:13.435030 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-20cffa75-4f31-4152-9472-440681334b0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:48:13.438302 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 602/1221] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 30 00:48:13 2022] POST /identity/v3/projects => generated 383 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 30 00:48:13.439713 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96576484-f35d-4b65-80d7-ea3c769bd889 None None] REQUEST_METHOD: `POST` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:48:13.439994 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96576484-f35d-4b65-80d7-ea3c769bd889 None None] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:48:13.440264 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96576484-f35d-4b65-80d7-ea3c769bd889 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:48:13.483216 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.auth.core [None req-96576484-f35d-4b65-80d7-ea3c769bd889 None None] MFA Rules not processed for user `eb55b6cbca4945abb21b0e49eb745e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=87955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:48:13.484456 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-96576484-f35d-4b65-80d7-ea3c769bd889 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:48:13.524594 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 620/1222] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 30 00:48:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:48:13.529840 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2e8c5f-8899-4534-986b-71a1541f206a None None] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:48:13.530385 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2e8c5f-8899-4534-986b-71a1541f206a None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:48:13.531863 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2e8c5f-8899-4534-986b-71a1541f206a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:48:13.557119 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.auth.core [None req-0d2e8c5f-8899-4534-986b-71a1541f206a None None] MFA Rules not processed for user `eb55b6cbca4945abb21b0e49eb745e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=87956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:48:13.558317 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-0d2e8c5f-8899-4534-986b-71a1541f206a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:48:13.567194 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 621/1223] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 30 00:48:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:48:13.568195 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2e8c5f-8899-4534-986b-71a1541f206a None None] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:48:13.573222 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 603/1224] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 30 00:48:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:48:13.575914 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe618867-b3b7-4c99-b453-fdcc343e86d5 None None] REQUEST_METHOD: `POST` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:48:13.576198 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe618867-b3b7-4c99-b453-fdcc343e86d5 None None] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:48:13.576471 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe618867-b3b7-4c99-b453-fdcc343e86d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:48:13.578235 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2e8c5f-8899-4534-986b-71a1541f206a None None] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:48:13.582817 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faaeb1c0-59a2-44fd-80e6-ff1bfbf158ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:48:13.583444 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faaeb1c0-59a2-44fd-80e6-ff1bfbf158ee admin admin] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:48:13.583720 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faaeb1c0-59a2-44fd-80e6-ff1bfbf158ee admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:48:13.583990 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faaeb1c0-59a2-44fd-80e6-ff1bfbf158ee admin admin] PATH_INFO: `/v3/users` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:48:13.584927 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faaeb1c0-59a2-44fd-80e6-ff1bfbf158ee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:48:13.585935 dv-cinder-861491-6-smb devstack@keystone.service[87956]: WARNING py.warnings [None req-faaeb1c0-59a2-44fd-80e6-ff1bfbf158ee admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 30 00:48:13.585935 dv-cinder-861491-6-smb devstack@keystone.service[87956]: warnings.warn(msg) Oct 30 00:48:13.585935 dv-cinder-861491-6-smb devstack@keystone.service[87956]: Oct 30 00:48:13.587156 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faaeb1c0-59a2-44fd-80e6-ff1bfbf158ee admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:48:13.595887 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.auth.core [None req-fe618867-b3b7-4c99-b453-fdcc343e86d5 None None] MFA Rules not processed for user `eb55b6cbca4945abb21b0e49eb745e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=87955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:48:13.597198 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-fe618867-b3b7-4c99-b453-fdcc343e86d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:48:13.605772 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 604/1225] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 30 00:48:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:48:13.607046 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b96e6a-c880-434a-9322-ac94eaad2a94 None None] REQUEST_METHOD: `POST` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:48:13.607362 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b96e6a-c880-434a-9322-ac94eaad2a94 None None] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:48:13.607633 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b96e6a-c880-434a-9322-ac94eaad2a94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:48:13.610685 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 622/1226] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 30 00:48:13 2022] POST /identity/v3/users => generated 292 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 00:48:13.611795 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524e02cb-bb60-4cf0-a2d2-689e24dbec2c None None] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:48:13.612074 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524e02cb-bb60-4cf0-a2d2-689e24dbec2c None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:48:13.612339 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524e02cb-bb60-4cf0-a2d2-689e24dbec2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:48:13.630267 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.auth.core [None req-e8b96e6a-c880-434a-9322-ac94eaad2a94 None None] MFA Rules not processed for user `eb55b6cbca4945abb21b0e49eb745e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=87955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:48:13.631503 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.auth.core [None req-524e02cb-bb60-4cf0-a2d2-689e24dbec2c None None] MFA Rules not processed for user `eb55b6cbca4945abb21b0e49eb745e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=87956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:48:13.631837 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-e8b96e6a-c880-434a-9322-ac94eaad2a94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:48:13.632741 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-524e02cb-bb60-4cf0-a2d2-689e24dbec2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:48:13.640184 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 605/1227] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 30 00:48:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:48:13.647359 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 623/1228] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 30 00:48:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:48:13.647519 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e4b515-7316-448c-b87d-9f354d686bf2 None None] REQUEST_METHOD: `POST` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:48:13.647519 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e4b515-7316-448c-b87d-9f354d686bf2 None None] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:48:13.647519 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e4b515-7316-448c-b87d-9f354d686bf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:48:13.647755 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5e86e6-fdcb-4984-a6cf-7dea979e5f9d None None] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:48:13.647755 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5e86e6-fdcb-4984-a6cf-7dea979e5f9d None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:48:13.647755 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5e86e6-fdcb-4984-a6cf-7dea979e5f9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:48:13.664013 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.auth.core [None req-cb5e86e6-fdcb-4984-a6cf-7dea979e5f9d None None] MFA Rules not processed for user `eb55b6cbca4945abb21b0e49eb745e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=87956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:48:13.665275 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-cb5e86e6-fdcb-4984-a6cf-7dea979e5f9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:48:13.665806 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.auth.core [None req-72e4b515-7316-448c-b87d-9f354d686bf2 None None] MFA Rules not processed for user `eb55b6cbca4945abb21b0e49eb745e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=87955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:48:13.666973 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-72e4b515-7316-448c-b87d-9f354d686bf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:48:13.673081 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 624/1229] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 30 00:48:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:48:13.674245 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c23dde1-f007-4cc9-b409-9273c15761df None None] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:48:13.674525 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c23dde1-f007-4cc9-b409-9273c15761df None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:48:13.674792 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c23dde1-f007-4cc9-b409-9273c15761df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:48:13.675805 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 606/1230] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 30 00:48:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:48:13.676923 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e4b515-7316-448c-b87d-9f354d686bf2 None None] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:48:13.687436 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e4b515-7316-448c-b87d-9f354d686bf2 None None] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:48:13.692181 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f793de0-af24-4a1c-97fb-e3b938d78489 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:48:13.692773 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f793de0-af24-4a1c-97fb-e3b938d78489 admin admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:48:13.693049 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f793de0-af24-4a1c-97fb-e3b938d78489 admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:48:13.693324 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f793de0-af24-4a1c-97fb-e3b938d78489 admin admin] PATH_INFO: `/v3/domains` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:48:13.693988 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f793de0-af24-4a1c-97fb-e3b938d78489 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:48:13.694281 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f793de0-af24-4a1c-97fb-e3b938d78489 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:48:13.695918 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f793de0-af24-4a1c-97fb-e3b938d78489 admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:48:13.704674 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.auth.core [None req-9c23dde1-f007-4cc9-b409-9273c15761df None None] MFA Rules not processed for user `eb55b6cbca4945abb21b0e49eb745e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=87956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:48:13.705884 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-9c23dde1-f007-4cc9-b409-9273c15761df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:48:13.708132 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 607/1231] 10.222.0.42 () {58 vars in 1153 bytes} [Sun Oct 30 00:48:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:48:13.708978 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f793de0-af24-4a1c-97fb-e3b938d78489 admin admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:48:13.714485 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 625/1232] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 30 00:48:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:48:13.719329 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f793de0-af24-4a1c-97fb-e3b938d78489 admin admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:48:13.720378 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18868680-bb9d-4156-8645-0895129d7e19 None None] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:48:13.720660 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18868680-bb9d-4156-8645-0895129d7e19 None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:48:13.720935 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18868680-bb9d-4156-8645-0895129d7e19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:48:13.723855 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db54b403-0c8a-45d0-a106-4732f23f7425 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:48:13.724446 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db54b403-0c8a-45d0-a106-4732f23f7425 admin admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:48:13.724718 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db54b403-0c8a-45d0-a106-4732f23f7425 admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:48:13.724985 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db54b403-0c8a-45d0-a106-4732f23f7425 admin admin] PATH_INFO: `/v3/roles` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:48:13.725616 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db54b403-0c8a-45d0-a106-4732f23f7425 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:48:13.727178 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db54b403-0c8a-45d0-a106-4732f23f7425 admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:48:13.737663 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 608/1233] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 30 00:48:13 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 00:48:13.738439 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db54b403-0c8a-45d0-a106-4732f23f7425 admin admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:48:13.740297 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.auth.core [None req-18868680-bb9d-4156-8645-0895129d7e19 None None] MFA Rules not processed for user `eb55b6cbca4945abb21b0e49eb745e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=87956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:48:13.741486 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-18868680-bb9d-4156-8645-0895129d7e19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:48:13.747593 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db54b403-0c8a-45d0-a106-4732f23f7425 admin admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:48:13.749813 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 626/1234] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 30 00:48:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:48:13.750974 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8499c525-d8e7-4ca4-a03d-7bfcda5899b7 None None] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:48:13.751276 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8499c525-d8e7-4ca4-a03d-7bfcda5899b7 None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:48:13.751550 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8499c525-d8e7-4ca4-a03d-7bfcda5899b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:48:13.752003 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d63a764-b665-4bcb-8cf1-18bd1a444eaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:48:13.752571 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d63a764-b665-4bcb-8cf1-18bd1a444eaf admin admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:48:13.752845 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d63a764-b665-4bcb-8cf1-18bd1a444eaf admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:48:13.753108 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d63a764-b665-4bcb-8cf1-18bd1a444eaf admin admin] PATH_INFO: `/v3/domains` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:48:13.753730 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d63a764-b665-4bcb-8cf1-18bd1a444eaf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:48:13.754026 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d63a764-b665-4bcb-8cf1-18bd1a444eaf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:48:13.755679 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d63a764-b665-4bcb-8cf1-18bd1a444eaf admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:48:13.767620 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 609/1235] 10.222.0.42 () {58 vars in 1153 bytes} [Sun Oct 30 00:48:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:48:13.768852 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e458b965-2c87-4e80-a3a0-3044fea6b1ce None None] REQUEST_METHOD: `POST` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:48:13.769125 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e458b965-2c87-4e80-a3a0-3044fea6b1ce None None] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:48:13.769393 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e458b965-2c87-4e80-a3a0-3044fea6b1ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:48:13.782234 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.auth.core [None req-8499c525-d8e7-4ca4-a03d-7bfcda5899b7 None None] MFA Rules not processed for user `eb55b6cbca4945abb21b0e49eb745e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=87956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:48:13.783493 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-8499c525-d8e7-4ca4-a03d-7bfcda5899b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:48:13.788922 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.auth.core [None req-e458b965-2c87-4e80-a3a0-3044fea6b1ce None None] MFA Rules not processed for user `eb55b6cbca4945abb21b0e49eb745e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=87955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:48:13.790133 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-e458b965-2c87-4e80-a3a0-3044fea6b1ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:48:13.792819 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 627/1236] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 30 00:48:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:48:13.793973 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe4ac1d-b603-4319-8d38-bf92881c09a7 None None] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:48:13.794251 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe4ac1d-b603-4319-8d38-bf92881c09a7 None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:48:13.794525 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe4ac1d-b603-4319-8d38-bf92881c09a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:48:13.807931 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 610/1237] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 30 00:48:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:48:13.808825 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e458b965-2c87-4e80-a3a0-3044fea6b1ce None None] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:48:13.814177 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.auth.core [None req-9fe4ac1d-b603-4319-8d38-bf92881c09a7 None None] MFA Rules not processed for user `eb55b6cbca4945abb21b0e49eb745e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=87956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:48:13.815410 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-9fe4ac1d-b603-4319-8d38-bf92881c09a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:48:13.818921 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e458b965-2c87-4e80-a3a0-3044fea6b1ce None None] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:48:13.823866 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d96e32c-e9b2-462d-b859-6e10b656a56f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:48:13.824180 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 628/1238] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 30 00:48:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:48:13.824461 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d96e32c-e9b2-462d-b859-6e10b656a56f admin admin] REQUEST_METHOD: `POST` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:48:13.824735 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d96e32c-e9b2-462d-b859-6e10b656a56f admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:48:13.824957 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe4ac1d-b603-4319-8d38-bf92881c09a7 None None] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:48:13.825073 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d96e32c-e9b2-462d-b859-6e10b656a56f admin admin] PATH_INFO: `/v3/projects` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:48:13.825718 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d96e32c-e9b2-462d-b859-6e10b656a56f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:48:13.828052 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d96e32c-e9b2-462d-b859-6e10b656a56f admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:48:13.834991 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe4ac1d-b603-4319-8d38-bf92881c09a7 None None] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:48:13.840259 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90157b9-d3d2-45a9-947b-ca36a002b1a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:48:13.840845 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90157b9-d3d2-45a9-947b-ca36a002b1a2 admin admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:48:13.841281 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90157b9-d3d2-45a9-947b-ca36a002b1a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:48:13.841736 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90157b9-d3d2-45a9-947b-ca36a002b1a2 admin admin] PATH_INFO: `/v3/domains` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:48:13.842399 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90157b9-d3d2-45a9-947b-ca36a002b1a2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87956) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:48:13.842688 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90157b9-d3d2-45a9-947b-ca36a002b1a2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:48:13.843722 dv-cinder-861491-6-smb devstack@keystone.service[87956]: WARNING py.warnings [None req-c90157b9-d3d2-45a9-947b-ca36a002b1a2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 30 00:48:13.843722 dv-cinder-861491-6-smb devstack@keystone.service[87956]: warnings.warn(msg) Oct 30 00:48:13.843722 dv-cinder-861491-6-smb devstack@keystone.service[87956]: Oct 30 00:48:13.844596 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90157b9-d3d2-45a9-947b-ca36a002b1a2 admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:48:13.860366 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 611/1239] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 30 00:48:13 2022] POST /identity/v3/projects => generated 373 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 00:48:13.860366 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d96e32c-e9b2-462d-b859-6e10b656a56f admin admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:48:13.860662 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 629/1240] 10.222.0.42 () {58 vars in 1153 bytes} [Sun Oct 30 00:48:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:48:13.860662 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90157b9-d3d2-45a9-947b-ca36a002b1a2 admin admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:48:13.868628 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90157b9-d3d2-45a9-947b-ca36a002b1a2 admin admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:48:13.894457 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:48:13.926169 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03baeaa5-2992-41ec-9c70-5e717cd27b0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:48:13.927009 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03baeaa5-2992-41ec-9c70-5e717cd27b0b admin admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:48:13.927474 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03baeaa5-2992-41ec-9c70-5e717cd27b0b admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:48:13.927744 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03baeaa5-2992-41ec-9c70-5e717cd27b0b admin admin] PATH_INFO: `/v3/domains` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:48:13.928381 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03baeaa5-2992-41ec-9c70-5e717cd27b0b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87956) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:48:13.928676 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03baeaa5-2992-41ec-9c70-5e717cd27b0b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:48:13.930363 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03baeaa5-2992-41ec-9c70-5e717cd27b0b admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:48:13.930964 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d96e32c-e9b2-462d-b859-6e10b656a56f admin admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:48:13.935728 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6141397-4d5e-4636-8b49-7197fb149656 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:48:13.936329 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6141397-4d5e-4636-8b49-7197fb149656 admin admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:48:13.936603 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6141397-4d5e-4636-8b49-7197fb149656 admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:48:13.936872 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6141397-4d5e-4636-8b49-7197fb149656 admin admin] PATH_INFO: `/v3/roles` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:48:13.937508 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6141397-4d5e-4636-8b49-7197fb149656 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:48:13.939106 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6141397-4d5e-4636-8b49-7197fb149656 admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:48:13.942684 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 630/1241] 10.222.0.42 () {58 vars in 1153 bytes} [Sun Oct 30 00:48:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:48:13.943588 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03baeaa5-2992-41ec-9c70-5e717cd27b0b admin admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:48:13.949161 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 612/1242] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 30 00:48:13 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 00:48:13.949923 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6141397-4d5e-4636-8b49-7197fb149656 admin admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:48:13.950731 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:48:13.955020 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03baeaa5-2992-41ec-9c70-5e717cd27b0b admin admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:48:13.961231 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08664b8a-a356-461d-9e67-b307bc2df130 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:48:13.961996 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08664b8a-a356-461d-9e67-b307bc2df130 admin admin] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:48:13.962325 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6141397-4d5e-4636-8b49-7197fb149656 admin admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:48:13.962446 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08664b8a-a356-461d-9e67-b307bc2df130 admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:48:13.962714 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08664b8a-a356-461d-9e67-b307bc2df130 admin admin] PATH_INFO: `/v3/projects` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:48:13.963441 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08664b8a-a356-461d-9e67-b307bc2df130 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:48:13.965380 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08664b8a-a356-461d-9e67-b307bc2df130 admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:48:13.966882 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c650c7-6018-4965-b73d-753abec95e8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:48:13.967513 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c650c7-6018-4965-b73d-753abec95e8e admin admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:48:13.967794 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c650c7-6018-4965-b73d-753abec95e8e admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:48:13.968067 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c650c7-6018-4965-b73d-753abec95e8e admin admin] PATH_INFO: `/v3/domains` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:48:13.968712 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c650c7-6018-4965-b73d-753abec95e8e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:48:13.969014 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c650c7-6018-4965-b73d-753abec95e8e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:48:13.970583 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c650c7-6018-4965-b73d-753abec95e8e admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:48:13.982636 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 613/1243] 10.222.0.42 () {58 vars in 1153 bytes} [Sun Oct 30 00:48:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:48:13.983524 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c650c7-6018-4965-b73d-753abec95e8e admin admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:48:13.993337 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c650c7-6018-4965-b73d-753abec95e8e admin admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:48:13.997170 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 631/1244] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 30 00:48:13 2022] POST /identity/v3/projects => generated 393 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 00:48:13.997914 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87b0fa0-6bb2-4cb9-bd48-f948b7cf2db6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:48:13.998035 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08664b8a-a356-461d-9e67-b307bc2df130 admin admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:48:13.998508 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87b0fa0-6bb2-4cb9-bd48-f948b7cf2db6 admin admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:48:13.998785 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87b0fa0-6bb2-4cb9-bd48-f948b7cf2db6 admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:48:13.999055 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87b0fa0-6bb2-4cb9-bd48-f948b7cf2db6 admin admin] PATH_INFO: `/v3/domains` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:48:13.999728 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87b0fa0-6bb2-4cb9-bd48-f948b7cf2db6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:48:14.000031 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87b0fa0-6bb2-4cb9-bd48-f948b7cf2db6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:48:14.001901 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87b0fa0-6bb2-4cb9-bd48-f948b7cf2db6 admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:48:14.014793 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 614/1245] 10.222.0.42 () {58 vars in 1153 bytes} [Sun Oct 30 00:48:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:48:14.015931 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87b0fa0-6bb2-4cb9-bd48-f948b7cf2db6 admin admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:48:14.025408 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87b0fa0-6bb2-4cb9-bd48-f948b7cf2db6 admin admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:48:14.066608 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08664b8a-a356-461d-9e67-b307bc2df130 admin admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:48:14.072168 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c8a6ae-a8ab-4fca-9e59-4f6a0b750338 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:48:14.072287 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c8a6ae-a8ab-4fca-9e59-4f6a0b750338 admin admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:48:14.072513 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c8a6ae-a8ab-4fca-9e59-4f6a0b750338 admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:48:14.072774 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c8a6ae-a8ab-4fca-9e59-4f6a0b750338 admin admin] PATH_INFO: `/v3/domains` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:48:14.073413 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c8a6ae-a8ab-4fca-9e59-4f6a0b750338 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87956) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:48:14.073705 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c8a6ae-a8ab-4fca-9e59-4f6a0b750338 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:48:14.075344 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c8a6ae-a8ab-4fca-9e59-4f6a0b750338 admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:48:14.085246 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3b00c5-29cd-40a2-a745-a8a92bf4da79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:48:14.085791 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3b00c5-29cd-40a2-a745-a8a92bf4da79 admin admin] REQUEST_METHOD: `POST` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:48:14.086113 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3b00c5-29cd-40a2-a745-a8a92bf4da79 admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:48:14.086388 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3b00c5-29cd-40a2-a745-a8a92bf4da79 admin admin] PATH_INFO: `/v3/users` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:48:14.087087 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3b00c5-29cd-40a2-a745-a8a92bf4da79 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:48:14.087530 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 632/1246] 10.222.0.42 () {58 vars in 1153 bytes} [Sun Oct 30 00:48:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:48:14.088208 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c8a6ae-a8ab-4fca-9e59-4f6a0b750338 admin admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:48:14.089205 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3b00c5-29cd-40a2-a745-a8a92bf4da79 admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:48:14.099815 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c8a6ae-a8ab-4fca-9e59-4f6a0b750338 admin admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:48:14.104650 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4375dcc8-00b5-4246-9730-434239475d31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:48:14.105265 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4375dcc8-00b5-4246-9730-434239475d31 admin admin] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:48:14.105677 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4375dcc8-00b5-4246-9730-434239475d31 admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:48:14.105947 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4375dcc8-00b5-4246-9730-434239475d31 admin admin] PATH_INFO: `/v3/projects` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:48:14.106651 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4375dcc8-00b5-4246-9730-434239475d31 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:48:14.108815 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4375dcc8-00b5-4246-9730-434239475d31 admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:48:14.119294 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 615/1247] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 30 00:48:14 2022] POST /identity/v3/users => generated 287 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 00:48:14.119294 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3b00c5-29cd-40a2-a745-a8a92bf4da79 admin admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:48:14.126536 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3b00c5-29cd-40a2-a745-a8a92bf4da79 admin admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:48:14.132284 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130ab058-0aa5-4b53-ae6e-8f9739cc01ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:48:14.132938 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130ab058-0aa5-4b53-ae6e-8f9739cc01ec admin admin] REQUEST_METHOD: `POST` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:48:14.133211 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130ab058-0aa5-4b53-ae6e-8f9739cc01ec admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:48:14.133480 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130ab058-0aa5-4b53-ae6e-8f9739cc01ec admin admin] PATH_INFO: `/v3/projects` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:48:14.134150 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130ab058-0aa5-4b53-ae6e-8f9739cc01ec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:48:14.136123 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130ab058-0aa5-4b53-ae6e-8f9739cc01ec admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:48:14.140994 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 633/1248] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 30 00:48:14 2022] POST /identity/v3/projects => generated 387 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 00:48:14.140994 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4375dcc8-00b5-4246-9730-434239475d31 admin admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:48:14.164308 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 616/1249] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 30 00:48:14 2022] POST /identity/v3/projects => generated 389 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 00:48:14.165130 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130ab058-0aa5-4b53-ae6e-8f9739cc01ec admin admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:48:14.204926 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4375dcc8-00b5-4246-9730-434239475d31 admin admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:48:14.226281 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130ab058-0aa5-4b53-ae6e-8f9739cc01ec admin admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:48:14.231008 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cc4ce4-6c06-4516-b7dd-0fd54f4ca0d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:48:14.231747 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cc4ce4-6c06-4516-b7dd-0fd54f4ca0d0 admin admin] REQUEST_METHOD: `POST` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:48:14.232025 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cc4ce4-6c06-4516-b7dd-0fd54f4ca0d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:48:14.232293 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cc4ce4-6c06-4516-b7dd-0fd54f4ca0d0 admin admin] PATH_INFO: `/v3/projects` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:48:14.232920 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92cc4ce4-6c06-4516-b7dd-0fd54f4ca0d0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:48:14.234829 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92cc4ce4-6c06-4516-b7dd-0fd54f4ca0d0 admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:48:14.240348 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:48:14.263493 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 617/1250] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 30 00:48:14 2022] POST /identity/v3/projects => generated 375 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 00:48:14.266982 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f02db3c-04af-4e96-9c8a-af29f86d4499 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:48:14.266982 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f02db3c-04af-4e96-9c8a-af29f86d4499 admin admin] REQUEST_METHOD: `PUT` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:48:14.266982 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f02db3c-04af-4e96-9c8a-af29f86d4499 admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:48:14.266982 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f02db3c-04af-4e96-9c8a-af29f86d4499 admin admin] PATH_INFO: `/v3/projects/ef696f2d406849d887dc519e1e8ba581/users/ea285bd64be444a9a5184fae7b471d64/roles/1c93019874174c4b91118d9ce2347e47` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:48:14.268117 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cc4ce4-6c06-4516-b7dd-0fd54f4ca0d0 admin admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:48:14.269209 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:48:14.282466 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f02db3c-04af-4e96-9c8a-af29f86d4499 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef696f2d406849d887dc519e1e8ba581, user_id=ea285bd64be444a9a5184fae7b471d64, role_id=1c93019874174c4b91118d9ce2347e47)` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:48:14.285224 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f02db3c-04af-4e96-9c8a-af29f86d4499 admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:48:14.303864 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 634/1251] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 30 00:48:14 2022] PUT /identity/v3/projects/ef696f2d406849d887dc519e1e8ba581/users/ea285bd64be444a9a5184fae7b471d64/roles/1c93019874174c4b91118d9ce2347e47 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 00:48:14.305204 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f02db3c-04af-4e96-9c8a-af29f86d4499 admin admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:48:14.331813 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cc4ce4-6c06-4516-b7dd-0fd54f4ca0d0 admin admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:48:14.373036 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f02db3c-04af-4e96-9c8a-af29f86d4499 admin admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:48:14.378198 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2cf939-cf9a-4bb3-ad09-f06af23c3747 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:48:14.379188 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2cf939-cf9a-4bb3-ad09-f06af23c3747 admin admin] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:48:14.379648 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2cf939-cf9a-4bb3-ad09-f06af23c3747 admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:48:14.379917 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2cf939-cf9a-4bb3-ad09-f06af23c3747 admin admin] PATH_INFO: `/v3/projects` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:48:14.380698 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2cf939-cf9a-4bb3-ad09-f06af23c3747 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:48:14.382502 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2cf939-cf9a-4bb3-ad09-f06af23c3747 admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:48:14.386817 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cebb5b-8bbc-4890-a4e9-07c27543222c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:48:14.387450 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cebb5b-8bbc-4890-a4e9-07c27543222c admin admin] REQUEST_METHOD: `POST` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:48:14.387721 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cebb5b-8bbc-4890-a4e9-07c27543222c admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:48:14.387990 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cebb5b-8bbc-4890-a4e9-07c27543222c admin admin] PATH_INFO: `/v3/users` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:48:14.388609 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68cebb5b-8bbc-4890-a4e9-07c27543222c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:48:14.390493 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68cebb5b-8bbc-4890-a4e9-07c27543222c admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:48:14.410807 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 635/1252] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 30 00:48:14 2022] POST /identity/v3/projects => generated 381 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 00:48:14.410807 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2cf939-cf9a-4bb3-ad09-f06af23c3747 admin admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:48:14.414505 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 618/1253] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 30 00:48:14 2022] POST /identity/v3/users => generated 297 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 00:48:14.414505 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cebb5b-8bbc-4890-a4e9-07c27543222c admin admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:48:14.422636 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cebb5b-8bbc-4890-a4e9-07c27543222c admin admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:48:14.475290 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2cf939-cf9a-4bb3-ad09-f06af23c3747 admin admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:48:14.477408 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18d0fc6-9395-4178-acea-562bb3e7954c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:48:14.478124 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18d0fc6-9395-4178-acea-562bb3e7954c admin admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:48:14.478402 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18d0fc6-9395-4178-acea-562bb3e7954c admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:48:14.478672 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18d0fc6-9395-4178-acea-562bb3e7954c admin admin] PATH_INFO: `/v3/roles` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:48:14.479340 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18d0fc6-9395-4178-acea-562bb3e7954c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:48:14.480116 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224cea53-056e-4a17-982e-a402e1e6d399 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:48:14.480783 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224cea53-056e-4a17-982e-a402e1e6d399 admin admin] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:48:14.480971 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18d0fc6-9395-4178-acea-562bb3e7954c admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:48:14.481178 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224cea53-056e-4a17-982e-a402e1e6d399 admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:48:14.481508 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224cea53-056e-4a17-982e-a402e1e6d399 admin admin] PATH_INFO: `/v3/projects` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:48:14.482200 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224cea53-056e-4a17-982e-a402e1e6d399 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:48:14.484112 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224cea53-056e-4a17-982e-a402e1e6d399 admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:48:14.490647 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 619/1254] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 30 00:48:14 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 00:48:14.492065 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18d0fc6-9395-4178-acea-562bb3e7954c admin admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:48:14.501451 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18d0fc6-9395-4178-acea-562bb3e7954c admin admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:48:14.507007 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04dc7754-320d-4503-b67f-7aea0565ca9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:48:14.507620 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dc7754-320d-4503-b67f-7aea0565ca9f admin admin] REQUEST_METHOD: `POST` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:48:14.507951 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dc7754-320d-4503-b67f-7aea0565ca9f admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:48:14.508225 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dc7754-320d-4503-b67f-7aea0565ca9f admin admin] PATH_INFO: `/v3/users` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:48:14.508884 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04dc7754-320d-4503-b67f-7aea0565ca9f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:48:14.510815 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04dc7754-320d-4503-b67f-7aea0565ca9f admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:48:14.512856 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 636/1255] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 30 00:48:14 2022] POST /identity/v3/projects => generated 379 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 00:48:14.513655 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224cea53-056e-4a17-982e-a402e1e6d399 admin admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:48:14.534449 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 620/1256] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 30 00:48:14 2022] POST /identity/v3/users => generated 294 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 00:48:14.535787 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04dc7754-320d-4503-b67f-7aea0565ca9f admin admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:48:14.540766 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:48:14.546391 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04dc7754-320d-4503-b67f-7aea0565ca9f admin admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:48:14.575779 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:48:14.581802 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224cea53-056e-4a17-982e-a402e1e6d399 admin admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:48:14.587849 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e785c036-a0eb-42b6-9607-ce774c5aac18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:48:14.588465 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e785c036-a0eb-42b6-9607-ce774c5aac18 admin admin] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:48:14.588740 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e785c036-a0eb-42b6-9607-ce774c5aac18 admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:48:14.589032 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e785c036-a0eb-42b6-9607-ce774c5aac18 admin admin] PATH_INFO: `/v3/users` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:48:14.589632 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e785c036-a0eb-42b6-9607-ce774c5aac18 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:48:14.591578 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e785c036-a0eb-42b6-9607-ce774c5aac18 admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:48:14.604450 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296e6a3d-d667-43f7-9028-e1d04a4fc876 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:48:14.605060 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296e6a3d-d667-43f7-9028-e1d04a4fc876 admin admin] REQUEST_METHOD: `POST` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:48:14.605406 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296e6a3d-d667-43f7-9028-e1d04a4fc876 admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:48:14.605838 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296e6a3d-d667-43f7-9028-e1d04a4fc876 admin admin] PATH_INFO: `/v3/users` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:48:14.606769 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296e6a3d-d667-43f7-9028-e1d04a4fc876 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:48:14.609007 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296e6a3d-d667-43f7-9028-e1d04a4fc876 admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:48:14.618398 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 637/1257] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 30 00:48:14 2022] POST /identity/v3/users => generated 295 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 00:48:14.618398 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1c80e2-5299-4644-9fa2-43e4710de81a None None] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:48:14.618398 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1c80e2-5299-4644-9fa2-43e4710de81a None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:48:14.618398 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1c80e2-5299-4644-9fa2-43e4710de81a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:48:14.631865 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 621/1258] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 30 00:48:14 2022] POST /identity/v3/users => generated 288 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 00:48:14.632670 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296e6a3d-d667-43f7-9028-e1d04a4fc876 admin admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:48:14.642833 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296e6a3d-d667-43f7-9028-e1d04a4fc876 admin admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:48:14.646914 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.auth.core [None req-ed1c80e2-5299-4644-9fa2-43e4710de81a None None] MFA Rules not processed for user `ea285bd64be444a9a5184fae7b471d64`. Rule list: `[]` (Enabled: `True`). {{(pid=87956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:48:14.648116 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d644f31-3e25-4e33-8ad2-0b054b93eed7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:48:14.648271 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-ed1c80e2-5299-4644-9fa2-43e4710de81a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:48:14.648852 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d644f31-3e25-4e33-8ad2-0b054b93eed7 admin admin] REQUEST_METHOD: `POST` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:48:14.649407 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d644f31-3e25-4e33-8ad2-0b054b93eed7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:48:14.649913 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d644f31-3e25-4e33-8ad2-0b054b93eed7 admin admin] PATH_INFO: `/v3/users` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:48:14.650623 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d644f31-3e25-4e33-8ad2-0b054b93eed7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:48:14.652935 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d644f31-3e25-4e33-8ad2-0b054b93eed7 admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:48:14.675802 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 622/1259] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 30 00:48:14 2022] POST /identity/v3/users => generated 291 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 00:48:14.677140 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d644f31-3e25-4e33-8ad2-0b054b93eed7 admin admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:48:14.687740 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d644f31-3e25-4e33-8ad2-0b054b93eed7 admin admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:48:14.692271 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c32105a-752f-47b4-b533-3387350ec5a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:48:14.692855 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c32105a-752f-47b4-b533-3387350ec5a5 admin admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:48:14.693130 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c32105a-752f-47b4-b533-3387350ec5a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:48:14.693397 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c32105a-752f-47b4-b533-3387350ec5a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:48:14.694022 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c32105a-752f-47b4-b533-3387350ec5a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:48:14.695637 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c32105a-752f-47b4-b533-3387350ec5a5 admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:48:14.706064 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 623/1260] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 30 00:48:14 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 00:48:14.706946 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c32105a-752f-47b4-b533-3387350ec5a5 admin admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:48:14.715045 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 638/1261] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 30 00:48:14 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:48:14.716017 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1c80e2-5299-4644-9fa2-43e4710de81a None None] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:48:14.716700 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c32105a-752f-47b4-b533-3387350ec5a5 admin admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:48:14.723040 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180c4dbd-2ff8-4330-8dee-7bee39ca4f67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:48:14.723672 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180c4dbd-2ff8-4330-8dee-7bee39ca4f67 admin admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:48:14.723944 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180c4dbd-2ff8-4330-8dee-7bee39ca4f67 admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:48:14.724213 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180c4dbd-2ff8-4330-8dee-7bee39ca4f67 admin admin] PATH_INFO: `/v3/roles` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:48:14.724854 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180c4dbd-2ff8-4330-8dee-7bee39ca4f67 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:48:14.726540 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180c4dbd-2ff8-4330-8dee-7bee39ca4f67 admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:48:14.727517 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1c80e2-5299-4644-9fa2-43e4710de81a None None] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:48:14.732863 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd900cf-f334-4aeb-9bdd-c914b769d8d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:48:14.733524 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd900cf-f334-4aeb-9bdd-c914b769d8d3 admin admin] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:48:14.733788 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd900cf-f334-4aeb-9bdd-c914b769d8d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:48:14.734154 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd900cf-f334-4aeb-9bdd-c914b769d8d3 admin admin] PATH_INFO: `/v3/users` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:48:14.734843 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd900cf-f334-4aeb-9bdd-c914b769d8d3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:48:14.737064 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd900cf-f334-4aeb-9bdd-c914b769d8d3 admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:48:14.737206 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 624/1262] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 30 00:48:14 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 00:48:14.738087 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180c4dbd-2ff8-4330-8dee-7bee39ca4f67 admin admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:48:14.755448 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180c4dbd-2ff8-4330-8dee-7bee39ca4f67 admin admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:48:14.763111 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 639/1263] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 30 00:48:14 2022] POST /identity/v3/users => generated 290 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 00:48:14.764013 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd4862f-f38e-43f1-80ea-669ec4eab202 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:48:14.764367 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd900cf-f334-4aeb-9bdd-c914b769d8d3 admin admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:48:14.764626 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd4862f-f38e-43f1-80ea-669ec4eab202 admin admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:48:14.765025 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd4862f-f38e-43f1-80ea-669ec4eab202 admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:48:14.765294 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd4862f-f38e-43f1-80ea-669ec4eab202 admin admin] PATH_INFO: `/v3/roles` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:48:14.765946 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd4862f-f38e-43f1-80ea-669ec4eab202 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:48:14.767994 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd4862f-f38e-43f1-80ea-669ec4eab202 admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:48:14.776281 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd900cf-f334-4aeb-9bdd-c914b769d8d3 admin admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:48:14.782312 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 625/1264] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 30 00:48:14 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 00:48:14.782312 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd4862f-f38e-43f1-80ea-669ec4eab202 admin admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:48:14.783272 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda7cf4b-655a-4523-8b77-7f865ad0938e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:48:14.783885 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda7cf4b-655a-4523-8b77-7f865ad0938e admin admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:48:14.784161 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda7cf4b-655a-4523-8b77-7f865ad0938e admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:48:14.784430 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda7cf4b-655a-4523-8b77-7f865ad0938e admin admin] PATH_INFO: `/v3/roles` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:48:14.785135 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda7cf4b-655a-4523-8b77-7f865ad0938e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:48:14.786722 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda7cf4b-655a-4523-8b77-7f865ad0938e admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:48:14.792148 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd4862f-f38e-43f1-80ea-669ec4eab202 admin admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:48:14.796760 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39da3c66-7f92-4a91-aca2-46a675cb364d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:48:14.797595 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39da3c66-7f92-4a91-aca2-46a675cb364d admin admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:48:14.797751 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 640/1265] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 30 00:48:14 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 00:48:14.797857 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39da3c66-7f92-4a91-aca2-46a675cb364d admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:48:14.798126 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39da3c66-7f92-4a91-aca2-46a675cb364d admin admin] PATH_INFO: `/v3/roles` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:48:14.798562 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda7cf4b-655a-4523-8b77-7f865ad0938e admin admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:48:14.798831 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39da3c66-7f92-4a91-aca2-46a675cb364d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:48:14.800457 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39da3c66-7f92-4a91-aca2-46a675cb364d admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:48:14.809809 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda7cf4b-655a-4523-8b77-7f865ad0938e admin admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:48:14.813994 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 626/1266] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 30 00:48:14 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 00:48:14.813994 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39da3c66-7f92-4a91-aca2-46a675cb364d admin admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:48:14.816955 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1173ff9-a754-4c07-b982-21a29fda0f48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:48:14.817625 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1173ff9-a754-4c07-b982-21a29fda0f48 admin admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:48:14.817965 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1173ff9-a754-4c07-b982-21a29fda0f48 admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:48:14.818300 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1173ff9-a754-4c07-b982-21a29fda0f48 admin admin] PATH_INFO: `/v3/roles` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:48:14.819002 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1173ff9-a754-4c07-b982-21a29fda0f48 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:48:14.820660 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1173ff9-a754-4c07-b982-21a29fda0f48 admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:48:14.823591 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39da3c66-7f92-4a91-aca2-46a675cb364d admin admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:48:14.828114 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bed222d-6bf2-4f3c-b847-35169fd6b029 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:48:14.828698 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bed222d-6bf2-4f3c-b847-35169fd6b029 admin admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:48:14.828972 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bed222d-6bf2-4f3c-b847-35169fd6b029 admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:48:14.829239 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bed222d-6bf2-4f3c-b847-35169fd6b029 admin admin] PATH_INFO: `/v3/roles` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:48:14.829870 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bed222d-6bf2-4f3c-b847-35169fd6b029 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:48:14.831280 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 641/1267] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 30 00:48:14 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 00:48:14.831445 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bed222d-6bf2-4f3c-b847-35169fd6b029 admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:48:14.832211 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1173ff9-a754-4c07-b982-21a29fda0f48 admin admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:48:14.842188 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 627/1268] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 30 00:48:14 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 00:48:14.842342 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1173ff9-a754-4c07-b982-21a29fda0f48 admin admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:48:14.843423 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e25b6e3-9ff1-4f43-b2b3-7a3e3d3ac609 None None] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:48:14.843779 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e25b6e3-9ff1-4f43-b2b3-7a3e3d3ac609 None None] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:48:14.844053 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e25b6e3-9ff1-4f43-b2b3-7a3e3d3ac609 None None] PATH_INFO: `/` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:48:14.845470 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 628/1269] 10.222.0.42 () {54 vars in 961 bytes} [Sun Oct 30 00:48:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:48:14.847345 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922e27ab-42ea-414a-83c1-33fc63fdcb82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:48:14.847957 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e25b6e3-9ff1-4f43-b2b3-7a3e3d3ac609 None None] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:48:14.848089 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922e27ab-42ea-414a-83c1-33fc63fdcb82 admin admin] REQUEST_METHOD: `PUT` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:48:14.848325 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922e27ab-42ea-414a-83c1-33fc63fdcb82 admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:48:14.848516 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922e27ab-42ea-414a-83c1-33fc63fdcb82 admin admin] PATH_INFO: `/v3/projects/e83381c53fab4c9f8955d79d24f06f16/users/bb25826fa981459eb69a375233d07ada/roles/1c93019874174c4b91118d9ce2347e47` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:48:14.860650 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e25b6e3-9ff1-4f43-b2b3-7a3e3d3ac609 None None] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:48:14.864164 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922e27ab-42ea-414a-83c1-33fc63fdcb82 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e83381c53fab4c9f8955d79d24f06f16, user_id=bb25826fa981459eb69a375233d07ada, role_id=1c93019874174c4b91118d9ce2347e47)` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:48:14.865271 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef29e40-2dc7-4a5b-ba8f-9edc3853fcdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:48:14.865966 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef29e40-2dc7-4a5b-ba8f-9edc3853fcdf admin admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:48:14.866239 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef29e40-2dc7-4a5b-ba8f-9edc3853fcdf admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:48:14.866505 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef29e40-2dc7-4a5b-ba8f-9edc3853fcdf admin admin] PATH_INFO: `/v3/roles` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:48:14.866809 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922e27ab-42ea-414a-83c1-33fc63fdcb82 admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:48:14.867128 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef29e40-2dc7-4a5b-ba8f-9edc3853fcdf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:48:14.868807 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef29e40-2dc7-4a5b-ba8f-9edc3853fcdf admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:48:14.883368 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 629/1270] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 30 00:48:14 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 00:48:14.883368 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef29e40-2dc7-4a5b-ba8f-9edc3853fcdf admin admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:48:14.883662 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 642/1271] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 30 00:48:14 2022] PUT /identity/v3/projects/e83381c53fab4c9f8955d79d24f06f16/users/bb25826fa981459eb69a375233d07ada/roles/1c93019874174c4b91118d9ce2347e47 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 00:48:14.883662 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922e27ab-42ea-414a-83c1-33fc63fdcb82 admin admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:48:14.899852 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef29e40-2dc7-4a5b-ba8f-9edc3853fcdf admin admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:48:14.949464 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922e27ab-42ea-414a-83c1-33fc63fdcb82 admin admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:48:14.953898 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b518759-d370-4a24-8456-813eef1b518b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:48:14.954498 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b518759-d370-4a24-8456-813eef1b518b admin admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:48:14.954687 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159c6868-8b93-4f1b-8a12-f8d944d21617 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:48:14.954809 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b518759-d370-4a24-8456-813eef1b518b admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:48:14.955029 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b518759-d370-4a24-8456-813eef1b518b admin admin] PATH_INFO: `/v3/roles` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:48:14.955323 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159c6868-8b93-4f1b-8a12-f8d944d21617 admin admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:48:14.955597 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159c6868-8b93-4f1b-8a12-f8d944d21617 admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:48:14.955738 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b518759-d370-4a24-8456-813eef1b518b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:48:14.955854 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159c6868-8b93-4f1b-8a12-f8d944d21617 admin admin] PATH_INFO: `/v3/roles` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:48:14.956485 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159c6868-8b93-4f1b-8a12-f8d944d21617 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:48:14.957338 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b518759-d370-4a24-8456-813eef1b518b admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:48:14.958080 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159c6868-8b93-4f1b-8a12-f8d944d21617 admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:48:14.970887 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 643/1272] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 30 00:48:14 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 00:48:14.971064 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 630/1273] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 30 00:48:14 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 00:48:14.971161 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b518759-d370-4a24-8456-813eef1b518b admin admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:48:14.971303 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159c6868-8b93-4f1b-8a12-f8d944d21617 admin admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:48:14.975171 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:48:14.979248 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159c6868-8b93-4f1b-8a12-f8d944d21617 admin admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:48:14.981979 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b518759-d370-4a24-8456-813eef1b518b admin admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:48:14.985667 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e9be47-863f-418c-9b86-e1b62cac3ab8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:48:14.986304 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e9be47-863f-418c-9b86-e1b62cac3ab8 admin admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:48:14.986611 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e9be47-863f-418c-9b86-e1b62cac3ab8 admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:48:14.986891 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e9be47-863f-418c-9b86-e1b62cac3ab8 admin admin] PATH_INFO: `/v3/roles` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:48:14.987509 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db78541a-ecfc-41b0-a3cc-619373da4d56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:48:14.987650 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e9be47-863f-418c-9b86-e1b62cac3ab8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:48:14.988133 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db78541a-ecfc-41b0-a3cc-619373da4d56 admin admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:48:14.988410 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db78541a-ecfc-41b0-a3cc-619373da4d56 admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:48:14.988681 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db78541a-ecfc-41b0-a3cc-619373da4d56 admin admin] PATH_INFO: `/v3/roles` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:48:14.989185 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e9be47-863f-418c-9b86-e1b62cac3ab8 admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:48:14.989334 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db78541a-ecfc-41b0-a3cc-619373da4d56 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:48:14.990887 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db78541a-ecfc-41b0-a3cc-619373da4d56 admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:48:14.992205 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:48:15.000970 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 631/1274] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 30 00:48:14 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 00:48:15.001756 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e9be47-863f-418c-9b86-e1b62cac3ab8 admin admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:48:15.006176 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 644/1275] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 30 00:48:14 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 00:48:15.007506 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20892999-d027-48e3-9e2b-02e85e469f7c None None] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:48:15.007808 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20892999-d027-48e3-9e2b-02e85e469f7c None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:48:15.008065 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20892999-d027-48e3-9e2b-02e85e469f7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:48:15.011549 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e9be47-863f-418c-9b86-e1b62cac3ab8 admin admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:48:15.016230 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58c01e6-f8a2-4282-9f48-20492739289f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:48:15.016877 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58c01e6-f8a2-4282-9f48-20492739289f admin admin] REQUEST_METHOD: `PUT` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:48:15.017158 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58c01e6-f8a2-4282-9f48-20492739289f admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:48:15.017444 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58c01e6-f8a2-4282-9f48-20492739289f admin admin] PATH_INFO: `/v3/projects/07ced1d2691444c3a6e3dc0164104d81/users/6215c75145174a63b88110843e7c29c7/roles/1c93019874174c4b91118d9ce2347e47` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:48:15.031812 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58c01e6-f8a2-4282-9f48-20492739289f admin admin] RBAC: Authorizing `identity:create_grant(project_id=07ced1d2691444c3a6e3dc0164104d81, user_id=6215c75145174a63b88110843e7c29c7, role_id=1c93019874174c4b91118d9ce2347e47)` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:48:15.034761 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58c01e6-f8a2-4282-9f48-20492739289f admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:48:15.045885 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.auth.core [None req-20892999-d027-48e3-9e2b-02e85e469f7c None None] MFA Rules not processed for user `fde877b6ddc74f4a87baf21471eb31d2`. Rule list: `[]` (Enabled: `True`). {{(pid=87956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:48:15.047094 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-20892999-d027-48e3-9e2b-02e85e469f7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:48:15.048624 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 632/1276] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 30 00:48:15 2022] PUT /identity/v3/projects/07ced1d2691444c3a6e3dc0164104d81/users/6215c75145174a63b88110843e7c29c7/roles/1c93019874174c4b91118d9ce2347e47 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 00:48:15.051782 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58c01e6-f8a2-4282-9f48-20492739289f admin admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:48:15.113464 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58c01e6-f8a2-4282-9f48-20492739289f admin admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:48:15.118157 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89760d9-1204-4a1d-852f-674cbf20747c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:48:15.118768 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89760d9-1204-4a1d-852f-674cbf20747c admin admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:48:15.119064 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89760d9-1204-4a1d-852f-674cbf20747c admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:48:15.119349 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89760d9-1204-4a1d-852f-674cbf20747c admin admin] PATH_INFO: `/v3/roles` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:48:15.120133 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89760d9-1204-4a1d-852f-674cbf20747c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:48:15.120540 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 645/1277] 10.222.0.42 () {58 vars in 1058 bytes} [Sun Oct 30 00:48:15 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:48:15.121777 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7123599b-94d9-4a69-a9de-8b9e5c23beb4 None None] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:48:15.122057 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7123599b-94d9-4a69-a9de-8b9e5c23beb4 None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:48:15.122322 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7123599b-94d9-4a69-a9de-8b9e5c23beb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:48:15.124459 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89760d9-1204-4a1d-852f-674cbf20747c admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:48:15.135441 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 633/1278] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 30 00:48:15 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 00:48:15.139401 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89760d9-1204-4a1d-852f-674cbf20747c admin admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:48:15.149070 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89760d9-1204-4a1d-852f-674cbf20747c admin admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:48:15.150595 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.auth.core [None req-7123599b-94d9-4a69-a9de-8b9e5c23beb4 None None] MFA Rules not processed for user `bb25826fa981459eb69a375233d07ada`. Rule list: `[]` (Enabled: `True`). {{(pid=87956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:48:15.151818 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-7123599b-94d9-4a69-a9de-8b9e5c23beb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:48:15.153918 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d31d30f-09a9-493b-9574-3eb24935bdcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:48:15.154607 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d31d30f-09a9-493b-9574-3eb24935bdcb admin admin] REQUEST_METHOD: `PUT` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:48:15.154881 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d31d30f-09a9-493b-9574-3eb24935bdcb admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:48:15.155145 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d31d30f-09a9-493b-9574-3eb24935bdcb admin admin] PATH_INFO: `/v3/projects/0945be7464c34ca4a6dcc95286ee5a51/users/431eca0bd74247b8bcb832ed1c9ae3ac/roles/1c93019874174c4b91118d9ce2347e47` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:48:15.169928 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d31d30f-09a9-493b-9574-3eb24935bdcb admin admin] RBAC: Authorizing `identity:create_grant(project_id=0945be7464c34ca4a6dcc95286ee5a51, user_id=431eca0bd74247b8bcb832ed1c9ae3ac, role_id=1c93019874174c4b91118d9ce2347e47)` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:48:15.172596 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d31d30f-09a9-493b-9574-3eb24935bdcb admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:48:15.187607 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 634/1279] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 30 00:48:15 2022] PUT /identity/v3/projects/0945be7464c34ca4a6dcc95286ee5a51/users/431eca0bd74247b8bcb832ed1c9ae3ac/roles/1c93019874174c4b91118d9ce2347e47 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 00:48:15.188395 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d31d30f-09a9-493b-9574-3eb24935bdcb admin admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:48:15.214974 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 646/1280] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 30 00:48:15 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:48:15.215829 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7123599b-94d9-4a69-a9de-8b9e5c23beb4 None None] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:48:15.225832 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7123599b-94d9-4a69-a9de-8b9e5c23beb4 None None] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:48:15.260530 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d31d30f-09a9-493b-9574-3eb24935bdcb admin admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:48:15.265291 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a050de1c-cf12-4ff2-a22b-85ebf0ebb289 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:48:15.265971 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a050de1c-cf12-4ff2-a22b-85ebf0ebb289 admin admin] REQUEST_METHOD: `PUT` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:48:15.266232 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a050de1c-cf12-4ff2-a22b-85ebf0ebb289 admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:48:15.266503 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a050de1c-cf12-4ff2-a22b-85ebf0ebb289 admin admin] PATH_INFO: `/v3/projects/536b19ac61b4407cb142abb7248a692f/users/3874b7420e29447a902c5fae54f761bb/roles/1c93019874174c4b91118d9ce2347e47` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:48:15.285835 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a05286-b080-418a-a359-01ac71b15d78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:48:15.286459 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a05286-b080-418a-a359-01ac71b15d78 admin admin] REQUEST_METHOD: `PUT` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:48:15.286776 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a05286-b080-418a-a359-01ac71b15d78 admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:48:15.287123 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a05286-b080-418a-a359-01ac71b15d78 admin admin] PATH_INFO: `/v3/projects/ea8c84d6a858426e86db9eabedfc296d/users/861d1145dd48414c9388bed57e993493/roles/1c93019874174c4b91118d9ce2347e47` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:48:15.292240 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a050de1c-cf12-4ff2-a22b-85ebf0ebb289 admin admin] RBAC: Authorizing `identity:create_grant(project_id=536b19ac61b4407cb142abb7248a692f, user_id=3874b7420e29447a902c5fae54f761bb, role_id=1c93019874174c4b91118d9ce2347e47)` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:48:15.295158 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a050de1c-cf12-4ff2-a22b-85ebf0ebb289 admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:48:15.296549 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=100 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:48:15.304890 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a05286-b080-418a-a359-01ac71b15d78 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea8c84d6a858426e86db9eabedfc296d, user_id=861d1145dd48414c9388bed57e993493, role_id=1c93019874174c4b91118d9ce2347e47)` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:48:15.307670 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a05286-b080-418a-a359-01ac71b15d78 admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:48:15.310009 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 635/1281] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 30 00:48:15 2022] PUT /identity/v3/projects/536b19ac61b4407cb142abb7248a692f/users/3874b7420e29447a902c5fae54f761bb/roles/1c93019874174c4b91118d9ce2347e47 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 00:48:15.310797 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a050de1c-cf12-4ff2-a22b-85ebf0ebb289 admin admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:48:15.328129 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 647/1282] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 30 00:48:15 2022] PUT /identity/v3/projects/ea8c84d6a858426e86db9eabedfc296d/users/861d1145dd48414c9388bed57e993493/roles/1c93019874174c4b91118d9ce2347e47 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 00:48:15.329477 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4528395-7f85-4fc8-ba60-677efc2de850 None None] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:48:15.330154 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4528395-7f85-4fc8-ba60-677efc2de850 None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:48:15.330535 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4528395-7f85-4fc8-ba60-677efc2de850 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:48:15.343817 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:48:15.351232 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.auth.core [None req-b4528395-7f85-4fc8-ba60-677efc2de850 None None] MFA Rules not processed for user `eb55b6cbca4945abb21b0e49eb745e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=87956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:48:15.352493 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-b4528395-7f85-4fc8-ba60-677efc2de850 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:48:15.380426 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a050de1c-cf12-4ff2-a22b-85ebf0ebb289 admin admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:48:15.411898 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 648/1283] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 30 00:48:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:48:15.412539 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4528395-7f85-4fc8-ba60-677efc2de850 None None] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:48:15.440387 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518f5ae7-fd04-471a-996b-e39f5555a7af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:48:15.441049 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518f5ae7-fd04-471a-996b-e39f5555a7af admin admin] REQUEST_METHOD: `PUT` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:48:15.441325 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518f5ae7-fd04-471a-996b-e39f5555a7af admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:48:15.441594 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518f5ae7-fd04-471a-996b-e39f5555a7af admin admin] PATH_INFO: `/v3/projects/832cfa7333b84aa0a2fb7cc2f226e78f/users/25a6cbfaa347401384a15c59a8e44a30/roles/1c93019874174c4b91118d9ce2347e47` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:48:15.455672 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518f5ae7-fd04-471a-996b-e39f5555a7af admin admin] RBAC: Authorizing `identity:create_grant(project_id=832cfa7333b84aa0a2fb7cc2f226e78f, user_id=25a6cbfaa347401384a15c59a8e44a30, role_id=1c93019874174c4b91118d9ce2347e47)` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:48:15.458303 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518f5ae7-fd04-471a-996b-e39f5555a7af admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:48:15.472581 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 636/1284] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 30 00:48:15 2022] PUT /identity/v3/projects/832cfa7333b84aa0a2fb7cc2f226e78f/users/25a6cbfaa347401384a15c59a8e44a30/roles/1c93019874174c4b91118d9ce2347e47 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 00:48:15.473606 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518f5ae7-fd04-471a-996b-e39f5555a7af admin admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:48:15.483373 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4528395-7f85-4fc8-ba60-677efc2de850 None None] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:48:15.540008 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518f5ae7-fd04-471a-996b-e39f5555a7af admin admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:48:15.544505 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bc4950-c6b6-44fe-bc94-c0f542f9ab68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:48:15.544641 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34243fb4-cdb0-4a0c-9013-abe63dea78cc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fde877b6ddc74f4a87baf21471eb31d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d2387fdf794d4eaef07bbcd7b39f2a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:48:15.545191 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bc4950-c6b6-44fe-bc94-c0f542f9ab68 admin admin] REQUEST_METHOD: `PUT` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:48:15.545322 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34243fb4-cdb0-4a0c-9013-abe63dea78cc service nova] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:48:15.545461 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34243fb4-cdb0-4a0c-9013-abe63dea78cc service nova] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:48:15.545557 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bc4950-c6b6-44fe-bc94-c0f542f9ab68 admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:48:15.545739 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bc4950-c6b6-44fe-bc94-c0f542f9ab68 admin admin] PATH_INFO: `/v3/projects/cc85f7ea91ac4d52bd06eea3460037c9/users/2ff437c6b6af4ac1b343280c5c191cd0/roles/1c93019874174c4b91118d9ce2347e47` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:48:15.545893 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34243fb4-cdb0-4a0c-9013-abe63dea78cc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:48:15.560023 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9bc4950-c6b6-44fe-bc94-c0f542f9ab68 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cc85f7ea91ac4d52bd06eea3460037c9, user_id=2ff437c6b6af4ac1b343280c5c191cd0, role_id=1c93019874174c4b91118d9ce2347e47)` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:48:15.562767 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9bc4950-c6b6-44fe-bc94-c0f542f9ab68 admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:48:15.566074 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:48:15.581161 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 637/1285] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 30 00:48:15 2022] PUT /identity/v3/projects/cc85f7ea91ac4d52bd06eea3460037c9/users/2ff437c6b6af4ac1b343280c5c191cd0/roles/1c93019874174c4b91118d9ce2347e47 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 00:48:15.581161 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a42e74c-efd8-44a5-a887-217e46a9e58b None None] REQUEST_METHOD: `POST` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:48:15.581161 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a42e74c-efd8-44a5-a887-217e46a9e58b None None] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:48:15.581161 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a42e74c-efd8-44a5-a887-217e46a9e58b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:48:15.598480 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.auth.core [None req-1a42e74c-efd8-44a5-a887-217e46a9e58b None None] MFA Rules not processed for user `eb55b6cbca4945abb21b0e49eb745e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=87955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:48:15.599742 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-1a42e74c-efd8-44a5-a887-217e46a9e58b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:48:15.609954 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34243fb4-cdb0-4a0c-9013-abe63dea78cc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:48:15.611565 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34243fb4-cdb0-4a0c-9013-abe63dea78cc service nova] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:48:15.620676 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 649/1286] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 30 00:48:15 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 00:48:15.622029 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2acc850-201d-4cfc-b22f-b2e5f20c0ec3 None None] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:48:15.622316 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2acc850-201d-4cfc-b22f-b2e5f20c0ec3 None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:48:15.622585 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2acc850-201d-4cfc-b22f-b2e5f20c0ec3 None None] PATH_INFO: `/` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:48:15.623850 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 650/1287] 10.222.0.42 () {54 vars in 961 bytes} [Sun Oct 30 00:48:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:48:15.624911 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b871d1-7605-42dc-87d4-4664fdbc4efe None None] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:48:15.625187 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b871d1-7605-42dc-87d4-4664fdbc4efe None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:48:15.625550 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b871d1-7605-42dc-87d4-4664fdbc4efe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:48:15.632794 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:48:15.655587 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.auth.core [None req-53b871d1-7605-42dc-87d4-4664fdbc4efe None None] MFA Rules not processed for user `3874b7420e29447a902c5fae54f761bb`. Rule list: `[]` (Enabled: `True`). {{(pid=87956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:48:15.656791 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-53b871d1-7605-42dc-87d4-4664fdbc4efe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:48:15.665418 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 638/1288] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 30 00:48:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:48:15.666460 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7820a7c1-3340-4f8f-b2b7-96f60c0ce7e2 None None] REQUEST_METHOD: `POST` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:48:15.666819 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7820a7c1-3340-4f8f-b2b7-96f60c0ce7e2 None None] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:48:15.667162 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7820a7c1-3340-4f8f-b2b7-96f60c0ce7e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:48:15.686344 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.auth.core [None req-7820a7c1-3340-4f8f-b2b7-96f60c0ce7e2 None None] MFA Rules not processed for user `eb55b6cbca4945abb21b0e49eb745e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=87955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:48:15.687601 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-7820a7c1-3340-4f8f-b2b7-96f60c0ce7e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:48:15.699389 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 639/1289] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 30 00:48:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:48:15.699389 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7820a7c1-3340-4f8f-b2b7-96f60c0ce7e2 None None] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:48:15.734524 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 651/1290] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 30 00:48:15 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:48:15.736170 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b181da1-6117-4afe-bba3-996ce6a9bd49 None None] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:48:15.736436 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b181da1-6117-4afe-bba3-996ce6a9bd49 None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:48:15.736803 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b181da1-6117-4afe-bba3-996ce6a9bd49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:48:15.759465 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7820a7c1-3340-4f8f-b2b7-96f60c0ce7e2 None None] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:48:15.764000 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.auth.core [None req-2b181da1-6117-4afe-bba3-996ce6a9bd49 None None] MFA Rules not processed for user `25a6cbfaa347401384a15c59a8e44a30`. Rule list: `[]` (Enabled: `True`). {{(pid=87956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:48:15.764617 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a83e5b0-bc2a-407f-91df-c721e116cf9d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5693f186c6ad4d9394f02ee3477cdcd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d2387fdf794d4eaef07bbcd7b39f2a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:48:15.765216 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-2b181da1-6117-4afe-bba3-996ce6a9bd49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:48:15.765670 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a83e5b0-bc2a-407f-91df-c721e116cf9d service neutron] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:48:15.766112 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a83e5b0-bc2a-407f-91df-c721e116cf9d service neutron] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:48:15.766531 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a83e5b0-bc2a-407f-91df-c721e116cf9d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:48:15.777832 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a83e5b0-bc2a-407f-91df-c721e116cf9d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:48:15.779293 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a83e5b0-bc2a-407f-91df-c721e116cf9d service neutron] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:48:15.789113 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 640/1291] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 30 00:48:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 00:48:15.792166 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fd7a9d-5369-47f3-a531-e749f85178c6 None None] REQUEST_METHOD: `POST` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:48:15.792647 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fd7a9d-5369-47f3-a531-e749f85178c6 None None] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:48:15.793150 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fd7a9d-5369-47f3-a531-e749f85178c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:48:15.818016 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.auth.core [None req-21fd7a9d-5369-47f3-a531-e749f85178c6 None None] MFA Rules not processed for user `eb55b6cbca4945abb21b0e49eb745e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=87955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:48:15.819324 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-21fd7a9d-5369-47f3-a531-e749f85178c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:48:15.831168 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 641/1292] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 30 00:48:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:48:15.832723 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8403de-630b-4037-b68b-75311de5e4c6 None None] REQUEST_METHOD: `POST` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:48:15.833016 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8403de-630b-4037-b68b-75311de5e4c6 None None] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:48:15.833291 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8403de-630b-4037-b68b-75311de5e4c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:48:15.839354 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 652/1293] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 30 00:48:15 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:48:15.840274 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b181da1-6117-4afe-bba3-996ce6a9bd49 None None] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:48:15.855348 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b181da1-6117-4afe-bba3-996ce6a9bd49 None None] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:48:15.860022 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a9635d-e697-407d-9ba3-1ae2621d9eaf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5693f186c6ad4d9394f02ee3477cdcd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d2387fdf794d4eaef07bbcd7b39f2a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:48:15.860943 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a9635d-e697-407d-9ba3-1ae2621d9eaf service neutron] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:48:15.861555 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a9635d-e697-407d-9ba3-1ae2621d9eaf service neutron] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:48:15.861766 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a9635d-e697-407d-9ba3-1ae2621d9eaf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:48:15.861956 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.auth.core [None req-ba8403de-630b-4037-b68b-75311de5e4c6 None None] MFA Rules not processed for user `fde877b6ddc74f4a87baf21471eb31d2`. Rule list: `[]` (Enabled: `True`). {{(pid=87955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:48:15.863152 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-ba8403de-630b-4037-b68b-75311de5e4c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:48:15.873816 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a9635d-e697-407d-9ba3-1ae2621d9eaf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:48:15.875739 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a9635d-e697-407d-9ba3-1ae2621d9eaf service neutron] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:48:15.887735 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 653/1294] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 30 00:48:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 00:48:15.888883 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a9635d-e697-407d-9ba3-1ae2621d9eaf service neutron] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:48:15.890248 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-88a9635d-e697-407d-9ba3-1ae2621d9eaf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:48:15.901279 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a9635d-e697-407d-9ba3-1ae2621d9eaf service neutron] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:48:15.905029 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d192bd3-6526-4127-a6a5-ecaa648ba384 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5693f186c6ad4d9394f02ee3477cdcd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d2387fdf794d4eaef07bbcd7b39f2a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:48:15.905636 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d192bd3-6526-4127-a6a5-ecaa648ba384 service neutron] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:48:15.905914 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d192bd3-6526-4127-a6a5-ecaa648ba384 service neutron] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:48:15.906185 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d192bd3-6526-4127-a6a5-ecaa648ba384 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:48:15.916859 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d192bd3-6526-4127-a6a5-ecaa648ba384 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:48:15.918937 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d192bd3-6526-4127-a6a5-ecaa648ba384 service neutron] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:48:15.930524 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 654/1295] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 30 00:48:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 00:48:15.931361 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d192bd3-6526-4127-a6a5-ecaa648ba384 service neutron] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:48:15.941060 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d192bd3-6526-4127-a6a5-ecaa648ba384 service neutron] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:48:15.944814 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 642/1296] 10.222.0.42 () {58 vars in 1058 bytes} [Sun Oct 30 00:48:15 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:48:15.945809 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8403de-630b-4037-b68b-75311de5e4c6 None None] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:48:15.946146 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a6723a-71e2-4a48-bd89-0415176ec266 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:48:15.946975 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a6723a-71e2-4a48-bd89-0415176ec266 admin admin] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:48:15.947353 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a6723a-71e2-4a48-bd89-0415176ec266 admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:48:15.947699 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a6723a-71e2-4a48-bd89-0415176ec266 admin admin] PATH_INFO: `/v3/projects` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:48:15.948420 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a6723a-71e2-4a48-bd89-0415176ec266 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:48:15.950398 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a6723a-71e2-4a48-bd89-0415176ec266 admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:48:15.959145 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8403de-630b-4037-b68b-75311de5e4c6 None None] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:48:15.967303 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=100 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:48:15.969818 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89320d44-c833-4468-9bee-7f2a0fbf3ae9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5693f186c6ad4d9394f02ee3477cdcd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d2387fdf794d4eaef07bbcd7b39f2a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:48:15.971441 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89320d44-c833-4468-9bee-7f2a0fbf3ae9 service neutron] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:48:15.971905 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89320d44-c833-4468-9bee-7f2a0fbf3ae9 service neutron] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:48:15.972374 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89320d44-c833-4468-9bee-7f2a0fbf3ae9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:48:15.983707 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89320d44-c833-4468-9bee-7f2a0fbf3ae9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:48:15.985050 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 655/1297] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 30 00:48:15 2022] POST /identity/v3/projects => generated 387 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 00:48:15.986429 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89320d44-c833-4468-9bee-7f2a0fbf3ae9 service neutron] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:48:15.987333 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093c50e9-0fd6-4bd4-9b0f-a958487409a2 None None] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:48:15.987981 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093c50e9-0fd6-4bd4-9b0f-a958487409a2 None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:48:15.988712 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093c50e9-0fd6-4bd4-9b0f-a958487409a2 None None] PATH_INFO: `/` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:48:15.990563 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 656/1298] 10.222.0.42 () {54 vars in 912 bytes} [Sun Oct 30 00:48:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:48:15.991413 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093c50e9-0fd6-4bd4-9b0f-a958487409a2 None None] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:48:16.001780 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 643/1299] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 30 00:48:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 00:48:16.002876 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89320d44-c833-4468-9bee-7f2a0fbf3ae9 service neutron] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:48:16.016480 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89320d44-c833-4468-9bee-7f2a0fbf3ae9 service neutron] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:48:16.088448 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=100 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:48:16.105864 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093c50e9-0fd6-4bd4-9b0f-a958487409a2 None None] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:48:16.107295 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3faa939b-b559-4675-8d60-7a726673a708 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:48:16.108564 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3faa939b-b559-4675-8d60-7a726673a708 admin admin] REQUEST_METHOD: `POST` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:48:16.108959 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3faa939b-b559-4675-8d60-7a726673a708 admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:48:16.109495 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3faa939b-b559-4675-8d60-7a726673a708 admin admin] PATH_INFO: `/v3/users` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:48:16.110167 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3faa939b-b559-4675-8d60-7a726673a708 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:48:16.112482 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3faa939b-b559-4675-8d60-7a726673a708 admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:48:16.115365 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23987141-7698-4aaf-b37c-8dbe7f9690e8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fde877b6ddc74f4a87baf21471eb31d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d2387fdf794d4eaef07bbcd7b39f2a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:48:16.116142 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23987141-7698-4aaf-b37c-8dbe7f9690e8 service nova] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:48:16.116587 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23987141-7698-4aaf-b37c-8dbe7f9690e8 service nova] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:48:16.117000 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23987141-7698-4aaf-b37c-8dbe7f9690e8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:48:16.144077 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 644/1300] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 30 00:48:16 2022] POST /identity/v3/users => generated 300 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 00:48:16.145671 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e949c248-80fa-40cc-a502-7ec4a688b628 None None] REQUEST_METHOD: `POST` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:48:16.146583 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e949c248-80fa-40cc-a502-7ec4a688b628 None None] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:48:16.146947 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e949c248-80fa-40cc-a502-7ec4a688b628 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:48:16.173062 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.auth.core [None req-e949c248-80fa-40cc-a502-7ec4a688b628 None None] MFA Rules not processed for user `fde877b6ddc74f4a87baf21471eb31d2`. Rule list: `[]` (Enabled: `True`). {{(pid=87955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:48:16.174393 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-e949c248-80fa-40cc-a502-7ec4a688b628 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:48:16.187577 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 645/1301] 10.222.0.42 () {58 vars in 1009 bytes} [Sun Oct 30 00:48:16 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:48:16.205057 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23987141-7698-4aaf-b37c-8dbe7f9690e8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:48:16.207170 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23987141-7698-4aaf-b37c-8dbe7f9690e8 service nova] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:48:16.208526 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e949c248-80fa-40cc-a502-7ec4a688b628 None None] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:48:16.222834 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 657/1302] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 30 00:48:15 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 00:48:16.223657 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23987141-7698-4aaf-b37c-8dbe7f9690e8 service nova] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:48:16.223798 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e949c248-80fa-40cc-a502-7ec4a688b628 None None] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:48:16.229861 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a9adde-f740-4993-a07e-62886c87a070 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:48:16.230513 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a9adde-f740-4993-a07e-62886c87a070 admin admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:48:16.230865 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a9adde-f740-4993-a07e-62886c87a070 admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:48:16.232194 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a9adde-f740-4993-a07e-62886c87a070 admin admin] PATH_INFO: `/v3/roles` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:48:16.233167 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a9adde-f740-4993-a07e-62886c87a070 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:48:16.236609 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a9adde-f740-4993-a07e-62886c87a070 admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:48:16.252115 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 646/1303] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 30 00:48:16 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 00:48:16.256857 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a9adde-f740-4993-a07e-62886c87a070 admin admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:48:16.271109 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a9adde-f740-4993-a07e-62886c87a070 admin admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:48:16.276905 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa703e49-5b78-4750-9799-bd190c8fa815 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:48:16.278986 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa703e49-5b78-4750-9799-bd190c8fa815 admin admin] REQUEST_METHOD: `PUT` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:48:16.279356 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa703e49-5b78-4750-9799-bd190c8fa815 admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:48:16.279697 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa703e49-5b78-4750-9799-bd190c8fa815 admin admin] PATH_INFO: `/v3/projects/99e92956215a4ccb9d60d2aac291b64a/users/fb35e24863c54d56b982bfce79d74af8/roles/6ccaa8c11f29456fb4e4eeccb21616c7` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:48:16.306556 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa703e49-5b78-4750-9799-bd190c8fa815 admin admin] RBAC: Authorizing `identity:create_grant(project_id=99e92956215a4ccb9d60d2aac291b64a, user_id=fb35e24863c54d56b982bfce79d74af8, role_id=6ccaa8c11f29456fb4e4eeccb21616c7)` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:48:16.310446 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa703e49-5b78-4750-9799-bd190c8fa815 admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:48:16.322852 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23987141-7698-4aaf-b37c-8dbe7f9690e8 service nova] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:48:16.332505 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 647/1304] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 30 00:48:16 2022] PUT /identity/v3/projects/99e92956215a4ccb9d60d2aac291b64a/users/fb35e24863c54d56b982bfce79d74af8/roles/6ccaa8c11f29456fb4e4eeccb21616c7 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 00:48:16.336733 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa703e49-5b78-4750-9799-bd190c8fa815 admin admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:48:16.425571 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:48:16.434723 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3ee440-00fc-4e8d-9439-e8f792861c61 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48d928ff7fe24348ac900f09c56acc20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d2387fdf794d4eaef07bbcd7b39f2a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:48:16.435777 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3ee440-00fc-4e8d-9439-e8f792861c61 service cinder] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:48:16.436280 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3ee440-00fc-4e8d-9439-e8f792861c61 service cinder] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:48:16.436979 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3ee440-00fc-4e8d-9439-e8f792861c61 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:48:16.487732 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa703e49-5b78-4750-9799-bd190c8fa815 admin admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:48:16.499570 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242c48f7-d852-481a-ae50-bd71db8f2e1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:48:16.500254 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242c48f7-d852-481a-ae50-bd71db8f2e1f admin admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:48:16.500545 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242c48f7-d852-481a-ae50-bd71db8f2e1f admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:48:16.501135 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242c48f7-d852-481a-ae50-bd71db8f2e1f admin admin] PATH_INFO: `/v3/roles` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:48:16.502522 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242c48f7-d852-481a-ae50-bd71db8f2e1f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:48:16.504973 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242c48f7-d852-481a-ae50-bd71db8f2e1f admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:48:16.533951 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 648/1305] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 30 00:48:16 2022] GET /identity/v3/roles => generated 1420 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 00:48:16.535328 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242c48f7-d852-481a-ae50-bd71db8f2e1f admin admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:48:16.539466 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3ee440-00fc-4e8d-9439-e8f792861c61 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:48:16.541879 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3ee440-00fc-4e8d-9439-e8f792861c61 service cinder] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:48:16.553704 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242c48f7-d852-481a-ae50-bd71db8f2e1f admin admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:48:16.582277 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 658/1306] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 30 00:48:16 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 00:48:16.592287 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9643e2-be1b-4303-9729-c0a33030b733 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:48:16.595941 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9643e2-be1b-4303-9729-c0a33030b733 admin admin] REQUEST_METHOD: `PUT` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:48:16.599775 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9643e2-be1b-4303-9729-c0a33030b733 admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:48:16.599959 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9643e2-be1b-4303-9729-c0a33030b733 admin admin] PATH_INFO: `/v3/projects/99e92956215a4ccb9d60d2aac291b64a/users/fb35e24863c54d56b982bfce79d74af8/roles/6ccaa8c11f29456fb4e4eeccb21616c7` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:48:16.623982 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9643e2-be1b-4303-9729-c0a33030b733 admin admin] RBAC: Authorizing `identity:create_grant(project_id=99e92956215a4ccb9d60d2aac291b64a, user_id=fb35e24863c54d56b982bfce79d74af8, role_id=6ccaa8c11f29456fb4e4eeccb21616c7)` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:48:16.635481 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9643e2-be1b-4303-9729-c0a33030b733 admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:48:16.676934 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 649/1307] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 30 00:48:16 2022] PUT /identity/v3/projects/99e92956215a4ccb9d60d2aac291b64a/users/fb35e24863c54d56b982bfce79d74af8/roles/6ccaa8c11f29456fb4e4eeccb21616c7 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 00:48:16.685938 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26eb18fb-e1ab-40f9-aee1-207535c1383d None None] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:48:16.686262 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bcdb25-3695-46d8-9c78-d2cb57f2a2a5 None None] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:48:16.686545 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26eb18fb-e1ab-40f9-aee1-207535c1383d None None] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:48:16.686923 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26eb18fb-e1ab-40f9-aee1-207535c1383d None None] PATH_INFO: `/` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:48:16.687074 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bcdb25-3695-46d8-9c78-d2cb57f2a2a5 None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:48:16.687539 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bcdb25-3695-46d8-9c78-d2cb57f2a2a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:48:16.688693 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 650/1308] 10.222.0.42 () {54 vars in 912 bytes} [Sun Oct 30 00:48:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:48:16.694836 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde31785-88e4-4891-b4ee-ce9cf4b697d9 None None] REQUEST_METHOD: `POST` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:48:16.696077 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde31785-88e4-4891-b4ee-ce9cf4b697d9 None None] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:48:16.696077 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde31785-88e4-4891-b4ee-ce9cf4b697d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:48:16.734185 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.auth.core [None req-dde31785-88e4-4891-b4ee-ce9cf4b697d9 None None] MFA Rules not processed for user `fde877b6ddc74f4a87baf21471eb31d2`. Rule list: `[]` (Enabled: `True`). {{(pid=87955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:48:16.735596 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-dde31785-88e4-4891-b4ee-ce9cf4b697d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:48:16.750407 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.auth.core [None req-e0bcdb25-3695-46d8-9c78-d2cb57f2a2a5 None None] MFA Rules not processed for user `fb35e24863c54d56b982bfce79d74af8`. Rule list: `[]` (Enabled: `True`). {{(pid=87956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:48:16.752011 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-e0bcdb25-3695-46d8-9c78-d2cb57f2a2a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:48:16.887257 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 651/1309] 10.222.0.42 () {58 vars in 1009 bytes} [Sun Oct 30 00:48:16 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:48:16.902534 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde31785-88e4-4891-b4ee-ce9cf4b697d9 None None] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:48:16.923837 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:48:16.949562 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 659/1310] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 30 00:48:16 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:48:17.010491 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde31785-88e4-4891-b4ee-ce9cf4b697d9 None None] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:48:17.020395 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a501ee-da2d-43e7-b0ce-b3bea623e584 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48d928ff7fe24348ac900f09c56acc20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d2387fdf794d4eaef07bbcd7b39f2a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:48:17.021182 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a501ee-da2d-43e7-b0ce-b3bea623e584 service cinder] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:48:17.021564 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a501ee-da2d-43e7-b0ce-b3bea623e584 service cinder] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:48:17.023063 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a501ee-da2d-43e7-b0ce-b3bea623e584 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:48:17.044013 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a501ee-da2d-43e7-b0ce-b3bea623e584 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:48:17.047679 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a501ee-da2d-43e7-b0ce-b3bea623e584 service cinder] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:48:17.062284 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 652/1311] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 30 00:48:16 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 30 00:48:17.436471 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bcdb25-3695-46d8-9c78-d2cb57f2a2a5 None None] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:48:17.456839 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bcdb25-3695-46d8-9c78-d2cb57f2a2a5 None None] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:48:17.465822 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcf69e3-458c-449e-9c8e-1c6784cb1416 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48d928ff7fe24348ac900f09c56acc20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d2387fdf794d4eaef07bbcd7b39f2a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:48:17.467048 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcf69e3-458c-449e-9c8e-1c6784cb1416 service cinder] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:48:17.468782 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcf69e3-458c-449e-9c8e-1c6784cb1416 service cinder] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:48:17.469052 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcf69e3-458c-449e-9c8e-1c6784cb1416 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:48:17.490370 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dcf69e3-458c-449e-9c8e-1c6784cb1416 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:48:17.493557 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dcf69e3-458c-449e-9c8e-1c6784cb1416 service cinder] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:48:17.527586 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 660/1312] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 30 00:48:17 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 00:48:17.720927 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a501ee-da2d-43e7-b0ce-b3bea623e584 service cinder] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:48:17.757559 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a501ee-da2d-43e7-b0ce-b3bea623e584 service cinder] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:48:17.788763 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253700bc-e2a8-420c-8d0a-53a9ae0501cd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fde877b6ddc74f4a87baf21471eb31d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d2387fdf794d4eaef07bbcd7b39f2a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:48:17.789538 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253700bc-e2a8-420c-8d0a-53a9ae0501cd service nova] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:48:17.791913 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253700bc-e2a8-420c-8d0a-53a9ae0501cd service nova] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:48:17.792324 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253700bc-e2a8-420c-8d0a-53a9ae0501cd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:48:17.955062 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcf69e3-458c-449e-9c8e-1c6784cb1416 service cinder] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:48:17.981718 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253700bc-e2a8-420c-8d0a-53a9ae0501cd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:48:17.986166 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253700bc-e2a8-420c-8d0a-53a9ae0501cd service nova] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:48:18.026368 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 653/1313] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 30 00:48:17 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 00:48:18.115247 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcf69e3-458c-449e-9c8e-1c6784cb1416 service cinder] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:48:18.131900 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befea14d-7209-462c-b07f-fa15c6bcb8a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:48:18.132943 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befea14d-7209-462c-b07f-fa15c6bcb8a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:48:18.133479 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befea14d-7209-462c-b07f-fa15c6bcb8a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:48:18.134130 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befea14d-7209-462c-b07f-fa15c6bcb8a7 admin admin] PATH_INFO: `/v3/users/3874b7420e29447a902c5fae54f761bb` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:48:18.136770 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befea14d-7209-462c-b07f-fa15c6bcb8a7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3874b7420e29447a902c5fae54f761bb)` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:48:18.144436 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befea14d-7209-462c-b07f-fa15c6bcb8a7 admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:48:18.151822 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=100 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:48:18.276794 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-befea14d-7209-462c-b07f-fa15c6bcb8a7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3874b7420e29447a902c5fae54f761bb'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:48:18.277814 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-befea14d-7209-462c-b07f-fa15c6bcb8a7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3874b7420e29447a902c5fae54f761bb'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:48:18.299865 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-befea14d-7209-462c-b07f-fa15c6bcb8a7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3874b7420e29447a902c5fae54f761bb'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:48:18.316459 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-befea14d-7209-462c-b07f-fa15c6bcb8a7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3874b7420e29447a902c5fae54f761bb'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:48:18.328309 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-befea14d-7209-462c-b07f-fa15c6bcb8a7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3874b7420e29447a902c5fae54f761bb'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:48:18.337073 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 661/1314] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 30 00:48:17 2022] DELETE /identity/v3/users/3874b7420e29447a902c5fae54f761bb => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 00:48:18.341751 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad07489-3564-4752-bfb0-ddc0be05d58f None None] REQUEST_METHOD: `POST` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:48:18.342054 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad07489-3564-4752-bfb0-ddc0be05d58f None None] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:48:18.342326 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad07489-3564-4752-bfb0-ddc0be05d58f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:48:18.379930 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.auth.core [None req-0ad07489-3564-4752-bfb0-ddc0be05d58f None None] MFA Rules not processed for user `eb55b6cbca4945abb21b0e49eb745e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=87955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:48:18.381223 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-0ad07489-3564-4752-bfb0-ddc0be05d58f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:48:18.419115 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befea14d-7209-462c-b07f-fa15c6bcb8a7 admin admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:48:18.420568 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-befea14d-7209-462c-b07f-fa15c6bcb8a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:48:18.551945 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 654/1315] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 30 00:48:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:48:18.571875 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befea14d-7209-462c-b07f-fa15c6bcb8a7 admin admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:48:18.582188 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c6ec7f-47a0-4711-a7f4-87ec98e9706a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:48:18.585017 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c6ec7f-47a0-4711-a7f4-87ec98e9706a admin admin] REQUEST_METHOD: `DELETE` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:48:18.585017 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c6ec7f-47a0-4711-a7f4-87ec98e9706a admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:48:18.585370 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c6ec7f-47a0-4711-a7f4-87ec98e9706a admin admin] PATH_INFO: `/v3/users/25a6cbfaa347401384a15c59a8e44a30` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:48:18.591654 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c6ec7f-47a0-4711-a7f4-87ec98e9706a admin admin] RBAC: Authorizing `identity:delete_user(user_id=25a6cbfaa347401384a15c59a8e44a30)` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:48:18.593790 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c6ec7f-47a0-4711-a7f4-87ec98e9706a admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:48:18.629815 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad07489-3564-4752-bfb0-ddc0be05d58f None None] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:48:18.632625 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-0ad07489-3564-4752-bfb0-ddc0be05d58f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:48:18.698987 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-28c6ec7f-47a0-4711-a7f4-87ec98e9706a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '25a6cbfaa347401384a15c59a8e44a30'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:48:18.703858 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-28c6ec7f-47a0-4711-a7f4-87ec98e9706a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '25a6cbfaa347401384a15c59a8e44a30'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:48:18.732433 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-28c6ec7f-47a0-4711-a7f4-87ec98e9706a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '25a6cbfaa347401384a15c59a8e44a30'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:48:18.747786 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-28c6ec7f-47a0-4711-a7f4-87ec98e9706a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '25a6cbfaa347401384a15c59a8e44a30'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:48:18.766838 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-28c6ec7f-47a0-4711-a7f4-87ec98e9706a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '25a6cbfaa347401384a15c59a8e44a30'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:48:18.770389 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:48:18.782284 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 662/1316] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 30 00:48:18 2022] DELETE /identity/v3/users/25a6cbfaa347401384a15c59a8e44a30 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 00:48:18.787980 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98b0950-0bf0-49b3-ac97-b581b245de7b None None] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:48:18.788257 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98b0950-0bf0-49b3-ac97-b581b245de7b None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:48:18.788528 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98b0950-0bf0-49b3-ac97-b581b245de7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:48:18.792462 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad07489-3564-4752-bfb0-ddc0be05d58f None None] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:48:18.801693 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=100 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:48:18.812866 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.auth.core [None req-f98b0950-0bf0-49b3-ac97-b581b245de7b None None] MFA Rules not processed for user `eb55b6cbca4945abb21b0e49eb745e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=87956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:48:18.814558 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-f98b0950-0bf0-49b3-ac97-b581b245de7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:48:18.920584 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2d22c9-09d9-4ecd-a98e-3bd4076af8c6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5693f186c6ad4d9394f02ee3477cdcd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d2387fdf794d4eaef07bbcd7b39f2a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:48:18.921213 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2d22c9-09d9-4ecd-a98e-3bd4076af8c6 service neutron] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:48:18.921490 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2d22c9-09d9-4ecd-a98e-3bd4076af8c6 service neutron] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:48:18.921760 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2d22c9-09d9-4ecd-a98e-3bd4076af8c6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:48:18.923706 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-6d2d22c9-09d9-4ecd-a98e-3bd4076af8c6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:48:18.954720 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 663/1317] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 30 00:48:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:48:19.009004 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98b0950-0bf0-49b3-ac97-b581b245de7b None None] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:48:19.010806 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-f98b0950-0bf0-49b3-ac97-b581b245de7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:48:19.027684 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2d22c9-09d9-4ecd-a98e-3bd4076af8c6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:48:19.029835 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2d22c9-09d9-4ecd-a98e-3bd4076af8c6 service neutron] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:48:19.032706 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98b0950-0bf0-49b3-ac97-b581b245de7b None None] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:48:19.042427 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0342155-ddee-4f9d-8bd5-258f40c37b1e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5693f186c6ad4d9394f02ee3477cdcd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d2387fdf794d4eaef07bbcd7b39f2a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:48:19.044428 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0342155-ddee-4f9d-8bd5-258f40c37b1e service neutron] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:48:19.044817 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0342155-ddee-4f9d-8bd5-258f40c37b1e service neutron] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:48:19.045252 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0342155-ddee-4f9d-8bd5-258f40c37b1e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:48:19.052523 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 655/1318] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 30 00:48:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 00:48:19.070330 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0342155-ddee-4f9d-8bd5-258f40c37b1e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:48:19.070330 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0342155-ddee-4f9d-8bd5-258f40c37b1e service neutron] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:48:19.090723 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 664/1319] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 30 00:48:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 30 00:48:20.330430 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2d22c9-09d9-4ecd-a98e-3bd4076af8c6 service neutron] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:48:20.333199 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-6d2d22c9-09d9-4ecd-a98e-3bd4076af8c6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:48:20.357948 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2d22c9-09d9-4ecd-a98e-3bd4076af8c6 service neutron] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:48:20.371700 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a43cb5b-03aa-4dfa-81ee-3bb6c18ce4ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:48:20.374412 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a43cb5b-03aa-4dfa-81ee-3bb6c18ce4ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:48:20.375087 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a43cb5b-03aa-4dfa-81ee-3bb6c18ce4ec admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:48:20.375567 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a43cb5b-03aa-4dfa-81ee-3bb6c18ce4ec admin admin] PATH_INFO: `/v3/projects/832cfa7333b84aa0a2fb7cc2f226e78f` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:48:20.381558 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a43cb5b-03aa-4dfa-81ee-3bb6c18ce4ec admin admin] RBAC: Authorizing `identity:delete_project(project_id=832cfa7333b84aa0a2fb7cc2f226e78f)` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:48:20.408866 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a43cb5b-03aa-4dfa-81ee-3bb6c18ce4ec admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:48:20.487631 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0342155-ddee-4f9d-8bd5-258f40c37b1e service neutron] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:48:20.487631 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-b0342155-ddee-4f9d-8bd5-258f40c37b1e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:48:20.515033 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0342155-ddee-4f9d-8bd5-258f40c37b1e service neutron] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:48:20.540727 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3284696-4f63-4a02-884b-df71bf61431b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:48:20.541184 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3284696-4f63-4a02-884b-df71bf61431b admin admin] REQUEST_METHOD: `DELETE` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:48:20.541499 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3284696-4f63-4a02-884b-df71bf61431b admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:48:20.541774 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3284696-4f63-4a02-884b-df71bf61431b admin admin] PATH_INFO: `/v3/projects/536b19ac61b4407cb142abb7248a692f` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:48:20.543000 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3284696-4f63-4a02-884b-df71bf61431b admin admin] RBAC: Authorizing `identity:delete_project(project_id=536b19ac61b4407cb142abb7248a692f)` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:48:20.545291 dv-cinder-861491-6-smb devstack@keystone.service[87956]: WARNING py.warnings [None req-e3284696-4f63-4a02-884b-df71bf61431b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 30 00:48:20.545291 dv-cinder-861491-6-smb devstack@keystone.service[87956]: warnings.warn(msg) Oct 30 00:48:20.545291 dv-cinder-861491-6-smb devstack@keystone.service[87956]: Oct 30 00:48:20.546819 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3284696-4f63-4a02-884b-df71bf61431b admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:48:20.575410 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-5a43cb5b-03aa-4dfa-81ee-3bb6c18ce4ec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '832cfa7333b84aa0a2fb7cc2f226e78f', 'request_id': 'req-5a43cb5b-03aa-4dfa-81ee-3bb6c18ce4ec'} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:48:20.589829 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-5a43cb5b-03aa-4dfa-81ee-3bb6c18ce4ec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '832cfa7333b84aa0a2fb7cc2f226e78f', 'request_id': 'req-5a43cb5b-03aa-4dfa-81ee-3bb6c18ce4ec'} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:48:20.609894 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-5a43cb5b-03aa-4dfa-81ee-3bb6c18ce4ec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '832cfa7333b84aa0a2fb7cc2f226e78f', 'request_id': 'req-5a43cb5b-03aa-4dfa-81ee-3bb6c18ce4ec'} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:48:20.634090 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-5a43cb5b-03aa-4dfa-81ee-3bb6c18ce4ec admin admin] The token cache is being invalidate because project 832cfa7333b84aa0a2fb7cc2f226e78f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87955) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 00:48:20.634440 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-5a43cb5b-03aa-4dfa-81ee-3bb6c18ce4ec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:48:20.635246 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-5a43cb5b-03aa-4dfa-81ee-3bb6c18ce4ec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:48:20.636875 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 656/1320] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 30 00:48:20 2022] DELETE /identity/v3/projects/832cfa7333b84aa0a2fb7cc2f226e78f => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 00:48:20.642199 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3c1157-6cd2-473f-a307-a9f9150b5bef None None] REQUEST_METHOD: `POST` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:48:20.642199 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3c1157-6cd2-473f-a307-a9f9150b5bef None None] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:48:20.642199 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3c1157-6cd2-473f-a307-a9f9150b5bef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:48:20.664601 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-e3284696-4f63-4a02-884b-df71bf61431b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '536b19ac61b4407cb142abb7248a692f', 'request_id': 'req-e3284696-4f63-4a02-884b-df71bf61431b'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:48:20.675503 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-e3284696-4f63-4a02-884b-df71bf61431b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '536b19ac61b4407cb142abb7248a692f', 'request_id': 'req-e3284696-4f63-4a02-884b-df71bf61431b'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:48:20.677501 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.auth.core [None req-be3c1157-6cd2-473f-a307-a9f9150b5bef None None] MFA Rules not processed for user `eb55b6cbca4945abb21b0e49eb745e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=87955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:48:20.679327 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-be3c1157-6cd2-473f-a307-a9f9150b5bef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:48:20.704633 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-e3284696-4f63-4a02-884b-df71bf61431b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '536b19ac61b4407cb142abb7248a692f', 'request_id': 'req-e3284696-4f63-4a02-884b-df71bf61431b'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:48:20.732884 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:48:20.733962 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-e3284696-4f63-4a02-884b-df71bf61431b admin admin] The token cache is being invalidate because project 536b19ac61b4407cb142abb7248a692f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87956) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 00:48:20.733962 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-e3284696-4f63-4a02-884b-df71bf61431b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:48:20.735851 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-e3284696-4f63-4a02-884b-df71bf61431b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:48:20.740908 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 665/1321] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 30 00:48:20 2022] DELETE /identity/v3/projects/536b19ac61b4407cb142abb7248a692f => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 00:48:20.742048 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3284696-4f63-4a02-884b-df71bf61431b admin admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:48:20.743969 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-e3284696-4f63-4a02-884b-df71bf61431b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:48:20.802452 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 657/1322] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 30 00:48:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 30 00:48:20.814143 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb78acb-465b-4bad-b0a6-0747f356bee9 None None] REQUEST_METHOD: `POST` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:48:20.814492 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb78acb-465b-4bad-b0a6-0747f356bee9 None None] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:48:20.814907 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb78acb-465b-4bad-b0a6-0747f356bee9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:48:20.889653 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.auth.core [None req-7eb78acb-465b-4bad-b0a6-0747f356bee9 None None] MFA Rules not processed for user `eb55b6cbca4945abb21b0e49eb745e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=87955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:48:20.895882 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-7eb78acb-465b-4bad-b0a6-0747f356bee9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:48:20.933827 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 658/1323] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 30 00:48:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:48:20.939450 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb78acb-465b-4bad-b0a6-0747f356bee9 None None] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:48:20.962062 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb78acb-465b-4bad-b0a6-0747f356bee9 None None] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:48:20.980816 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3284696-4f63-4a02-884b-df71bf61431b admin admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:48:20.983986 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bb1cb8-2107-4da4-a27e-73842d664a89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:48:20.984840 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bb1cb8-2107-4da4-a27e-73842d664a89 admin admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:48:20.985315 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bb1cb8-2107-4da4-a27e-73842d664a89 admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:48:20.985655 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bb1cb8-2107-4da4-a27e-73842d664a89 admin admin] PATH_INFO: `/v3/domains` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:48:20.986384 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4bb1cb8-2107-4da4-a27e-73842d664a89 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:48:20.992210 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4bb1cb8-2107-4da4-a27e-73842d664a89 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:48:20.995706 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4bb1cb8-2107-4da4-a27e-73842d664a89 admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:48:21.009691 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f090e0-3ed4-4d1f-a0c9-7fb512693252 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:48:21.009691 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f090e0-3ed4-4d1f-a0c9-7fb512693252 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:48:21.009691 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f090e0-3ed4-4d1f-a0c9-7fb512693252 admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:48:21.011487 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f090e0-3ed4-4d1f-a0c9-7fb512693252 admin admin] PATH_INFO: `/v3/users/fb35e24863c54d56b982bfce79d74af8` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:48:21.018449 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f090e0-3ed4-4d1f-a0c9-7fb512693252 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fb35e24863c54d56b982bfce79d74af8)` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:48:21.018449 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f090e0-3ed4-4d1f-a0c9-7fb512693252 admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:48:21.032205 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 659/1324] 10.222.0.42 () {58 vars in 1153 bytes} [Sun Oct 30 00:48:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:48:21.036803 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bb1cb8-2107-4da4-a27e-73842d664a89 admin admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:48:21.040525 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:48:21.040697 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-e4bb1cb8-2107-4da4-a27e-73842d664a89 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:48:21.079821 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bb1cb8-2107-4da4-a27e-73842d664a89 admin admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:48:21.101368 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bb6a55-97c1-4092-819c-107b9d0c2a26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:48:21.101843 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bb6a55-97c1-4092-819c-107b9d0c2a26 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:48:21.102125 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bb6a55-97c1-4092-819c-107b9d0c2a26 admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:48:21.102395 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bb6a55-97c1-4092-819c-107b9d0c2a26 admin admin] PATH_INFO: `/v3/users/bb25826fa981459eb69a375233d07ada` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:48:21.103623 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1bb6a55-97c1-4092-819c-107b9d0c2a26 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bb25826fa981459eb69a375233d07ada)` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:48:21.104654 dv-cinder-861491-6-smb devstack@keystone.service[87955]: WARNING py.warnings [None req-d1bb6a55-97c1-4092-819c-107b9d0c2a26 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 30 00:48:21.104654 dv-cinder-861491-6-smb devstack@keystone.service[87955]: warnings.warn(msg) Oct 30 00:48:21.104654 dv-cinder-861491-6-smb devstack@keystone.service[87955]: Oct 30 00:48:21.105936 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1bb6a55-97c1-4092-819c-107b9d0c2a26 admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:48:21.169073 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-76f090e0-3ed4-4d1f-a0c9-7fb512693252 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fb35e24863c54d56b982bfce79d74af8'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:48:21.169910 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-76f090e0-3ed4-4d1f-a0c9-7fb512693252 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fb35e24863c54d56b982bfce79d74af8'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:48:21.203178 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-76f090e0-3ed4-4d1f-a0c9-7fb512693252 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fb35e24863c54d56b982bfce79d74af8'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:48:21.223703 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-76f090e0-3ed4-4d1f-a0c9-7fb512693252 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fb35e24863c54d56b982bfce79d74af8'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:48:21.239279 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-76f090e0-3ed4-4d1f-a0c9-7fb512693252 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fb35e24863c54d56b982bfce79d74af8'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:48:21.278125 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 666/1325] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 30 00:48:20 2022] DELETE /identity/v3/users/fb35e24863c54d56b982bfce79d74af8 => generated 0 bytes in 535 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 00:48:21.290907 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f090e0-3ed4-4d1f-a0c9-7fb512693252 admin admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:48:21.293778 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-d1bb6a55-97c1-4092-819c-107b9d0c2a26 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bb25826fa981459eb69a375233d07ada'} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:48:21.293971 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-76f090e0-3ed4-4d1f-a0c9-7fb512693252 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:48:21.294677 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-d1bb6a55-97c1-4092-819c-107b9d0c2a26 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bb25826fa981459eb69a375233d07ada'} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:48:21.308522 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-d1bb6a55-97c1-4092-819c-107b9d0c2a26 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bb25826fa981459eb69a375233d07ada'} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:48:21.309393 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-d1bb6a55-97c1-4092-819c-107b9d0c2a26 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bb25826fa981459eb69a375233d07ada'} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:48:21.348197 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-d1bb6a55-97c1-4092-819c-107b9d0c2a26 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bb25826fa981459eb69a375233d07ada'} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:48:21.374534 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 660/1326] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 30 00:48:21 2022] DELETE /identity/v3/users/bb25826fa981459eb69a375233d07ada => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 00:48:21.379603 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc03c19-b5f0-46d3-95f7-df15fc0c3997 None None] REQUEST_METHOD: `POST` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:48:21.380540 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc03c19-b5f0-46d3-95f7-df15fc0c3997 None None] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:48:21.380913 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc03c19-b5f0-46d3-95f7-df15fc0c3997 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:48:21.407551 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.auth.core [None req-ffc03c19-b5f0-46d3-95f7-df15fc0c3997 None None] MFA Rules not processed for user `eb55b6cbca4945abb21b0e49eb745e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=87955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:48:21.409049 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-ffc03c19-b5f0-46d3-95f7-df15fc0c3997 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:48:21.441044 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f090e0-3ed4-4d1f-a0c9-7fb512693252 admin admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:48:21.581303 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 661/1327] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 30 00:48:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:48:21.643867 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc03c19-b5f0-46d3-95f7-df15fc0c3997 None None] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:48:21.645308 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-ffc03c19-b5f0-46d3-95f7-df15fc0c3997 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:48:21.654242 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba06e07-90b0-44ee-a5a4-3416b1adb69d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:48:21.654894 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba06e07-90b0-44ee-a5a4-3416b1adb69d admin admin] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:48:21.655172 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba06e07-90b0-44ee-a5a4-3416b1adb69d admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:48:21.655955 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba06e07-90b0-44ee-a5a4-3416b1adb69d admin admin] PATH_INFO: `/v3/projects` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:48:21.656617 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba06e07-90b0-44ee-a5a4-3416b1adb69d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:48:21.658570 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba06e07-90b0-44ee-a5a4-3416b1adb69d admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:48:21.706192 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:48:21.747450 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 667/1328] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 30 00:48:21 2022] POST /identity/v3/projects => generated 357 bytes in 467 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 00:48:21.748937 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc03c19-b5f0-46d3-95f7-df15fc0c3997 None None] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:48:21.749848 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba06e07-90b0-44ee-a5a4-3416b1adb69d admin admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:48:21.756500 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-3ba06e07-90b0-44ee-a5a4-3416b1adb69d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:48:21.798805 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:DELETE=10,keystone:SELECT=88,keystone:INSERT=2 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:48:21.853237 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ed2918-a553-42ff-8c04-d3ccede73fab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5693f186c6ad4d9394f02ee3477cdcd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d2387fdf794d4eaef07bbcd7b39f2a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:48:21.859964 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ed2918-a553-42ff-8c04-d3ccede73fab service neutron] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:48:21.862013 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ed2918-a553-42ff-8c04-d3ccede73fab service neutron] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:48:21.864751 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ed2918-a553-42ff-8c04-d3ccede73fab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:48:21.901286 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba06e07-90b0-44ee-a5a4-3416b1adb69d admin admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:48:21.920475 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddecd2d-8923-45ba-ac4b-15bc6c0fe7d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:48:21.921095 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddecd2d-8923-45ba-ac4b-15bc6c0fe7d9 admin admin] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:48:21.921368 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddecd2d-8923-45ba-ac4b-15bc6c0fe7d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:48:21.921641 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddecd2d-8923-45ba-ac4b-15bc6c0fe7d9 admin admin] PATH_INFO: `/v3/users` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:48:21.927181 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddecd2d-8923-45ba-ac4b-15bc6c0fe7d9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:48:21.929309 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddecd2d-8923-45ba-ac4b-15bc6c0fe7d9 admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:48:21.974583 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 668/1329] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 30 00:48:21 2022] POST /identity/v3/users => generated 279 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 00:48:21.980279 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ed2918-a553-42ff-8c04-d3ccede73fab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:48:21.980766 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddecd2d-8923-45ba-ac4b-15bc6c0fe7d9 admin admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:48:21.983829 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ed2918-a553-42ff-8c04-d3ccede73fab service neutron] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:48:22.012855 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 662/1330] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 30 00:48:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 30 00:48:22.039733 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddecd2d-8923-45ba-ac4b-15bc6c0fe7d9 admin admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:48:22.065253 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6e4efa-fe30-4c06-8829-6f7b34351a71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:48:22.079173 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6e4efa-fe30-4c06-8829-6f7b34351a71 admin admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:48:22.080671 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6e4efa-fe30-4c06-8829-6f7b34351a71 admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:48:22.082899 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6e4efa-fe30-4c06-8829-6f7b34351a71 admin admin] PATH_INFO: `/v3/roles` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:48:22.084058 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6e4efa-fe30-4c06-8829-6f7b34351a71 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:48:22.092543 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6e4efa-fe30-4c06-8829-6f7b34351a71 admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:48:22.110561 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 669/1331] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 30 00:48:21 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 00:48:22.114232 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ed2918-a553-42ff-8c04-d3ccede73fab service neutron] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:48:22.129065 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ed2918-a553-42ff-8c04-d3ccede73fab service neutron] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:48:22.134344 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbe7a38-ad67-44f4-a530-e4addf7a109b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:48:22.135090 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbe7a38-ad67-44f4-a530-e4addf7a109b admin admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:48:22.135496 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbe7a38-ad67-44f4-a530-e4addf7a109b admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:48:22.135834 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbe7a38-ad67-44f4-a530-e4addf7a109b admin admin] PATH_INFO: `/v3/roles` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:48:22.136564 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebbe7a38-ad67-44f4-a530-e4addf7a109b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:48:22.138211 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebbe7a38-ad67-44f4-a530-e4addf7a109b admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:48:22.153199 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 663/1332] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 30 00:48:22 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 00:48:22.154654 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6e4efa-fe30-4c06-8829-6f7b34351a71 admin admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:48:22.172622 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6e4efa-fe30-4c06-8829-6f7b34351a71 admin admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:48:22.181248 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573191d5-ac4d-4ec3-a195-f56fbc58ece5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:48:22.181938 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573191d5-ac4d-4ec3-a195-f56fbc58ece5 admin admin] REQUEST_METHOD: `PUT` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:48:22.182379 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573191d5-ac4d-4ec3-a195-f56fbc58ece5 admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:48:22.182841 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573191d5-ac4d-4ec3-a195-f56fbc58ece5 admin admin] PATH_INFO: `/v3/projects/001d0f86be04403ab185a7b7b2fc2410/users/2f10ee9c6d1b49459b8b72701a9b0461/roles/1c93019874174c4b91118d9ce2347e47` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:48:22.211870 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573191d5-ac4d-4ec3-a195-f56fbc58ece5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=001d0f86be04403ab185a7b7b2fc2410, user_id=2f10ee9c6d1b49459b8b72701a9b0461, role_id=1c93019874174c4b91118d9ce2347e47)` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:48:22.217158 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573191d5-ac4d-4ec3-a195-f56fbc58ece5 admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:48:22.248193 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 670/1333] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 30 00:48:22 2022] PUT /identity/v3/projects/001d0f86be04403ab185a7b7b2fc2410/users/2f10ee9c6d1b49459b8b72701a9b0461/roles/1c93019874174c4b91118d9ce2347e47 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 00:48:22.259912 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7068ebd8-062b-4281-a2bb-4655098dc769 None None] REQUEST_METHOD: `POST` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:48:22.260187 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7068ebd8-062b-4281-a2bb-4655098dc769 None None] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:48:22.260620 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7068ebd8-062b-4281-a2bb-4655098dc769 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:48:22.338540 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.auth.core [None req-7068ebd8-062b-4281-a2bb-4655098dc769 None None] MFA Rules not processed for user `2f10ee9c6d1b49459b8b72701a9b0461`. Rule list: `[]` (Enabled: `True`). {{(pid=87955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:48:22.341089 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-7068ebd8-062b-4281-a2bb-4655098dc769 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:48:22.442357 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 664/1334] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 30 00:48:22 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:48:22.446744 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573191d5-ac4d-4ec3-a195-f56fbc58ece5 admin admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:48:22.750754 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573191d5-ac4d-4ec3-a195-f56fbc58ece5 admin admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:48:22.763383 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12ba1fa-7bc7-47c9-b165-cb38c49005d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:48:22.767434 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12ba1fa-7bc7-47c9-b165-cb38c49005d6 admin admin] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:48:22.767434 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12ba1fa-7bc7-47c9-b165-cb38c49005d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:48:22.767434 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12ba1fa-7bc7-47c9-b165-cb38c49005d6 admin admin] PATH_INFO: `/v3/projects` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:48:22.767434 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12ba1fa-7bc7-47c9-b165-cb38c49005d6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:48:22.768002 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12ba1fa-7bc7-47c9-b165-cb38c49005d6 admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:48:22.830302 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 671/1335] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 30 00:48:22 2022] POST /identity/v3/projects => generated 357 bytes in 384 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 00:48:22.834579 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7068ebd8-062b-4281-a2bb-4655098dc769 None None] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:48:22.854759 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7068ebd8-062b-4281-a2bb-4655098dc769 None None] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:48:22.928113 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=100 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:48:23.080051 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2181412f-2278-453e-ae8e-7aaa75c00cd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:48:23.080945 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2181412f-2278-453e-ae8e-7aaa75c00cd1 admin admin] REQUEST_METHOD: `POST` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:48:23.081430 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2181412f-2278-453e-ae8e-7aaa75c00cd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:48:23.081898 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2181412f-2278-453e-ae8e-7aaa75c00cd1 admin admin] PATH_INFO: `/v3/users` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:48:23.083251 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2181412f-2278-453e-ae8e-7aaa75c00cd1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:48:23.085727 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2181412f-2278-453e-ae8e-7aaa75c00cd1 admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:48:23.127278 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 665/1336] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 30 00:48:22 2022] POST /identity/v3/users => generated 285 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 00:48:23.131783 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12ba1fa-7bc7-47c9-b165-cb38c49005d6 admin admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:48:23.148676 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12ba1fa-7bc7-47c9-b165-cb38c49005d6 admin admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:48:23.156627 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544a5cbe-b69b-47d1-99d0-4a75f42cc8e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:48:23.157830 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544a5cbe-b69b-47d1-99d0-4a75f42cc8e2 admin admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:48:23.158317 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544a5cbe-b69b-47d1-99d0-4a75f42cc8e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:48:23.158802 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544a5cbe-b69b-47d1-99d0-4a75f42cc8e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:48:23.159704 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544a5cbe-b69b-47d1-99d0-4a75f42cc8e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:48:23.162037 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544a5cbe-b69b-47d1-99d0-4a75f42cc8e2 admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:48:23.181334 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 672/1337] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 30 00:48:23 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 00:48:23.185692 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2181412f-2278-453e-ae8e-7aaa75c00cd1 admin admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:48:23.201033 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2181412f-2278-453e-ae8e-7aaa75c00cd1 admin admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:48:23.213564 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa17bdbd-5f2f-493f-beb8-b04e3b01785d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:48:23.214332 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa17bdbd-5f2f-493f-beb8-b04e3b01785d admin admin] REQUEST_METHOD: `PUT` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:48:23.217527 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa17bdbd-5f2f-493f-beb8-b04e3b01785d admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:48:23.217942 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa17bdbd-5f2f-493f-beb8-b04e3b01785d admin admin] PATH_INFO: `/v3/projects/674d0c9628e44ac6bd85a6991868b3f1/users/c8453468624c4302a55c9849086e242c/roles/6ccaa8c11f29456fb4e4eeccb21616c7` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:48:23.271374 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa17bdbd-5f2f-493f-beb8-b04e3b01785d admin admin] RBAC: Authorizing `identity:create_grant(project_id=674d0c9628e44ac6bd85a6991868b3f1, user_id=c8453468624c4302a55c9849086e242c, role_id=6ccaa8c11f29456fb4e4eeccb21616c7)` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:48:23.278305 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa17bdbd-5f2f-493f-beb8-b04e3b01785d admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:48:23.311413 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 666/1338] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 30 00:48:23 2022] PUT /identity/v3/projects/674d0c9628e44ac6bd85a6991868b3f1/users/c8453468624c4302a55c9849086e242c/roles/6ccaa8c11f29456fb4e4eeccb21616c7 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 00:48:23.315380 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544a5cbe-b69b-47d1-99d0-4a75f42cc8e2 admin admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:48:23.327860 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544a5cbe-b69b-47d1-99d0-4a75f42cc8e2 admin admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:48:23.413416 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:48:23.443681 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15785a26-b5a5-4542-afd3-b5449930d833 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:48:23.445688 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15785a26-b5a5-4542-afd3-b5449930d833 admin admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:48:23.446089 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15785a26-b5a5-4542-afd3-b5449930d833 admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:48:23.446497 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15785a26-b5a5-4542-afd3-b5449930d833 admin admin] PATH_INFO: `/v3/roles` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:48:23.447509 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15785a26-b5a5-4542-afd3-b5449930d833 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:48:23.450003 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15785a26-b5a5-4542-afd3-b5449930d833 admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:48:23.468096 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa17bdbd-5f2f-493f-beb8-b04e3b01785d admin admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:48:23.479481 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 673/1339] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 30 00:48:23 2022] GET /identity/v3/roles => generated 1420 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 00:48:23.481157 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa17bdbd-5f2f-493f-beb8-b04e3b01785d admin admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:48:23.487158 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7786e90e-3c73-4bc2-859a-7f4e9161a672 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:48:23.488199 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7786e90e-3c73-4bc2-859a-7f4e9161a672 admin admin] REQUEST_METHOD: `PUT` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:48:23.488579 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7786e90e-3c73-4bc2-859a-7f4e9161a672 admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:48:23.488952 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7786e90e-3c73-4bc2-859a-7f4e9161a672 admin admin] PATH_INFO: `/v3/projects/674d0c9628e44ac6bd85a6991868b3f1/users/c8453468624c4302a55c9849086e242c/roles/6ccaa8c11f29456fb4e4eeccb21616c7` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:48:23.495360 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7786e90e-3c73-4bc2-859a-7f4e9161a672 admin admin] RBAC: Authorizing `identity:create_grant(project_id=674d0c9628e44ac6bd85a6991868b3f1, user_id=c8453468624c4302a55c9849086e242c, role_id=6ccaa8c11f29456fb4e4eeccb21616c7)` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:48:23.498368 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7786e90e-3c73-4bc2-859a-7f4e9161a672 admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:48:23.523562 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9502521-2f66-42eb-aaa9-5d0c19512f61 None None] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:48:23.524372 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9502521-2f66-42eb-aaa9-5d0c19512f61 None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:48:23.524888 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9502521-2f66-42eb-aaa9-5d0c19512f61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:48:23.543502 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 667/1340] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 30 00:48:23 2022] PUT /identity/v3/projects/674d0c9628e44ac6bd85a6991868b3f1/users/c8453468624c4302a55c9849086e242c/roles/6ccaa8c11f29456fb4e4eeccb21616c7 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 00:48:23.594144 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.auth.core [None req-a9502521-2f66-42eb-aaa9-5d0c19512f61 None None] MFA Rules not processed for user `c8453468624c4302a55c9849086e242c`. Rule list: `[]` (Enabled: `True`). {{(pid=87956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:48:23.595338 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-a9502521-2f66-42eb-aaa9-5d0c19512f61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:48:23.692257 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 674/1341] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 30 00:48:23 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:48:23.703987 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7786e90e-3c73-4bc2-859a-7f4e9161a672 admin admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:48:23.705852 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-7786e90e-3c73-4bc2-859a-7f4e9161a672 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:48:23.793294 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7786e90e-3c73-4bc2-859a-7f4e9161a672 admin admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:48:23.797030 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b9d72f-93e8-499e-903f-769b34ea4704 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48d928ff7fe24348ac900f09c56acc20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d2387fdf794d4eaef07bbcd7b39f2a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:48:23.798845 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9502521-2f66-42eb-aaa9-5d0c19512f61 None None] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:48:23.799462 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b9d72f-93e8-499e-903f-769b34ea4704 service cinder] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:48:23.800358 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-a9502521-2f66-42eb-aaa9-5d0c19512f61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:48:23.806080 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b9d72f-93e8-499e-903f-769b34ea4704 service cinder] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:48:23.806356 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b9d72f-93e8-499e-903f-769b34ea4704 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:48:23.845821 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b9d72f-93e8-499e-903f-769b34ea4704 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:48:23.848113 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b9d72f-93e8-499e-903f-769b34ea4704 service cinder] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:48:23.888055 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 668/1342] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 30 00:48:23 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 00:48:23.972659 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9502521-2f66-42eb-aaa9-5d0c19512f61 None None] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:48:23.983128 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae450c9f-00f0-4106-91a0-0e41ca460685 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:48:23.984092 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae450c9f-00f0-4106-91a0-0e41ca460685 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:48:23.984624 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae450c9f-00f0-4106-91a0-0e41ca460685 admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:48:23.985038 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae450c9f-00f0-4106-91a0-0e41ca460685 admin admin] PATH_INFO: `/v3/projects/99e92956215a4ccb9d60d2aac291b64a` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:48:23.986846 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae450c9f-00f0-4106-91a0-0e41ca460685 admin admin] RBAC: Authorizing `identity:delete_project(project_id=99e92956215a4ccb9d60d2aac291b64a)` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:48:23.989023 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae450c9f-00f0-4106-91a0-0e41ca460685 admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:48:24.057372 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b9d72f-93e8-499e-903f-769b34ea4704 service cinder] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:48:24.069642 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b9d72f-93e8-499e-903f-769b34ea4704 service cinder] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:48:24.109170 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-ae450c9f-00f0-4106-91a0-0e41ca460685 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '99e92956215a4ccb9d60d2aac291b64a', 'request_id': 'req-ae450c9f-00f0-4106-91a0-0e41ca460685'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:48:24.129415 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-ae450c9f-00f0-4106-91a0-0e41ca460685 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '99e92956215a4ccb9d60d2aac291b64a', 'request_id': 'req-ae450c9f-00f0-4106-91a0-0e41ca460685'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:48:24.140031 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-ae450c9f-00f0-4106-91a0-0e41ca460685 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '99e92956215a4ccb9d60d2aac291b64a', 'request_id': 'req-ae450c9f-00f0-4106-91a0-0e41ca460685'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:48:24.158456 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:48:24.169627 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-ae450c9f-00f0-4106-91a0-0e41ca460685 admin admin] The token cache is being invalidate because project 99e92956215a4ccb9d60d2aac291b64a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87956) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 00:48:24.169753 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-ae450c9f-00f0-4106-91a0-0e41ca460685 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:48:24.171911 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-ae450c9f-00f0-4106-91a0-0e41ca460685 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:48:24.176688 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 675/1343] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 30 00:48:23 2022] DELETE /identity/v3/projects/99e92956215a4ccb9d60d2aac291b64a => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 00:48:24.178348 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae450c9f-00f0-4106-91a0-0e41ca460685 admin admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:48:24.182466 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-ae450c9f-00f0-4106-91a0-0e41ca460685 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:48:24.204323 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a745374b-12af-40ca-b836-bf63effb3974 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48d928ff7fe24348ac900f09c56acc20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d2387fdf794d4eaef07bbcd7b39f2a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:48:24.204954 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a745374b-12af-40ca-b836-bf63effb3974 service cinder] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:48:24.206771 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a745374b-12af-40ca-b836-bf63effb3974 service cinder] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:48:24.208386 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a745374b-12af-40ca-b836-bf63effb3974 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:48:24.213716 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-a745374b-12af-40ca-b836-bf63effb3974 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:48:24.282835 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:48:24.340891 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae450c9f-00f0-4106-91a0-0e41ca460685 admin admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:48:24.353737 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a745374b-12af-40ca-b836-bf63effb3974 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:48:24.355426 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a745374b-12af-40ca-b836-bf63effb3974 service cinder] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:48:24.356305 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9ae0cf-8ce7-45b5-bdd0-4905a88d0c11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:48:24.358055 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9ae0cf-8ce7-45b5-bdd0-4905a88d0c11 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:48:24.358339 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9ae0cf-8ce7-45b5-bdd0-4905a88d0c11 admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:48:24.359749 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9ae0cf-8ce7-45b5-bdd0-4905a88d0c11 admin admin] PATH_INFO: `/v3/users/ea285bd64be444a9a5184fae7b471d64` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:48:24.363987 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9ae0cf-8ce7-45b5-bdd0-4905a88d0c11 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ea285bd64be444a9a5184fae7b471d64)` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:48:24.366540 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 669/1344] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 30 00:48:24 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 00:48:24.367906 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f19d789-bb75-406a-9352-1d4e85471f94 None None] REQUEST_METHOD: `POST` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:48:24.368289 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f19d789-bb75-406a-9352-1d4e85471f94 None None] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:48:24.368471 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f19d789-bb75-406a-9352-1d4e85471f94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:48:24.370799 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9ae0cf-8ce7-45b5-bdd0-4905a88d0c11 admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:48:24.397126 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.auth.core [None req-4f19d789-bb75-406a-9352-1d4e85471f94 None None] MFA Rules not processed for user `eb55b6cbca4945abb21b0e49eb745e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=87955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:48:24.398355 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-4f19d789-bb75-406a-9352-1d4e85471f94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:48:24.407694 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 670/1345] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 30 00:48:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:48:24.408541 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f19d789-bb75-406a-9352-1d4e85471f94 None None] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:48:24.409814 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-4f19d789-bb75-406a-9352-1d4e85471f94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:48:24.426002 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f19d789-bb75-406a-9352-1d4e85471f94 None None] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:48:24.433937 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b81aff0-0096-4554-8770-b2ffb5e2a699 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:48:24.434970 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b81aff0-0096-4554-8770-b2ffb5e2a699 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:48:24.435359 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b81aff0-0096-4554-8770-b2ffb5e2a699 admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:48:24.435654 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b81aff0-0096-4554-8770-b2ffb5e2a699 admin admin] PATH_INFO: `/v3/projects/e83381c53fab4c9f8955d79d24f06f16` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:48:24.437246 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b81aff0-0096-4554-8770-b2ffb5e2a699 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e83381c53fab4c9f8955d79d24f06f16)` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:48:24.439553 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b81aff0-0096-4554-8770-b2ffb5e2a699 admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:48:24.500419 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-fd9ae0cf-8ce7-45b5-bdd0-4905a88d0c11 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ea285bd64be444a9a5184fae7b471d64'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:48:24.501656 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-fd9ae0cf-8ce7-45b5-bdd0-4905a88d0c11 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ea285bd64be444a9a5184fae7b471d64'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:48:24.533866 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-6b81aff0-0096-4554-8770-b2ffb5e2a699 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e83381c53fab4c9f8955d79d24f06f16', 'request_id': 'req-6b81aff0-0096-4554-8770-b2ffb5e2a699'} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:48:24.542815 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-6b81aff0-0096-4554-8770-b2ffb5e2a699 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e83381c53fab4c9f8955d79d24f06f16', 'request_id': 'req-6b81aff0-0096-4554-8770-b2ffb5e2a699'} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:48:24.549011 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-fd9ae0cf-8ce7-45b5-bdd0-4905a88d0c11 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ea285bd64be444a9a5184fae7b471d64'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:48:24.560961 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-6b81aff0-0096-4554-8770-b2ffb5e2a699 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e83381c53fab4c9f8955d79d24f06f16', 'request_id': 'req-6b81aff0-0096-4554-8770-b2ffb5e2a699'} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:48:24.577806 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-fd9ae0cf-8ce7-45b5-bdd0-4905a88d0c11 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ea285bd64be444a9a5184fae7b471d64'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:48:24.597933 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-fd9ae0cf-8ce7-45b5-bdd0-4905a88d0c11 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ea285bd64be444a9a5184fae7b471d64'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:48:24.606550 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-6b81aff0-0096-4554-8770-b2ffb5e2a699 admin admin] The token cache is being invalidate because project e83381c53fab4c9f8955d79d24f06f16 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87955) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 00:48:24.607166 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-6b81aff0-0096-4554-8770-b2ffb5e2a699 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:48:24.608050 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-6b81aff0-0096-4554-8770-b2ffb5e2a699 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:48:24.612014 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 671/1346] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 30 00:48:24 2022] DELETE /identity/v3/projects/e83381c53fab4c9f8955d79d24f06f16 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 00:48:24.613607 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03ee729-3928-4406-b297-3590d118596f None None] REQUEST_METHOD: `POST` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:48:24.614042 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03ee729-3928-4406-b297-3590d118596f None None] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:48:24.614693 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03ee729-3928-4406-b297-3590d118596f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:48:24.628554 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 676/1347] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 30 00:48:24 2022] DELETE /identity/v3/users/ea285bd64be444a9a5184fae7b471d64 => generated 0 bytes in 449 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 00:48:24.632045 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e85fdc6-ecd4-4b30-865d-7e318ddfb16c None None] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:48:24.632268 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e85fdc6-ecd4-4b30-865d-7e318ddfb16c None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:48:24.632710 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e85fdc6-ecd4-4b30-865d-7e318ddfb16c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:48:24.648475 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.auth.core [None req-b03ee729-3928-4406-b297-3590d118596f None None] MFA Rules not processed for user `eb55b6cbca4945abb21b0e49eb745e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=87955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:48:24.649989 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-b03ee729-3928-4406-b297-3590d118596f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:48:24.714033 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.auth.core [None req-7e85fdc6-ecd4-4b30-865d-7e318ddfb16c None None] MFA Rules not processed for user `eb55b6cbca4945abb21b0e49eb745e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=87956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:48:24.720092 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-7e85fdc6-ecd4-4b30-865d-7e318ddfb16c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:48:24.797707 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 672/1348] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 30 00:48:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:48:24.797707 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36992e5-991c-4f9d-bb32-6df684b8d485 None None] REQUEST_METHOD: `POST` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:48:24.797707 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36992e5-991c-4f9d-bb32-6df684b8d485 None None] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:48:24.797707 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36992e5-991c-4f9d-bb32-6df684b8d485 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:48:24.827271 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.auth.core [None req-a36992e5-991c-4f9d-bb32-6df684b8d485 None None] MFA Rules not processed for user `eb55b6cbca4945abb21b0e49eb745e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=87955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:48:24.830009 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-a36992e5-991c-4f9d-bb32-6df684b8d485 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:48:24.863349 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 673/1349] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 30 00:48:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:48:24.866100 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36992e5-991c-4f9d-bb32-6df684b8d485 None None] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:48:24.881141 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36992e5-991c-4f9d-bb32-6df684b8d485 None None] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:48:24.888931 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cb5401-807c-41f3-a2c2-ec9013d31d53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:48:24.889877 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cb5401-807c-41f3-a2c2-ec9013d31d53 admin admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:48:24.890804 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cb5401-807c-41f3-a2c2-ec9013d31d53 admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:48:24.891251 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cb5401-807c-41f3-a2c2-ec9013d31d53 admin admin] PATH_INFO: `/v3/domains` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:48:24.898798 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5cb5401-807c-41f3-a2c2-ec9013d31d53 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:48:24.898798 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5cb5401-807c-41f3-a2c2-ec9013d31d53 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:48:24.900791 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5cb5401-807c-41f3-a2c2-ec9013d31d53 admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:48:24.921129 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 674/1350] 10.222.0.42 () {58 vars in 1153 bytes} [Sun Oct 30 00:48:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:48:24.926128 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cb5401-807c-41f3-a2c2-ec9013d31d53 admin admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:48:24.934641 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 677/1351] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 30 00:48:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 300 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:48:24.936315 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d5d059-8eec-456e-96d4-02919a929f23 None None] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:48:24.936578 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d5d059-8eec-456e-96d4-02919a929f23 None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:48:24.936804 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d5d059-8eec-456e-96d4-02919a929f23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:48:24.946774 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cb5401-807c-41f3-a2c2-ec9013d31d53 admin admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:48:24.965089 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393b4e6e-f57b-4ed1-8e15-cd3599ce43a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:48:24.966134 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393b4e6e-f57b-4ed1-8e15-cd3599ce43a8 admin admin] REQUEST_METHOD: `POST` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:48:24.969509 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393b4e6e-f57b-4ed1-8e15-cd3599ce43a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:48:24.969914 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393b4e6e-f57b-4ed1-8e15-cd3599ce43a8 admin admin] PATH_INFO: `/v3/projects` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:48:24.970846 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393b4e6e-f57b-4ed1-8e15-cd3599ce43a8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:48:24.972682 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393b4e6e-f57b-4ed1-8e15-cd3599ce43a8 admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:48:24.972903 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.auth.core [None req-92d5d059-8eec-456e-96d4-02919a929f23 None None] MFA Rules not processed for user `eb55b6cbca4945abb21b0e49eb745e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=87956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:48:24.974148 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-92d5d059-8eec-456e-96d4-02919a929f23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:48:24.992782 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 678/1352] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 30 00:48:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 30 00:48:24.993729 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d5d059-8eec-456e-96d4-02919a929f23 None None] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:48:24.996892 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-92d5d059-8eec-456e-96d4-02919a929f23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:48:25.033522 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:48:25.039989 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 675/1353] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 30 00:48:24 2022] POST /identity/v3/projects => generated 407 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 30 00:48:25.039989 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393b4e6e-f57b-4ed1-8e15-cd3599ce43a8 admin admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:48:25.052818 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:48:25.120358 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d5d059-8eec-456e-96d4-02919a929f23 None None] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:48:25.181505 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393b4e6e-f57b-4ed1-8e15-cd3599ce43a8 admin admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:48:25.196241 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e648fd3-a4a7-49c1-9e96-1115cba1fd0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:48:25.197128 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e648fd3-a4a7-49c1-9e96-1115cba1fd0d admin admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:48:25.197128 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e648fd3-a4a7-49c1-9e96-1115cba1fd0d admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:48:25.197472 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e648fd3-a4a7-49c1-9e96-1115cba1fd0d admin admin] PATH_INFO: `/v3/domains` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:48:25.198229 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e648fd3-a4a7-49c1-9e96-1115cba1fd0d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:48:25.198538 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e648fd3-a4a7-49c1-9e96-1115cba1fd0d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:48:25.200588 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e648fd3-a4a7-49c1-9e96-1115cba1fd0d admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:48:25.220465 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 676/1354] 10.222.0.42 () {58 vars in 1153 bytes} [Sun Oct 30 00:48:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:48:25.221115 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e648fd3-a4a7-49c1-9e96-1115cba1fd0d admin admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:48:25.224484 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3d1189-6003-4304-97da-ad935a1cbf28 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5693f186c6ad4d9394f02ee3477cdcd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d2387fdf794d4eaef07bbcd7b39f2a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:48:25.225503 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3d1189-6003-4304-97da-ad935a1cbf28 service neutron] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:48:25.225503 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3d1189-6003-4304-97da-ad935a1cbf28 service neutron] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:48:25.225737 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3d1189-6003-4304-97da-ad935a1cbf28 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:48:25.244682 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3d1189-6003-4304-97da-ad935a1cbf28 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:48:25.246143 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3d1189-6003-4304-97da-ad935a1cbf28 service neutron] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:48:25.250465 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e648fd3-a4a7-49c1-9e96-1115cba1fd0d admin admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:48:25.261498 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6d2fa6-16da-48cc-9b4a-9137fa1391ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:48:25.262144 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6d2fa6-16da-48cc-9b4a-9137fa1391ce admin admin] REQUEST_METHOD: `POST` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:48:25.262426 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6d2fa6-16da-48cc-9b4a-9137fa1391ce admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:48:25.263188 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6d2fa6-16da-48cc-9b4a-9137fa1391ce admin admin] PATH_INFO: `/v3/users` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:48:25.263352 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6d2fa6-16da-48cc-9b4a-9137fa1391ce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:48:25.265581 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6d2fa6-16da-48cc-9b4a-9137fa1391ce admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:48:25.268336 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 679/1355] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 30 00:48:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 275 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 00:48:25.269298 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3d1189-6003-4304-97da-ad935a1cbf28 service neutron] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:48:25.286894 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3d1189-6003-4304-97da-ad935a1cbf28 service neutron] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:48:25.293949 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285975b3-648c-4246-9f73-8322741e171c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:48:25.296476 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285975b3-648c-4246-9f73-8322741e171c admin admin] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:48:25.296795 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285975b3-648c-4246-9f73-8322741e171c admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:48:25.297066 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285975b3-648c-4246-9f73-8322741e171c admin admin] PATH_INFO: `/v3/projects` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:48:25.297749 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285975b3-648c-4246-9f73-8322741e171c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:48:25.299869 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285975b3-648c-4246-9f73-8322741e171c admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:48:25.311157 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 677/1356] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 30 00:48:25 2022] POST /identity/v3/users => generated 304 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 00:48:25.312237 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6d2fa6-16da-48cc-9b4a-9137fa1391ce admin admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:48:25.325798 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6d2fa6-16da-48cc-9b4a-9137fa1391ce admin admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:48:25.330869 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29ec3bd-49e0-408a-bf73-38180f362367 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:48:25.331525 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29ec3bd-49e0-408a-bf73-38180f362367 admin admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:48:25.332115 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29ec3bd-49e0-408a-bf73-38180f362367 admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:48:25.332388 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29ec3bd-49e0-408a-bf73-38180f362367 admin admin] PATH_INFO: `/v3/roles` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:48:25.333043 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29ec3bd-49e0-408a-bf73-38180f362367 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:48:25.334748 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29ec3bd-49e0-408a-bf73-38180f362367 admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:48:25.351023 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 678/1357] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 30 00:48:25 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 00:48:25.352943 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29ec3bd-49e0-408a-bf73-38180f362367 admin admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:48:25.364201 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 680/1358] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 30 00:48:25 2022] POST /identity/v3/projects => generated 363 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 00:48:25.365299 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29ec3bd-49e0-408a-bf73-38180f362367 admin admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:48:25.369120 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285975b3-648c-4246-9f73-8322741e171c admin admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:48:25.441796 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cac752-5601-4ab7-90bf-5f35357997f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:48:25.443468 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cac752-5601-4ab7-90bf-5f35357997f8 admin admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:48:25.443988 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cac752-5601-4ab7-90bf-5f35357997f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:48:25.444536 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cac752-5601-4ab7-90bf-5f35357997f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:48:25.445647 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5cac752-5601-4ab7-90bf-5f35357997f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:48:25.448581 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5cac752-5601-4ab7-90bf-5f35357997f8 admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:48:25.464868 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 679/1359] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 30 00:48:25 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 00:48:25.468699 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cac752-5601-4ab7-90bf-5f35357997f8 admin admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:48:25.484335 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cac752-5601-4ab7-90bf-5f35357997f8 admin admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:48:25.494676 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73668a6c-783c-48c8-8b26-520d14cf0853 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:48:25.496049 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73668a6c-783c-48c8-8b26-520d14cf0853 admin admin] REQUEST_METHOD: `PUT` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:48:25.496529 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73668a6c-783c-48c8-8b26-520d14cf0853 admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:48:25.497039 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73668a6c-783c-48c8-8b26-520d14cf0853 admin admin] PATH_INFO: `/v3/projects/c92b36400cb44e229934a54fdff13ec6/users/1ba83867601d44679ad87d9b6ded24df/roles/1c93019874174c4b91118d9ce2347e47` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:48:25.521906 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73668a6c-783c-48c8-8b26-520d14cf0853 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c92b36400cb44e229934a54fdff13ec6, user_id=1ba83867601d44679ad87d9b6ded24df, role_id=1c93019874174c4b91118d9ce2347e47)` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:48:25.529193 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73668a6c-783c-48c8-8b26-520d14cf0853 admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:48:25.533804 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285975b3-648c-4246-9f73-8322741e171c admin admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:48:25.540485 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162d4d75-f918-4777-b580-0b98357c3e20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:48:25.542117 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162d4d75-f918-4777-b580-0b98357c3e20 admin admin] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:48:25.542858 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162d4d75-f918-4777-b580-0b98357c3e20 admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:48:25.542858 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162d4d75-f918-4777-b580-0b98357c3e20 admin admin] PATH_INFO: `/v3/users` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:48:25.543980 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162d4d75-f918-4777-b580-0b98357c3e20 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:48:25.546544 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162d4d75-f918-4777-b580-0b98357c3e20 admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:48:25.558427 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 680/1360] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 30 00:48:25 2022] PUT /identity/v3/projects/c92b36400cb44e229934a54fdff13ec6/users/1ba83867601d44679ad87d9b6ded24df/roles/1c93019874174c4b91118d9ce2347e47 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 00:48:25.569957 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55506d11-d2de-4d96-9f6d-dabfa886baff None None] REQUEST_METHOD: `POST` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:48:25.570640 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55506d11-d2de-4d96-9f6d-dabfa886baff None None] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:48:25.570929 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55506d11-d2de-4d96-9f6d-dabfa886baff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:48:25.581398 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 681/1361] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 30 00:48:25 2022] POST /identity/v3/users => generated 282 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 00:48:25.583797 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162d4d75-f918-4777-b580-0b98357c3e20 admin admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:48:25.609193 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162d4d75-f918-4777-b580-0b98357c3e20 admin admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:48:25.641473 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.auth.core [None req-55506d11-d2de-4d96-9f6d-dabfa886baff None None] MFA Rules not processed for user `1ba83867601d44679ad87d9b6ded24df`. Rule list: `[]` (Enabled: `True`). {{(pid=87955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:48:25.643023 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-55506d11-d2de-4d96-9f6d-dabfa886baff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:48:25.713684 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:48:25.726878 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:48:25.773153 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a2d74b-37a0-4e79-9232-69de8807da79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:48:25.773838 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a2d74b-37a0-4e79-9232-69de8807da79 admin admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:48:25.775080 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a2d74b-37a0-4e79-9232-69de8807da79 admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:48:25.775773 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a2d74b-37a0-4e79-9232-69de8807da79 admin admin] PATH_INFO: `/v3/roles` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:48:25.777658 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a2d74b-37a0-4e79-9232-69de8807da79 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:48:25.780646 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a2d74b-37a0-4e79-9232-69de8807da79 admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:48:25.845304 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 682/1362] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 30 00:48:25 2022] GET /identity/v3/roles => generated 1420 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 00:48:25.848958 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a2d74b-37a0-4e79-9232-69de8807da79 admin admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:48:25.872940 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 681/1363] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 30 00:48:25 2022] POST /identity/v3/auth/tokens => generated 3284 bytes in 303 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:48:25.877342 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55506d11-d2de-4d96-9f6d-dabfa886baff None None] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:48:25.887307 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-55506d11-d2de-4d96-9f6d-dabfa886baff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:48:25.890257 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a2d74b-37a0-4e79-9232-69de8807da79 admin admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:48:25.918475 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69df1680-6fc5-47e2-b61c-d86672b8b6be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:48:25.919194 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69df1680-6fc5-47e2-b61c-d86672b8b6be admin admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:48:25.919497 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69df1680-6fc5-47e2-b61c-d86672b8b6be admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:48:25.919775 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69df1680-6fc5-47e2-b61c-d86672b8b6be admin admin] PATH_INFO: `/v3/roles` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:48:25.935531 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69df1680-6fc5-47e2-b61c-d86672b8b6be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:48:25.948091 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69df1680-6fc5-47e2-b61c-d86672b8b6be admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:48:25.978987 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55506d11-d2de-4d96-9f6d-dabfa886baff None None] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:48:26.013621 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b108b25d-0de2-4da4-a768-4d22c1fe3ebd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:48:26.014355 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b108b25d-0de2-4da4-a768-4d22c1fe3ebd admin admin] REQUEST_METHOD: `DELETE` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:48:26.014587 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b108b25d-0de2-4da4-a768-4d22c1fe3ebd admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:48:26.014863 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b108b25d-0de2-4da4-a768-4d22c1fe3ebd admin admin] PATH_INFO: `/v3/projects/ef696f2d406849d887dc519e1e8ba581` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:48:26.026172 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b108b25d-0de2-4da4-a768-4d22c1fe3ebd admin admin] RBAC: Authorizing `identity:delete_project(project_id=ef696f2d406849d887dc519e1e8ba581)` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:48:26.027968 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 683/1364] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 30 00:48:25 2022] GET /identity/v3/roles => generated 1420 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 00:48:26.030142 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69df1680-6fc5-47e2-b61c-d86672b8b6be admin admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:48:26.039289 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b108b25d-0de2-4da4-a768-4d22c1fe3ebd admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:48:26.097922 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69df1680-6fc5-47e2-b61c-d86672b8b6be admin admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:48:26.121402 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b044ede-7c7d-4c52-99ed-719f8922ef5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:48:26.123243 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b044ede-7c7d-4c52-99ed-719f8922ef5d admin admin] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:48:26.123243 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b044ede-7c7d-4c52-99ed-719f8922ef5d admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:48:26.123243 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b044ede-7c7d-4c52-99ed-719f8922ef5d admin admin] PATH_INFO: `/v3/projects` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:48:26.123243 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b044ede-7c7d-4c52-99ed-719f8922ef5d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:48:26.138199 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b044ede-7c7d-4c52-99ed-719f8922ef5d admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:48:26.211782 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 684/1365] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 30 00:48:26 2022] POST /identity/v3/projects => generated 405 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 00:48:26.213554 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b044ede-7c7d-4c52-99ed-719f8922ef5d admin admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:48:26.226508 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-b108b25d-0de2-4da4-a768-4d22c1fe3ebd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ef696f2d406849d887dc519e1e8ba581', 'request_id': 'req-b108b25d-0de2-4da4-a768-4d22c1fe3ebd'} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:48:26.240023 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-b108b25d-0de2-4da4-a768-4d22c1fe3ebd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ef696f2d406849d887dc519e1e8ba581', 'request_id': 'req-b108b25d-0de2-4da4-a768-4d22c1fe3ebd'} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:48:26.265695 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-b108b25d-0de2-4da4-a768-4d22c1fe3ebd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ef696f2d406849d887dc519e1e8ba581', 'request_id': 'req-b108b25d-0de2-4da4-a768-4d22c1fe3ebd'} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:48:26.281010 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-b108b25d-0de2-4da4-a768-4d22c1fe3ebd admin admin] The token cache is being invalidate because project ef696f2d406849d887dc519e1e8ba581 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87955) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 00:48:26.281310 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-b108b25d-0de2-4da4-a768-4d22c1fe3ebd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:48:26.282008 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-b108b25d-0de2-4da4-a768-4d22c1fe3ebd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:48:26.289934 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 682/1366] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 30 00:48:25 2022] DELETE /identity/v3/projects/ef696f2d406849d887dc519e1e8ba581 => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 00:48:26.289934 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b108b25d-0de2-4da4-a768-4d22c1fe3ebd admin admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:48:26.291876 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-b108b25d-0de2-4da4-a768-4d22c1fe3ebd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:48:26.414722 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b044ede-7c7d-4c52-99ed-719f8922ef5d admin admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:48:26.420824 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7653c4a1-89cd-4cb6-a417-0667370638a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:48:26.421956 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7653c4a1-89cd-4cb6-a417-0667370638a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:48:26.422248 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7653c4a1-89cd-4cb6-a417-0667370638a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:48:26.422588 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7653c4a1-89cd-4cb6-a417-0667370638a5 admin admin] PATH_INFO: `/v3/projects/0669416c25ae470488961974eca56bd2/users/708cf6a192ea4ebfade38962661d79e2/roles/1c93019874174c4b91118d9ce2347e47` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:48:26.441260 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7653c4a1-89cd-4cb6-a417-0667370638a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0669416c25ae470488961974eca56bd2, user_id=708cf6a192ea4ebfade38962661d79e2, role_id=1c93019874174c4b91118d9ce2347e47)` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:48:26.445874 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7653c4a1-89cd-4cb6-a417-0667370638a5 admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:48:26.476823 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 685/1367] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 30 00:48:26 2022] PUT /identity/v3/projects/0669416c25ae470488961974eca56bd2/users/708cf6a192ea4ebfade38962661d79e2/roles/1c93019874174c4b91118d9ce2347e47 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 00:48:26.476823 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb9d862-2516-460e-a103-fe376f3b3880 None None] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:48:26.476823 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb9d862-2516-460e-a103-fe376f3b3880 None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:48:26.476823 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb9d862-2516-460e-a103-fe376f3b3880 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:48:26.500913 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b108b25d-0de2-4da4-a768-4d22c1fe3ebd admin admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:48:26.528771 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.auth.core [None req-adb9d862-2516-460e-a103-fe376f3b3880 None None] MFA Rules not processed for user `eb55b6cbca4945abb21b0e49eb745e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=87956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:48:26.529730 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-adb9d862-2516-460e-a103-fe376f3b3880 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:48:26.649264 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 686/1368] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 30 00:48:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:48:26.650180 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac08be0-f9d9-4d2a-8991-2543ec7962cb None None] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:48:26.650615 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac08be0-f9d9-4d2a-8991-2543ec7962cb None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:48:26.651194 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac08be0-f9d9-4d2a-8991-2543ec7962cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:48:26.685289 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb22600-0868-488a-a233-55634d7eea5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:48:26.686850 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb22600-0868-488a-a233-55634d7eea5a admin admin] REQUEST_METHOD: `POST` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:48:26.687612 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb22600-0868-488a-a233-55634d7eea5a admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:48:26.687906 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb22600-0868-488a-a233-55634d7eea5a admin admin] PATH_INFO: `/v3/users` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:48:26.689674 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb22600-0868-488a-a233-55634d7eea5a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:48:26.692187 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb22600-0868-488a-a233-55634d7eea5a admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:48:26.703075 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.auth.core [None req-4ac08be0-f9d9-4d2a-8991-2543ec7962cb None None] MFA Rules not processed for user `708cf6a192ea4ebfade38962661d79e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:48:26.705474 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-4ac08be0-f9d9-4d2a-8991-2543ec7962cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:48:26.731890 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:48:26.735095 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:48:26.769865 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 683/1369] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 30 00:48:26 2022] POST /identity/v3/users => generated 309 bytes in 482 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 00:48:26.773171 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e2dc64-1543-43ed-aa64-b0b004b662e5 None None] REQUEST_METHOD: `POST` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:48:26.773480 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e2dc64-1543-43ed-aa64-b0b004b662e5 None None] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:48:26.773864 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e2dc64-1543-43ed-aa64-b0b004b662e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:48:26.855044 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 687/1370] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 30 00:48:26 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:48:26.856445 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac08be0-f9d9-4d2a-8991-2543ec7962cb None None] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:48:26.861763 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.auth.core [None req-56e2dc64-1543-43ed-aa64-b0b004b662e5 None None] MFA Rules not processed for user `eb55b6cbca4945abb21b0e49eb745e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=87955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:48:26.863003 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-56e2dc64-1543-43ed-aa64-b0b004b662e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:48:26.881997 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac08be0-f9d9-4d2a-8991-2543ec7962cb None None] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:48:26.884079 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 684/1371] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 30 00:48:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:48:26.884989 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e2dc64-1543-43ed-aa64-b0b004b662e5 None None] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:48:26.888886 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-56e2dc64-1543-43ed-aa64-b0b004b662e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:48:26.896950 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d20e3db-9775-411e-8308-2200780495cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:48:26.897861 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d20e3db-9775-411e-8308-2200780495cd admin admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:48:26.898387 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d20e3db-9775-411e-8308-2200780495cd admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:48:26.898834 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d20e3db-9775-411e-8308-2200780495cd admin admin] PATH_INFO: `/v3/roles` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:48:26.900220 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d20e3db-9775-411e-8308-2200780495cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:48:26.902015 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d20e3db-9775-411e-8308-2200780495cd admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:48:26.903489 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e2dc64-1543-43ed-aa64-b0b004b662e5 None None] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:48:26.909369 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6e00c5-d5ba-4f20-8bc5-b2dc4df663ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:48:26.910063 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6e00c5-d5ba-4f20-8bc5-b2dc4df663ed admin admin] REQUEST_METHOD: `POST` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:48:26.910340 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6e00c5-d5ba-4f20-8bc5-b2dc4df663ed admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:48:26.910613 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6e00c5-d5ba-4f20-8bc5-b2dc4df663ed admin admin] PATH_INFO: `/v3/projects` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:48:26.915431 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6e00c5-d5ba-4f20-8bc5-b2dc4df663ed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:48:26.917437 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6e00c5-d5ba-4f20-8bc5-b2dc4df663ed admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:48:26.934340 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 688/1372] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 30 00:48:26 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 00:48:26.938246 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d20e3db-9775-411e-8308-2200780495cd admin admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:48:26.964254 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 685/1373] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 30 00:48:26 2022] POST /identity/v3/projects => generated 365 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 00:48:26.965036 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6e00c5-d5ba-4f20-8bc5-b2dc4df663ed admin admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:48:26.967128 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d20e3db-9775-411e-8308-2200780495cd admin admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:48:27.130162 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ee3196-015b-4124-b100-13ab9e3bba1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:48:27.130612 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ee3196-015b-4124-b100-13ab9e3bba1e admin admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:48:27.131054 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ee3196-015b-4124-b100-13ab9e3bba1e admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:48:27.132661 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ee3196-015b-4124-b100-13ab9e3bba1e admin admin] PATH_INFO: `/v3/domains` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:48:27.134240 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ee3196-015b-4124-b100-13ab9e3bba1e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87956) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:48:27.135193 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ee3196-015b-4124-b100-13ab9e3bba1e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:48:27.137852 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ee3196-015b-4124-b100-13ab9e3bba1e admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:48:27.139809 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6e00c5-d5ba-4f20-8bc5-b2dc4df663ed admin admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:48:27.156441 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969a186b-0832-4743-9f17-29ed2f023b71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:48:27.157232 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969a186b-0832-4743-9f17-29ed2f023b71 admin admin] REQUEST_METHOD: `PUT` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:48:27.157572 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969a186b-0832-4743-9f17-29ed2f023b71 admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:48:27.158009 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969a186b-0832-4743-9f17-29ed2f023b71 admin admin] PATH_INFO: `/v3/projects/0ee2fb35e7c8457fa6407cb647bee859/users/a97164084bd8476093aacf31d39b8879/roles/6ccaa8c11f29456fb4e4eeccb21616c7` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:48:27.170800 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 689/1374] 10.222.0.42 () {58 vars in 1153 bytes} [Sun Oct 30 00:48:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:48:27.175044 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ee3196-015b-4124-b100-13ab9e3bba1e admin admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:48:27.193537 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969a186b-0832-4743-9f17-29ed2f023b71 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0ee2fb35e7c8457fa6407cb647bee859, user_id=a97164084bd8476093aacf31d39b8879, role_id=6ccaa8c11f29456fb4e4eeccb21616c7)` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:48:27.198316 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ee3196-015b-4124-b100-13ab9e3bba1e admin admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:48:27.200455 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969a186b-0832-4743-9f17-29ed2f023b71 admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:48:27.210583 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb4c49a-15d4-4f15-a5f5-20a6b3028600 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:48:27.211415 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb4c49a-15d4-4f15-a5f5-20a6b3028600 admin admin] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:48:27.211815 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb4c49a-15d4-4f15-a5f5-20a6b3028600 admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:48:27.212299 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb4c49a-15d4-4f15-a5f5-20a6b3028600 admin admin] PATH_INFO: `/v3/users` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:48:27.213170 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb4c49a-15d4-4f15-a5f5-20a6b3028600 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:48:27.215863 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb4c49a-15d4-4f15-a5f5-20a6b3028600 admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:48:27.227779 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 686/1375] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 30 00:48:26 2022] PUT /identity/v3/projects/0ee2fb35e7c8457fa6407cb647bee859/users/a97164084bd8476093aacf31d39b8879/roles/6ccaa8c11f29456fb4e4eeccb21616c7 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 00:48:27.231113 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969a186b-0832-4743-9f17-29ed2f023b71 admin admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:48:27.267022 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 690/1376] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 30 00:48:27 2022] POST /identity/v3/users => generated 289 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 00:48:27.267803 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb4c49a-15d4-4f15-a5f5-20a6b3028600 admin admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:48:27.289219 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb4c49a-15d4-4f15-a5f5-20a6b3028600 admin admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:48:27.374553 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969a186b-0832-4743-9f17-29ed2f023b71 admin admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:48:27.385256 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ede5fb7-daea-4234-9919-28b2020e93b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:48:27.386896 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ede5fb7-daea-4234-9919-28b2020e93b0 admin admin] REQUEST_METHOD: `POST` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:48:27.388485 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ede5fb7-daea-4234-9919-28b2020e93b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:48:27.390004 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ede5fb7-daea-4234-9919-28b2020e93b0 admin admin] PATH_INFO: `/v3/projects` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:48:27.391096 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ede5fb7-daea-4234-9919-28b2020e93b0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:48:27.396711 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ede5fb7-daea-4234-9919-28b2020e93b0 admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:48:27.426081 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004f43ec-b8a1-447e-8679-c169ba6b3c35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:48:27.426818 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004f43ec-b8a1-447e-8679-c169ba6b3c35 admin admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:48:27.427190 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004f43ec-b8a1-447e-8679-c169ba6b3c35 admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:48:27.427637 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004f43ec-b8a1-447e-8679-c169ba6b3c35 admin admin] PATH_INFO: `/v3/roles` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:48:27.429067 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004f43ec-b8a1-447e-8679-c169ba6b3c35 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:48:27.433457 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004f43ec-b8a1-447e-8679-c169ba6b3c35 admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:48:27.463317 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 687/1377] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 30 00:48:27 2022] POST /identity/v3/projects => generated 365 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 00:48:27.464471 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 691/1378] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 30 00:48:27 2022] GET /identity/v3/roles => generated 1420 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 00:48:27.464752 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ede5fb7-daea-4234-9919-28b2020e93b0 admin admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:48:27.467691 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004f43ec-b8a1-447e-8679-c169ba6b3c35 admin admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:48:27.489009 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004f43ec-b8a1-447e-8679-c169ba6b3c35 admin admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:48:27.522133 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:48:27.543165 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:INSERT=6,keystone:SELECT=94 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:48:27.604525 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ede5fb7-daea-4234-9919-28b2020e93b0 admin admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:48:27.610380 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077d8bb5-34f0-4c6e-8df9-f60fa40998de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:48:27.611070 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077d8bb5-34f0-4c6e-8df9-f60fa40998de admin admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:48:27.612307 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077d8bb5-34f0-4c6e-8df9-f60fa40998de admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:48:27.612667 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077d8bb5-34f0-4c6e-8df9-f60fa40998de admin admin] PATH_INFO: `/v3/roles` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:48:27.613931 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077d8bb5-34f0-4c6e-8df9-f60fa40998de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:48:27.616347 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077d8bb5-34f0-4c6e-8df9-f60fa40998de admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:48:27.630001 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d826dc-b8a6-40ea-8b9c-9e001b7e7ce8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:48:27.630670 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d826dc-b8a6-40ea-8b9c-9e001b7e7ce8 admin admin] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:48:27.630950 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d826dc-b8a6-40ea-8b9c-9e001b7e7ce8 admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:48:27.631412 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d826dc-b8a6-40ea-8b9c-9e001b7e7ce8 admin admin] PATH_INFO: `/v3/users` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:48:27.632068 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d826dc-b8a6-40ea-8b9c-9e001b7e7ce8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:48:27.633903 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 688/1379] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 30 00:48:27 2022] GET /identity/v3/roles => generated 1420 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 00:48:27.634274 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d826dc-b8a6-40ea-8b9c-9e001b7e7ce8 admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:48:27.635632 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077d8bb5-34f0-4c6e-8df9-f60fa40998de admin admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:48:27.651265 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077d8bb5-34f0-4c6e-8df9-f60fa40998de admin admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:48:27.657911 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e1df01-042e-41e1-a52f-bb98c25a0809 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:48:27.659545 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e1df01-042e-41e1-a52f-bb98c25a0809 admin admin] REQUEST_METHOD: `PUT` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:48:27.660331 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e1df01-042e-41e1-a52f-bb98c25a0809 admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:48:27.661196 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e1df01-042e-41e1-a52f-bb98c25a0809 admin admin] PATH_INFO: `/v3/projects/0ee2fb35e7c8457fa6407cb647bee859/users/a97164084bd8476093aacf31d39b8879/roles/6ccaa8c11f29456fb4e4eeccb21616c7` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:48:27.664078 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e1df01-042e-41e1-a52f-bb98c25a0809 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0ee2fb35e7c8457fa6407cb647bee859, user_id=a97164084bd8476093aacf31d39b8879, role_id=6ccaa8c11f29456fb4e4eeccb21616c7)` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:48:27.668960 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e1df01-042e-41e1-a52f-bb98c25a0809 admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:48:27.676997 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 692/1380] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 30 00:48:27 2022] POST /identity/v3/users => generated 283 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 00:48:27.678187 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d826dc-b8a6-40ea-8b9c-9e001b7e7ce8 admin admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:48:27.702705 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 689/1381] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 30 00:48:27 2022] PUT /identity/v3/projects/0ee2fb35e7c8457fa6407cb647bee859/users/a97164084bd8476093aacf31d39b8879/roles/6ccaa8c11f29456fb4e4eeccb21616c7 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 00:48:27.703815 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e1df01-042e-41e1-a52f-bb98c25a0809 admin admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:48:27.708599 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d826dc-b8a6-40ea-8b9c-9e001b7e7ce8 admin admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:48:27.834547 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e1df01-042e-41e1-a52f-bb98c25a0809 admin admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:48:27.839454 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d577ed-5157-4f2b-9a3c-2223fffa09da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:48:27.840146 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d577ed-5157-4f2b-9a3c-2223fffa09da admin admin] REQUEST_METHOD: `PUT` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:48:27.840422 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d577ed-5157-4f2b-9a3c-2223fffa09da admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:48:27.840693 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d577ed-5157-4f2b-9a3c-2223fffa09da admin admin] PATH_INFO: `/v3/projects/201d91d9661447ae8137c2772a7b3783/users/45e61a07c4fa4d73a471dce5657d9607/roles/6ccaa8c11f29456fb4e4eeccb21616c7` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:48:27.843472 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ca5531-8dcd-4767-baef-60f8d2394e9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:48:27.844192 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ca5531-8dcd-4767-baef-60f8d2394e9c admin admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:48:27.844700 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ca5531-8dcd-4767-baef-60f8d2394e9c admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:48:27.845127 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ca5531-8dcd-4767-baef-60f8d2394e9c admin admin] PATH_INFO: `/v3/roles` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:48:27.845884 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ca5531-8dcd-4767-baef-60f8d2394e9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:48:27.858210 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ca5531-8dcd-4767-baef-60f8d2394e9c admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:48:27.877920 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 690/1382] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 30 00:48:27 2022] GET /identity/v3/roles => generated 1420 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 00:48:27.878386 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6f471c-93ac-41ad-b2d2-1e63ebf68b5a None None] REQUEST_METHOD: `POST` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:48:27.878885 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6f471c-93ac-41ad-b2d2-1e63ebf68b5a None None] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:48:27.879164 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6f471c-93ac-41ad-b2d2-1e63ebf68b5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:48:27.879736 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d577ed-5157-4f2b-9a3c-2223fffa09da admin admin] RBAC: Authorizing `identity:create_grant(project_id=201d91d9661447ae8137c2772a7b3783, user_id=45e61a07c4fa4d73a471dce5657d9607, role_id=6ccaa8c11f29456fb4e4eeccb21616c7)` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:48:27.882601 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d577ed-5157-4f2b-9a3c-2223fffa09da admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:48:27.908378 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 693/1383] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 30 00:48:27 2022] PUT /identity/v3/projects/201d91d9661447ae8137c2772a7b3783/users/45e61a07c4fa4d73a471dce5657d9607/roles/6ccaa8c11f29456fb4e4eeccb21616c7 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 00:48:27.912778 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d577ed-5157-4f2b-9a3c-2223fffa09da admin admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:48:27.929296 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.auth.core [None req-bf6f471c-93ac-41ad-b2d2-1e63ebf68b5a None None] MFA Rules not processed for user `a97164084bd8476093aacf31d39b8879`. Rule list: `[]` (Enabled: `True`). {{(pid=87955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:48:27.931375 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-bf6f471c-93ac-41ad-b2d2-1e63ebf68b5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:48:28.056297 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d577ed-5157-4f2b-9a3c-2223fffa09da admin admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:48:28.073343 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c123b8-534b-4c04-8c23-c03421b6ce23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:48:28.073736 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c123b8-534b-4c04-8c23-c03421b6ce23 admin admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:48:28.074014 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c123b8-534b-4c04-8c23-c03421b6ce23 admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:48:28.074323 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c123b8-534b-4c04-8c23-c03421b6ce23 admin admin] PATH_INFO: `/v3/roles` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:48:28.074998 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c123b8-534b-4c04-8c23-c03421b6ce23 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:48:28.076809 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c123b8-534b-4c04-8c23-c03421b6ce23 admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:48:28.100862 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 694/1384] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 30 00:48:27 2022] GET /identity/v3/roles => generated 1420 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 00:48:28.102351 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c123b8-534b-4c04-8c23-c03421b6ce23 admin admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:48:28.131335 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 691/1385] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 30 00:48:27 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:48:28.132194 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6f471c-93ac-41ad-b2d2-1e63ebf68b5a None None] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:48:28.135182 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c123b8-534b-4c04-8c23-c03421b6ce23 admin admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:48:28.153345 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc6e8cc-e5fc-42bc-8593-0c5da01d9746 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:48:28.153977 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc6e8cc-e5fc-42bc-8593-0c5da01d9746 admin admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:48:28.154251 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc6e8cc-e5fc-42bc-8593-0c5da01d9746 admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:48:28.154561 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc6e8cc-e5fc-42bc-8593-0c5da01d9746 admin admin] PATH_INFO: `/v3/roles` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:48:28.155171 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc6e8cc-e5fc-42bc-8593-0c5da01d9746 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:48:28.161449 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc6e8cc-e5fc-42bc-8593-0c5da01d9746 admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:48:28.164097 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6f471c-93ac-41ad-b2d2-1e63ebf68b5a None None] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:48:28.192253 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858ec52d-f19a-41be-9222-4b868d832fc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:48:28.196362 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858ec52d-f19a-41be-9222-4b868d832fc5 admin admin] REQUEST_METHOD: `PUT` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:48:28.196362 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858ec52d-f19a-41be-9222-4b868d832fc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:48:28.196617 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858ec52d-f19a-41be-9222-4b868d832fc5 admin admin] PATH_INFO: `/v3/projects/671aa3b2a72249cb8a2a840d522f96cc/users/30c8610724d5465a85441c2d8193080b/roles/1c93019874174c4b91118d9ce2347e47` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:48:28.221549 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 695/1386] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 30 00:48:28 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 00:48:28.222554 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc6e8cc-e5fc-42bc-8593-0c5da01d9746 admin admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:48:28.232436 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-dcc6e8cc-e5fc-42bc-8593-0c5da01d9746 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:48:28.258504 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858ec52d-f19a-41be-9222-4b868d832fc5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=671aa3b2a72249cb8a2a840d522f96cc, user_id=30c8610724d5465a85441c2d8193080b, role_id=1c93019874174c4b91118d9ce2347e47)` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:48:28.261272 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858ec52d-f19a-41be-9222-4b868d832fc5 admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:48:28.289480 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:48:28.316013 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 692/1387] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 30 00:48:28 2022] PUT /identity/v3/projects/671aa3b2a72249cb8a2a840d522f96cc/users/30c8610724d5465a85441c2d8193080b/roles/1c93019874174c4b91118d9ce2347e47 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 00:48:28.316986 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858ec52d-f19a-41be-9222-4b868d832fc5 admin admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:48:28.343506 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:48:28.402957 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc6e8cc-e5fc-42bc-8593-0c5da01d9746 admin admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:48:28.429875 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858ec52d-f19a-41be-9222-4b868d832fc5 admin admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:48:28.444935 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39498ff-76fa-4ad9-b8e4-1caa9f045c8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:48:28.445714 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39498ff-76fa-4ad9-b8e4-1caa9f045c8a admin admin] REQUEST_METHOD: `PUT` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:48:28.445998 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39498ff-76fa-4ad9-b8e4-1caa9f045c8a admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:48:28.446277 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39498ff-76fa-4ad9-b8e4-1caa9f045c8a admin admin] PATH_INFO: `/v3/projects/201d91d9661447ae8137c2772a7b3783/users/45e61a07c4fa4d73a471dce5657d9607/roles/6ccaa8c11f29456fb4e4eeccb21616c7` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:48:28.449996 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39498ff-76fa-4ad9-b8e4-1caa9f045c8a admin admin] RBAC: Authorizing `identity:create_grant(project_id=201d91d9661447ae8137c2772a7b3783, user_id=45e61a07c4fa4d73a471dce5657d9607, role_id=6ccaa8c11f29456fb4e4eeccb21616c7)` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:48:28.452778 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39498ff-76fa-4ad9-b8e4-1caa9f045c8a admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:48:28.488104 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 693/1388] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 30 00:48:28 2022] PUT /identity/v3/projects/201d91d9661447ae8137c2772a7b3783/users/45e61a07c4fa4d73a471dce5657d9607/roles/6ccaa8c11f29456fb4e4eeccb21616c7 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 00:48:28.490082 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7628ff7-0c6f-4318-b4c2-ef104b8ef159 None None] REQUEST_METHOD: `POST` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:48:28.490373 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7628ff7-0c6f-4318-b4c2-ef104b8ef159 None None] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:48:28.490650 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7628ff7-0c6f-4318-b4c2-ef104b8ef159 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:48:28.535632 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d967b3ef-672e-4c53-a28b-c58025540c53 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48d928ff7fe24348ac900f09c56acc20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d2387fdf794d4eaef07bbcd7b39f2a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:48:28.536929 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d967b3ef-672e-4c53-a28b-c58025540c53 service cinder] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:48:28.538168 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d967b3ef-672e-4c53-a28b-c58025540c53 service cinder] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:48:28.538507 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d967b3ef-672e-4c53-a28b-c58025540c53 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:48:28.559959 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.auth.core [None req-e7628ff7-0c6f-4318-b4c2-ef104b8ef159 None None] MFA Rules not processed for user `30c8610724d5465a85441c2d8193080b`. Rule list: `[]` (Enabled: `True`). {{(pid=87955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:48:28.561510 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-e7628ff7-0c6f-4318-b4c2-ef104b8ef159 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:48:28.661755 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d967b3ef-672e-4c53-a28b-c58025540c53 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:48:28.664334 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d967b3ef-672e-4c53-a28b-c58025540c53 service cinder] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:48:28.687046 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 696/1389] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 30 00:48:28 2022] GET /identity/v3/auth/tokens => generated 3349 bytes in 465 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 00:48:28.701565 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2446412b-e64d-4741-bc94-fab3277a1b0c None None] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:48:28.703222 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2446412b-e64d-4741-bc94-fab3277a1b0c None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:48:28.703708 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2446412b-e64d-4741-bc94-fab3277a1b0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:48:28.746329 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 694/1390] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 30 00:48:28 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:48:28.757856 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7628ff7-0c6f-4318-b4c2-ef104b8ef159 None None] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:48:28.759327 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-e7628ff7-0c6f-4318-b4c2-ef104b8ef159 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:48:28.782871 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.auth.core [None req-2446412b-e64d-4741-bc94-fab3277a1b0c None None] MFA Rules not processed for user `45e61a07c4fa4d73a471dce5657d9607`. Rule list: `[]` (Enabled: `True`). {{(pid=87956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:48:28.785129 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-2446412b-e64d-4741-bc94-fab3277a1b0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:48:28.884370 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7628ff7-0c6f-4318-b4c2-ef104b8ef159 None None] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:48:28.892527 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e817c7-eecb-4f57-b196-e2580e4c3f25 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48d928ff7fe24348ac900f09c56acc20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d2387fdf794d4eaef07bbcd7b39f2a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:48:28.894045 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e817c7-eecb-4f57-b196-e2580e4c3f25 service cinder] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:48:28.894334 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e817c7-eecb-4f57-b196-e2580e4c3f25 service cinder] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:48:28.896540 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e817c7-eecb-4f57-b196-e2580e4c3f25 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:48:28.915030 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e817c7-eecb-4f57-b196-e2580e4c3f25 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:48:28.916524 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e817c7-eecb-4f57-b196-e2580e4c3f25 service cinder] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:48:28.939623 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 695/1391] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 30 00:48:28 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 30 00:48:28.986351 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 697/1392] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 30 00:48:28 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:48:29.095498 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e817c7-eecb-4f57-b196-e2580e4c3f25 service cinder] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:48:29.106668 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e817c7-eecb-4f57-b196-e2580e4c3f25 service cinder] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:48:29.112905 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea9eb87-927a-47cb-bc02-9f38a6bdf8b5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48d928ff7fe24348ac900f09c56acc20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d2387fdf794d4eaef07bbcd7b39f2a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:48:29.114532 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea9eb87-927a-47cb-bc02-9f38a6bdf8b5 service cinder] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:48:29.115004 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea9eb87-927a-47cb-bc02-9f38a6bdf8b5 service cinder] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:48:29.115186 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea9eb87-927a-47cb-bc02-9f38a6bdf8b5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:48:29.141067 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea9eb87-927a-47cb-bc02-9f38a6bdf8b5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:48:29.142772 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea9eb87-927a-47cb-bc02-9f38a6bdf8b5 service cinder] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:48:29.167796 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 696/1393] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 30 00:48:29 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 00:48:29.243843 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2446412b-e64d-4741-bc94-fab3277a1b0c None None] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:48:29.258869 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2446412b-e64d-4741-bc94-fab3277a1b0c None None] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:48:29.284351 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbeb6ac2-066e-4bfc-8832-d9f81b114ffe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48d928ff7fe24348ac900f09c56acc20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d2387fdf794d4eaef07bbcd7b39f2a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:48:29.286466 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbeb6ac2-066e-4bfc-8832-d9f81b114ffe service cinder] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:48:29.289150 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbeb6ac2-066e-4bfc-8832-d9f81b114ffe service cinder] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:48:29.289532 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbeb6ac2-066e-4bfc-8832-d9f81b114ffe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:48:29.295183 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-fbeb6ac2-066e-4bfc-8832-d9f81b114ffe service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:48:29.309517 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=100 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:48:29.429932 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbeb6ac2-066e-4bfc-8832-d9f81b114ffe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:48:29.433456 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbeb6ac2-066e-4bfc-8832-d9f81b114ffe service cinder] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:48:29.462422 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 698/1394] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 30 00:48:29 2022] GET /identity/v3/auth/tokens => generated 3284 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 00:48:29.522102 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf071dd2-cd3a-4679-ac01-2db51709aa85 None None] REQUEST_METHOD: `POST` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:48:29.526807 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf071dd2-cd3a-4679-ac01-2db51709aa85 None None] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:48:29.527328 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf071dd2-cd3a-4679-ac01-2db51709aa85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:48:29.617337 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.auth.core [None req-cf071dd2-cd3a-4679-ac01-2db51709aa85 None None] MFA Rules not processed for user `6215c75145174a63b88110843e7c29c7`. Rule list: `[]` (Enabled: `True`). {{(pid=87955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:48:29.623413 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-cf071dd2-cd3a-4679-ac01-2db51709aa85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:48:29.640184 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:48:29.802700 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 697/1395] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 30 00:48:29 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:48:29.804110 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bc492c-e4f1-4d2f-81aa-fa5cade817eb None None] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:48:29.804396 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bc492c-e4f1-4d2f-81aa-fa5cade817eb None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:48:29.804668 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bc492c-e4f1-4d2f-81aa-fa5cade817eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:48:29.860376 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.auth.core [None req-11bc492c-e4f1-4d2f-81aa-fa5cade817eb None None] MFA Rules not processed for user `6215c75145174a63b88110843e7c29c7`. Rule list: `[]` (Enabled: `True`). {{(pid=87956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:48:29.861628 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-11bc492c-e4f1-4d2f-81aa-fa5cade817eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:48:29.897367 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 699/1396] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 30 00:48:29 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:48:29.914781 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf071dd2-cd3a-4679-ac01-2db51709aa85 None None] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:48:29.918247 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-cf071dd2-cd3a-4679-ac01-2db51709aa85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:48:29.939554 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bc492c-e4f1-4d2f-81aa-fa5cade817eb None None] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:48:29.952479 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bc492c-e4f1-4d2f-81aa-fa5cade817eb None None] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:48:29.977241 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fa10cb-c6a9-46c0-ab8e-218417183c76 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48d928ff7fe24348ac900f09c56acc20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d2387fdf794d4eaef07bbcd7b39f2a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:48:29.978196 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fa10cb-c6a9-46c0-ab8e-218417183c76 service cinder] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:48:29.978478 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fa10cb-c6a9-46c0-ab8e-218417183c76 service cinder] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:48:29.978754 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fa10cb-c6a9-46c0-ab8e-218417183c76 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:48:30.189777 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fa10cb-c6a9-46c0-ab8e-218417183c76 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:48:30.194420 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf071dd2-cd3a-4679-ac01-2db51709aa85 None None] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:48:30.194592 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fa10cb-c6a9-46c0-ab8e-218417183c76 service cinder] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:48:30.207573 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8fc376-3eac-48ac-a99e-b793ab1ecddf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fde877b6ddc74f4a87baf21471eb31d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d2387fdf794d4eaef07bbcd7b39f2a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:48:30.209489 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8fc376-3eac-48ac-a99e-b793ab1ecddf service nova] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:48:30.210339 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8fc376-3eac-48ac-a99e-b793ab1ecddf service nova] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:48:30.211549 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8fc376-3eac-48ac-a99e-b793ab1ecddf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:48:30.219593 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 700/1397] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 30 00:48:29 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 281 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 00:48:30.226298 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8fc376-3eac-48ac-a99e-b793ab1ecddf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:48:30.227995 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8fc376-3eac-48ac-a99e-b793ab1ecddf service nova] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:48:30.256671 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 698/1398] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 30 00:48:29 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 00:48:32.033345 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca2ff8e-ed3b-4bc9-8a3e-445fb6da9982 None None] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:48:32.034362 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca2ff8e-ed3b-4bc9-8a3e-445fb6da9982 None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:48:32.034899 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca2ff8e-ed3b-4bc9-8a3e-445fb6da9982 None None] PATH_INFO: `/` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:48:32.038105 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 701/1399] 10.222.0.42 () {54 vars in 912 bytes} [Sun Oct 30 00:48:32 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:48:32.050055 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6024d5-53d9-447c-a0bc-1863c6dcdbfc None None] REQUEST_METHOD: `POST` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:48:32.050530 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6024d5-53d9-447c-a0bc-1863c6dcdbfc None None] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:48:32.050902 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6024d5-53d9-447c-a0bc-1863c6dcdbfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:48:32.190524 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.auth.core [None req-ea6024d5-53d9-447c-a0bc-1863c6dcdbfc None None] MFA Rules not processed for user `5693f186c6ad4d9394f02ee3477cdcd3`. Rule list: `[]` (Enabled: `True`). {{(pid=87955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:48:32.192839 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-ea6024d5-53d9-447c-a0bc-1863c6dcdbfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:48:32.321638 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 699/1400] 10.222.0.42 () {58 vars in 1009 bytes} [Sun Oct 30 00:48:32 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:48:32.352183 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca2ff8e-ed3b-4bc9-8a3e-445fb6da9982 None None] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:48:32.355030 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-bca2ff8e-ed3b-4bc9-8a3e-445fb6da9982 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:48:32.393652 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0c43da-ee24-44b6-aa9f-14ce7fe05d88 None None] REQUEST_METHOD: `POST` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:48:32.405617 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0c43da-ee24-44b6-aa9f-14ce7fe05d88 None None] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:48:32.406144 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0c43da-ee24-44b6-aa9f-14ce7fe05d88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:48:32.436042 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca2ff8e-ed3b-4bc9-8a3e-445fb6da9982 None None] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:48:32.450375 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5500cb2-ac7c-4e30-b26f-7374eb43fefc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5693f186c6ad4d9394f02ee3477cdcd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d2387fdf794d4eaef07bbcd7b39f2a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:48:32.451264 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5500cb2-ac7c-4e30-b26f-7374eb43fefc service neutron] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:48:32.451861 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5500cb2-ac7c-4e30-b26f-7374eb43fefc service neutron] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:48:32.452282 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5500cb2-ac7c-4e30-b26f-7374eb43fefc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:48:32.474154 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5500cb2-ac7c-4e30-b26f-7374eb43fefc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:48:32.476825 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5500cb2-ac7c-4e30-b26f-7374eb43fefc service neutron] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:48:32.487753 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.auth.core [None req-fb0c43da-ee24-44b6-aa9f-14ce7fe05d88 None None] MFA Rules not processed for user `2ff437c6b6af4ac1b343280c5c191cd0`. Rule list: `[]` (Enabled: `True`). {{(pid=87955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:48:32.494677 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-fb0c43da-ee24-44b6-aa9f-14ce7fe05d88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:48:32.524998 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 702/1401] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 30 00:48:32 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 00:48:32.532682 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27963b2-1c35-4fb0-bfcd-15c681c6251d None None] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:48:32.532949 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27963b2-1c35-4fb0-bfcd-15c681c6251d None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:48:32.541554 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27963b2-1c35-4fb0-bfcd-15c681c6251d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:48:32.610538 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=100 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:48:32.679799 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.auth.core [None req-d27963b2-1c35-4fb0-bfcd-15c681c6251d None None] MFA Rules not processed for user `861d1145dd48414c9388bed57e993493`. Rule list: `[]` (Enabled: `True`). {{(pid=87956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:48:32.681524 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-d27963b2-1c35-4fb0-bfcd-15c681c6251d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:48:32.801728 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 700/1402] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 30 00:48:32 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 414 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:48:32.816158 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58106858-9796-4964-aecb-b20129c5850f None None] REQUEST_METHOD: `POST` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:48:32.816501 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58106858-9796-4964-aecb-b20129c5850f None None] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:48:32.816793 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58106858-9796-4964-aecb-b20129c5850f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:48:32.862546 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.auth.core [None req-58106858-9796-4964-aecb-b20129c5850f None None] MFA Rules not processed for user `2ff437c6b6af4ac1b343280c5c191cd0`. Rule list: `[]` (Enabled: `True`). {{(pid=87955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:48:32.864105 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-58106858-9796-4964-aecb-b20129c5850f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:48:32.913428 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 701/1403] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 30 00:48:32 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:48:32.920854 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58106858-9796-4964-aecb-b20129c5850f None None] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:48:32.924070 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-58106858-9796-4964-aecb-b20129c5850f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:48:32.943439 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 703/1404] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 30 00:48:32 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 418 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:48:32.967758 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58106858-9796-4964-aecb-b20129c5850f None None] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:48:32.986047 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76f9a13-6d65-4fa0-b45f-7eb7a58d1108 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fde877b6ddc74f4a87baf21471eb31d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d2387fdf794d4eaef07bbcd7b39f2a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:48:32.989884 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76f9a13-6d65-4fa0-b45f-7eb7a58d1108 service nova] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:48:32.990151 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76f9a13-6d65-4fa0-b45f-7eb7a58d1108 service nova] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:48:32.990492 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76f9a13-6d65-4fa0-b45f-7eb7a58d1108 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:48:33.023056 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76f9a13-6d65-4fa0-b45f-7eb7a58d1108 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:48:33.031038 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76f9a13-6d65-4fa0-b45f-7eb7a58d1108 service nova] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:48:33.069036 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 702/1405] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 30 00:48:32 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 00:48:33.225755 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f1a175-6e6c-4d82-aba0-c2ee7b32a450 None None] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:48:33.226596 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f1a175-6e6c-4d82-aba0-c2ee7b32a450 None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:48:33.226998 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f1a175-6e6c-4d82-aba0-c2ee7b32a450 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:48:33.305167 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=100 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:48:33.311504 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.auth.core [None req-31f1a175-6e6c-4d82-aba0-c2ee7b32a450 None None] MFA Rules not processed for user `431eca0bd74247b8bcb832ed1c9ae3ac`. Rule list: `[]` (Enabled: `True`). {{(pid=87956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:48:33.314737 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-31f1a175-6e6c-4d82-aba0-c2ee7b32a450 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:48:33.521561 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 704/1406] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 30 00:48:33 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 297 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:48:33.591027 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76f9a13-6d65-4fa0-b45f-7eb7a58d1108 service nova] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:48:33.611667 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76f9a13-6d65-4fa0-b45f-7eb7a58d1108 service nova] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:48:33.642709 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d0a2d8-5986-407c-9820-98e7859c03d6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fde877b6ddc74f4a87baf21471eb31d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d2387fdf794d4eaef07bbcd7b39f2a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:48:33.643361 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d0a2d8-5986-407c-9820-98e7859c03d6 service nova] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:48:33.643641 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d0a2d8-5986-407c-9820-98e7859c03d6 service nova] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:48:33.643911 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d0a2d8-5986-407c-9820-98e7859c03d6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:48:33.675699 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d0a2d8-5986-407c-9820-98e7859c03d6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:48:33.677403 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d0a2d8-5986-407c-9820-98e7859c03d6 service nova] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:48:33.727862 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f1a175-6e6c-4d82-aba0-c2ee7b32a450 None None] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:48:33.730198 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-31f1a175-6e6c-4d82-aba0-c2ee7b32a450 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:48:33.741076 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 703/1407] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 30 00:48:33 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 00:48:33.881562 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f1a175-6e6c-4d82-aba0-c2ee7b32a450 None None] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:48:33.894557 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f669fc1-8a9f-41cb-a62a-787622eea6f3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '202b8b2c0f454297bfb97c1ac4033625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d2387fdf794d4eaef07bbcd7b39f2a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:48:33.895324 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f669fc1-8a9f-41cb-a62a-787622eea6f3 service placement] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:48:33.895602 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f669fc1-8a9f-41cb-a62a-787622eea6f3 service placement] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:48:33.896423 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f669fc1-8a9f-41cb-a62a-787622eea6f3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:48:33.902519 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-7f669fc1-8a9f-41cb-a62a-787622eea6f3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:48:33.926954 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f669fc1-8a9f-41cb-a62a-787622eea6f3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:48:33.932401 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f669fc1-8a9f-41cb-a62a-787622eea6f3 service placement] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:48:33.960038 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 705/1408] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 30 00:48:33 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 30 00:48:34.057723 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d0a2d8-5986-407c-9820-98e7859c03d6 service nova] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:48:34.078778 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d0a2d8-5986-407c-9820-98e7859c03d6 service nova] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:48:34.104504 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee23c05c-132a-402c-8952-e0f60c6bd81e None None] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:48:34.105043 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee23c05c-132a-402c-8952-e0f60c6bd81e None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:48:34.105388 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee23c05c-132a-402c-8952-e0f60c6bd81e None None] PATH_INFO: `/` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:48:34.107274 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 706/1409] 10.222.0.42 () {54 vars in 912 bytes} [Sun Oct 30 00:48:34 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:48:34.113211 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77ab533-2dd4-4d8f-997c-13a703b3f524 None None] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:48:34.113370 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84d1f86-3f28-4e2b-961d-ac3e75a67ebd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fde877b6ddc74f4a87baf21471eb31d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d2387fdf794d4eaef07bbcd7b39f2a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:48:34.113632 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77ab533-2dd4-4d8f-997c-13a703b3f524 None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:48:34.114174 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77ab533-2dd4-4d8f-997c-13a703b3f524 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:48:34.114895 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84d1f86-3f28-4e2b-961d-ac3e75a67ebd service nova] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:48:34.118244 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84d1f86-3f28-4e2b-961d-ac3e75a67ebd service nova] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:48:34.118777 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84d1f86-3f28-4e2b-961d-ac3e75a67ebd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:48:34.136292 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84d1f86-3f28-4e2b-961d-ac3e75a67ebd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:48:34.141142 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84d1f86-3f28-4e2b-961d-ac3e75a67ebd service nova] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:48:34.158252 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 704/1410] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 30 00:48:34 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 00:48:34.195748 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.auth.core [None req-c77ab533-2dd4-4d8f-997c-13a703b3f524 None None] MFA Rules not processed for user `5693f186c6ad4d9394f02ee3477cdcd3`. Rule list: `[]` (Enabled: `True`). {{(pid=87956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:48:34.206344 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-c77ab533-2dd4-4d8f-997c-13a703b3f524 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:48:34.234296 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 707/1411] 10.222.0.42 () {58 vars in 1009 bytes} [Sun Oct 30 00:48:34 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 30 00:48:34.250678 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84d1f86-3f28-4e2b-961d-ac3e75a67ebd service nova] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:48:34.252542 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-d84d1f86-3f28-4e2b-961d-ac3e75a67ebd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:48:34.270805 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84d1f86-3f28-4e2b-961d-ac3e75a67ebd service nova] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:48:34.281364 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f4fedd-2dad-4fa8-9ae2-6d1ec488cd5d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5693f186c6ad4d9394f02ee3477cdcd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d2387fdf794d4eaef07bbcd7b39f2a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:48:34.282003 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f4fedd-2dad-4fa8-9ae2-6d1ec488cd5d service neutron] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:48:34.282282 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f4fedd-2dad-4fa8-9ae2-6d1ec488cd5d service neutron] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:48:34.282626 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f4fedd-2dad-4fa8-9ae2-6d1ec488cd5d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:48:34.303834 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f4fedd-2dad-4fa8-9ae2-6d1ec488cd5d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:48:34.305484 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f4fedd-2dad-4fa8-9ae2-6d1ec488cd5d service neutron] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:48:34.340778 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 705/1412] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 30 00:48:34 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 00:48:34.627620 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04948d1-a19e-4a8b-8abd-03ab2079b20e None None] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:48:34.627926 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04948d1-a19e-4a8b-8abd-03ab2079b20e None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:48:34.628230 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04948d1-a19e-4a8b-8abd-03ab2079b20e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:48:34.732175 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.auth.core [None req-f04948d1-a19e-4a8b-8abd-03ab2079b20e None None] MFA Rules not processed for user `6215c75145174a63b88110843e7c29c7`. Rule list: `[]` (Enabled: `True`). {{(pid=87956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:48:34.740405 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-f04948d1-a19e-4a8b-8abd-03ab2079b20e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:48:34.751355 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 708/1413] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 30 00:48:34 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:48:34.929794 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f4fedd-2dad-4fa8-9ae2-6d1ec488cd5d service neutron] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:48:35.121410 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f4fedd-2dad-4fa8-9ae2-6d1ec488cd5d service neutron] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:48:35.129699 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f4e7b1-9248-4a5d-a3b0-7281d5be7501 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:48:35.131660 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f4e7b1-9248-4a5d-a3b0-7281d5be7501 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:48:35.132150 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f4e7b1-9248-4a5d-a3b0-7281d5be7501 admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:48:35.132645 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f4e7b1-9248-4a5d-a3b0-7281d5be7501 admin admin] PATH_INFO: `/v3/users/708cf6a192ea4ebfade38962661d79e2` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:48:35.134282 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f4e7b1-9248-4a5d-a3b0-7281d5be7501 admin admin] RBAC: Authorizing `identity:delete_user(user_id=708cf6a192ea4ebfade38962661d79e2)` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:48:35.137116 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f4e7b1-9248-4a5d-a3b0-7281d5be7501 admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:48:35.261536 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-a0f4e7b1-9248-4a5d-a3b0-7281d5be7501 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '708cf6a192ea4ebfade38962661d79e2'} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:48:35.262798 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-a0f4e7b1-9248-4a5d-a3b0-7281d5be7501 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '708cf6a192ea4ebfade38962661d79e2'} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:48:35.288180 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-a0f4e7b1-9248-4a5d-a3b0-7281d5be7501 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '708cf6a192ea4ebfade38962661d79e2'} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:48:35.290558 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-a0f4e7b1-9248-4a5d-a3b0-7281d5be7501 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '708cf6a192ea4ebfade38962661d79e2'} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:48:35.316387 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:48:35.324915 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-a0f4e7b1-9248-4a5d-a3b0-7281d5be7501 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '708cf6a192ea4ebfade38962661d79e2'} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:48:35.359172 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 706/1414] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 30 00:48:34 2022] DELETE /identity/v3/users/708cf6a192ea4ebfade38962661d79e2 => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 00:48:35.361572 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e2caf5-56ec-4a87-81c6-0bcabef91b8a None None] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:48:35.362428 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e2caf5-56ec-4a87-81c6-0bcabef91b8a None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:48:35.362916 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e2caf5-56ec-4a87-81c6-0bcabef91b8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:48:35.415425 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.auth.core [None req-b8e2caf5-56ec-4a87-81c6-0bcabef91b8a None None] MFA Rules not processed for user `eb55b6cbca4945abb21b0e49eb745e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=87956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:48:35.417692 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-b8e2caf5-56ec-4a87-81c6-0bcabef91b8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:48:35.609963 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 709/1415] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 30 00:48:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:48:35.639023 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f4e7b1-9248-4a5d-a3b0-7281d5be7501 admin admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:48:35.641283 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-a0f4e7b1-9248-4a5d-a3b0-7281d5be7501 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:48:35.807341 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f4e7b1-9248-4a5d-a3b0-7281d5be7501 admin admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:48:35.816183 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febf4601-b595-43b1-a726-e008c22dbb5e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5693f186c6ad4d9394f02ee3477cdcd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d2387fdf794d4eaef07bbcd7b39f2a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:48:35.816929 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febf4601-b595-43b1-a726-e008c22dbb5e service neutron] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:48:35.818005 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febf4601-b595-43b1-a726-e008c22dbb5e service neutron] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:48:35.818436 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febf4601-b595-43b1-a726-e008c22dbb5e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:48:35.844933 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febf4601-b595-43b1-a726-e008c22dbb5e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:48:35.848882 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febf4601-b595-43b1-a726-e008c22dbb5e service neutron] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:48:35.876917 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 707/1416] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 30 00:48:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 00:48:37.882279 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e2caf5-56ec-4a87-81c6-0bcabef91b8a None None] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:48:37.885562 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-b8e2caf5-56ec-4a87-81c6-0bcabef91b8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:48:37.916937 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e2caf5-56ec-4a87-81c6-0bcabef91b8a None None] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:48:37.929837 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d01481-f0fd-40fe-be3d-8d1e6613b90a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:48:37.930688 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d01481-f0fd-40fe-be3d-8d1e6613b90a admin admin] REQUEST_METHOD: `DELETE` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:48:37.931105 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d01481-f0fd-40fe-be3d-8d1e6613b90a admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:48:37.931561 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d01481-f0fd-40fe-be3d-8d1e6613b90a admin admin] PATH_INFO: `/v3/users/1ba83867601d44679ad87d9b6ded24df` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:48:37.932858 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d01481-f0fd-40fe-be3d-8d1e6613b90a admin admin] RBAC: Authorizing `identity:delete_user(user_id=1ba83867601d44679ad87d9b6ded24df)` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:48:37.936952 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d01481-f0fd-40fe-be3d-8d1e6613b90a admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:48:38.004975 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f0a185-3676-4b47-bc8a-ce1fe4d539fb None None] REQUEST_METHOD: `POST` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:48:38.005487 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f0a185-3676-4b47-bc8a-ce1fe4d539fb None None] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:48:38.005733 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f0a185-3676-4b47-bc8a-ce1fe4d539fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:48:38.037818 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:48:38.152531 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-35d01481-f0fd-40fe-be3d-8d1e6613b90a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1ba83867601d44679ad87d9b6ded24df'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:48:38.162731 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-35d01481-f0fd-40fe-be3d-8d1e6613b90a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1ba83867601d44679ad87d9b6ded24df'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:48:38.192966 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.auth.core [None req-c5f0a185-3676-4b47-bc8a-ce1fe4d539fb None None] MFA Rules not processed for user `3e7b21b55fb84a6cad507a8954492d48`. Rule list: `[]` (Enabled: `True`). {{(pid=87955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:48:38.201634 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-35d01481-f0fd-40fe-be3d-8d1e6613b90a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1ba83867601d44679ad87d9b6ded24df'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:48:38.201930 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-c5f0a185-3676-4b47-bc8a-ce1fe4d539fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:48:38.224518 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-35d01481-f0fd-40fe-be3d-8d1e6613b90a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1ba83867601d44679ad87d9b6ded24df'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:48:38.252349 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-35d01481-f0fd-40fe-be3d-8d1e6613b90a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1ba83867601d44679ad87d9b6ded24df'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:48:38.272961 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 710/1417] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 30 00:48:37 2022] DELETE /identity/v3/users/1ba83867601d44679ad87d9b6ded24df => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 00:48:38.278102 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc37c3c-61ba-4bc3-b087-7c79b6a8e100 None None] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:48:38.278739 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc37c3c-61ba-4bc3-b087-7c79b6a8e100 None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:48:38.279177 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc37c3c-61ba-4bc3-b087-7c79b6a8e100 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:48:38.321740 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.auth.core [None req-fcc37c3c-61ba-4bc3-b087-7c79b6a8e100 None None] MFA Rules not processed for user `eb55b6cbca4945abb21b0e49eb745e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=87956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:48:38.329729 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-fcc37c3c-61ba-4bc3-b087-7c79b6a8e100 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:48:38.406267 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 708/1418] 10.222.0.42 () {58 vars in 1009 bytes} [Sun Oct 30 00:48:38 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 402 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 30 00:48:38.517675 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 711/1419] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 30 00:48:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 30 00:48:38.554405 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f0a185-3676-4b47-bc8a-ce1fe4d539fb None None] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:48:38.556420 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-c5f0a185-3676-4b47-bc8a-ce1fe4d539fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:48:38.588756 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f0a185-3676-4b47-bc8a-ce1fe4d539fb None None] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:48:38.647258 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc37c3c-61ba-4bc3-b087-7c79b6a8e100 None None] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:48:38.649139 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-fcc37c3c-61ba-4bc3-b087-7c79b6a8e100 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:48:38.676534 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc37c3c-61ba-4bc3-b087-7c79b6a8e100 None None] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:48:38.709824 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a212736f-9e85-4265-934d-6d2724bd2786 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:48:38.712062 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a212736f-9e85-4265-934d-6d2724bd2786 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:48:38.712556 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a212736f-9e85-4265-934d-6d2724bd2786 admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:48:38.713298 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a212736f-9e85-4265-934d-6d2724bd2786 admin admin] PATH_INFO: `/v3/projects/0669416c25ae470488961974eca56bd2` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:48:38.714960 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a212736f-9e85-4265-934d-6d2724bd2786 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0669416c25ae470488961974eca56bd2)` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:48:38.720541 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a212736f-9e85-4265-934d-6d2724bd2786 admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:48:38.774035 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88faf10d-6220-439f-ac35-d2716ae98863 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5693f186c6ad4d9394f02ee3477cdcd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d2387fdf794d4eaef07bbcd7b39f2a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:48:38.774757 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88faf10d-6220-439f-ac35-d2716ae98863 service neutron] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:48:38.775102 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88faf10d-6220-439f-ac35-d2716ae98863 service neutron] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:48:38.775477 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88faf10d-6220-439f-ac35-d2716ae98863 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:48:38.791109 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88faf10d-6220-439f-ac35-d2716ae98863 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:48:38.795816 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88faf10d-6220-439f-ac35-d2716ae98863 service neutron] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:48:38.818270 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:48:38.831678 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 709/1420] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 30 00:48:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 278 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 00:48:38.832585 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88faf10d-6220-439f-ac35-d2716ae98863 service neutron] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:48:38.843159 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-88faf10d-6220-439f-ac35-d2716ae98863 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:48:38.902029 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-a212736f-9e85-4265-934d-6d2724bd2786 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0669416c25ae470488961974eca56bd2', 'request_id': 'req-a212736f-9e85-4265-934d-6d2724bd2786'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:48:38.917294 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-a212736f-9e85-4265-934d-6d2724bd2786 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0669416c25ae470488961974eca56bd2', 'request_id': 'req-a212736f-9e85-4265-934d-6d2724bd2786'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:48:38.947977 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-a212736f-9e85-4265-934d-6d2724bd2786 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0669416c25ae470488961974eca56bd2', 'request_id': 'req-a212736f-9e85-4265-934d-6d2724bd2786'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:48:38.984621 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-a212736f-9e85-4265-934d-6d2724bd2786 admin admin] The token cache is being invalidate because project 0669416c25ae470488961974eca56bd2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87956) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 00:48:38.985765 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-a212736f-9e85-4265-934d-6d2724bd2786 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:48:38.987071 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-a212736f-9e85-4265-934d-6d2724bd2786 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:48:38.993058 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 712/1421] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 30 00:48:38 2022] DELETE /identity/v3/projects/0669416c25ae470488961974eca56bd2 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 00:48:38.997829 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a212736f-9e85-4265-934d-6d2724bd2786 admin admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:48:39.006062 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-a212736f-9e85-4265-934d-6d2724bd2786 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:48:39.053363 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:48:39.179024 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a212736f-9e85-4265-934d-6d2724bd2786 admin admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:48:39.201272 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77aa290-ad38-44c1-8ff5-147bcebb3d31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:48:39.201939 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77aa290-ad38-44c1-8ff5-147bcebb3d31 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:48:39.202208 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77aa290-ad38-44c1-8ff5-147bcebb3d31 admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:48:39.202633 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77aa290-ad38-44c1-8ff5-147bcebb3d31 admin admin] PATH_INFO: `/v3/users/45e61a07c4fa4d73a471dce5657d9607` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:48:39.206663 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77aa290-ad38-44c1-8ff5-147bcebb3d31 admin admin] RBAC: Authorizing `identity:delete_user(user_id=45e61a07c4fa4d73a471dce5657d9607)` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:48:39.209124 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77aa290-ad38-44c1-8ff5-147bcebb3d31 admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:48:39.229866 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88faf10d-6220-439f-ac35-d2716ae98863 service neutron] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:48:39.385626 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-d77aa290-ad38-44c1-8ff5-147bcebb3d31 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '45e61a07c4fa4d73a471dce5657d9607'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:48:39.387413 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-d77aa290-ad38-44c1-8ff5-147bcebb3d31 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '45e61a07c4fa4d73a471dce5657d9607'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:48:39.425771 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-d77aa290-ad38-44c1-8ff5-147bcebb3d31 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '45e61a07c4fa4d73a471dce5657d9607'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:48:39.447638 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-d77aa290-ad38-44c1-8ff5-147bcebb3d31 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '45e61a07c4fa4d73a471dce5657d9607'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:48:39.475636 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-d77aa290-ad38-44c1-8ff5-147bcebb3d31 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '45e61a07c4fa4d73a471dce5657d9607'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:48:39.507495 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 713/1422] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 30 00:48:38 2022] DELETE /identity/v3/users/45e61a07c4fa4d73a471dce5657d9607 => generated 0 bytes in 507 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 00:48:39.523042 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428cce83-95fe-4ef6-809a-8a286da0a67e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6d6e884a8104a428e4de6be1cfa467c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d2387fdf794d4eaef07bbcd7b39f2a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:48:39.523596 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428cce83-95fe-4ef6-809a-8a286da0a67e service swift] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:48:39.523870 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428cce83-95fe-4ef6-809a-8a286da0a67e service swift] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:48:39.524135 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428cce83-95fe-4ef6-809a-8a286da0a67e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:48:39.536070 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-428cce83-95fe-4ef6-809a-8a286da0a67e service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:48:39.741883 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428cce83-95fe-4ef6-809a-8a286da0a67e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:48:39.753662 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428cce83-95fe-4ef6-809a-8a286da0a67e service swift] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:48:39.798227 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 710/1423] 10.222.0.42 () {60 vars in 1384 bytes} [Sun Oct 30 00:48:38 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 965 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 30 00:48:40.473455 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8477a096-0418-4ace-a755-4fb656119404 None None] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:48:40.477817 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8477a096-0418-4ace-a755-4fb656119404 None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:48:40.478393 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8477a096-0418-4ace-a755-4fb656119404 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:48:40.543128 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.auth.core [None req-8477a096-0418-4ace-a755-4fb656119404 None None] MFA Rules not processed for user `431eca0bd74247b8bcb832ed1c9ae3ac`. Rule list: `[]` (Enabled: `True`). {{(pid=87956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:48:40.550857 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-8477a096-0418-4ace-a755-4fb656119404 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:48:40.799606 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 714/1424] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 30 00:48:40 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 327 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:48:41.288155 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428cce83-95fe-4ef6-809a-8a286da0a67e service swift] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:48:41.290777 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-428cce83-95fe-4ef6-809a-8a286da0a67e service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:48:41.316488 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428cce83-95fe-4ef6-809a-8a286da0a67e service swift] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:48:41.365745 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=100 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:48:41.500697 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8272e8-76ad-461d-bd2f-962c5538e8d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:48:41.501835 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8272e8-76ad-461d-bd2f-962c5538e8d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:48:41.502314 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8272e8-76ad-461d-bd2f-962c5538e8d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:48:41.502775 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8272e8-76ad-461d-bd2f-962c5538e8d3 admin admin] PATH_INFO: `/v3/projects/c92b36400cb44e229934a54fdff13ec6` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:48:41.508368 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8272e8-76ad-461d-bd2f-962c5538e8d3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c92b36400cb44e229934a54fdff13ec6)` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:48:41.510662 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8272e8-76ad-461d-bd2f-962c5538e8d3 admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:48:41.626994 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-3d8272e8-76ad-461d-bd2f-962c5538e8d3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c92b36400cb44e229934a54fdff13ec6', 'request_id': 'req-3d8272e8-76ad-461d-bd2f-962c5538e8d3'} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:48:41.644637 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-3d8272e8-76ad-461d-bd2f-962c5538e8d3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c92b36400cb44e229934a54fdff13ec6', 'request_id': 'req-3d8272e8-76ad-461d-bd2f-962c5538e8d3'} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:48:41.675756 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-3d8272e8-76ad-461d-bd2f-962c5538e8d3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c92b36400cb44e229934a54fdff13ec6', 'request_id': 'req-3d8272e8-76ad-461d-bd2f-962c5538e8d3'} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:48:41.723687 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-3d8272e8-76ad-461d-bd2f-962c5538e8d3 admin admin] The token cache is being invalidate because project c92b36400cb44e229934a54fdff13ec6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87955) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 00:48:41.724033 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-3d8272e8-76ad-461d-bd2f-962c5538e8d3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:48:41.731114 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-3d8272e8-76ad-461d-bd2f-962c5538e8d3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:48:41.741524 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8477a096-0418-4ace-a755-4fb656119404 None None] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:48:41.755370 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 711/1425] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 30 00:48:41 2022] DELETE /identity/v3/projects/c92b36400cb44e229934a54fdff13ec6 => generated 0 bytes in 450 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 00:48:41.761240 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8477a096-0418-4ace-a755-4fb656119404 None None] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:48:41.926055 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:48:41.984784 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606b3459-5a42-47ec-907a-e2a2df090aa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:48:41.985399 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606b3459-5a42-47ec-907a-e2a2df090aa1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:48:41.985672 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606b3459-5a42-47ec-907a-e2a2df090aa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:48:41.985941 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606b3459-5a42-47ec-907a-e2a2df090aa1 admin admin] PATH_INFO: `/v3/users/a97164084bd8476093aacf31d39b8879` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:48:41.987318 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606b3459-5a42-47ec-907a-e2a2df090aa1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a97164084bd8476093aacf31d39b8879)` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:48:41.989315 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606b3459-5a42-47ec-907a-e2a2df090aa1 admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:48:42.149008 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-606b3459-5a42-47ec-907a-e2a2df090aa1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a97164084bd8476093aacf31d39b8879'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:48:42.151702 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-606b3459-5a42-47ec-907a-e2a2df090aa1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a97164084bd8476093aacf31d39b8879'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:48:42.211821 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-606b3459-5a42-47ec-907a-e2a2df090aa1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a97164084bd8476093aacf31d39b8879'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:48:42.227714 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-606b3459-5a42-47ec-907a-e2a2df090aa1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a97164084bd8476093aacf31d39b8879'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:48:42.268171 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-606b3459-5a42-47ec-907a-e2a2df090aa1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a97164084bd8476093aacf31d39b8879'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:48:42.278820 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 715/1426] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 30 00:48:41 2022] DELETE /identity/v3/users/a97164084bd8476093aacf31d39b8879 => generated 0 bytes in 538 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 00:48:42.389766 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91ecf2a-8ed4-4498-92fc-a6b0827aec8b None None] REQUEST_METHOD: `POST` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:48:42.390411 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91ecf2a-8ed4-4498-92fc-a6b0827aec8b None None] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:48:42.390411 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91ecf2a-8ed4-4498-92fc-a6b0827aec8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:48:42.458257 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.auth.core [None req-d91ecf2a-8ed4-4498-92fc-a6b0827aec8b None None] MFA Rules not processed for user `861d1145dd48414c9388bed57e993493`. Rule list: `[]` (Enabled: `True`). {{(pid=87955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:48:42.459530 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-d91ecf2a-8ed4-4498-92fc-a6b0827aec8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:48:42.738583 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 712/1427] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 30 00:48:42 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 350 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:48:42.952702 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606b3459-5a42-47ec-907a-e2a2df090aa1 admin admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:48:42.954634 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-606b3459-5a42-47ec-907a-e2a2df090aa1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:48:43.223709 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606b3459-5a42-47ec-907a-e2a2df090aa1 admin admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:48:43.243138 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4589aab-0bc5-44b9-8268-69a9d358cf5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:48:43.244097 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4589aab-0bc5-44b9-8268-69a9d358cf5a admin admin] REQUEST_METHOD: `DELETE` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:48:43.244572 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4589aab-0bc5-44b9-8268-69a9d358cf5a admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:48:43.245022 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4589aab-0bc5-44b9-8268-69a9d358cf5a admin admin] PATH_INFO: `/v3/projects/201d91d9661447ae8137c2772a7b3783` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:48:43.252169 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4589aab-0bc5-44b9-8268-69a9d358cf5a admin admin] RBAC: Authorizing `identity:delete_project(project_id=201d91d9661447ae8137c2772a7b3783)` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:48:43.254450 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4589aab-0bc5-44b9-8268-69a9d358cf5a admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:48:43.407603 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-e4589aab-0bc5-44b9-8268-69a9d358cf5a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '201d91d9661447ae8137c2772a7b3783', 'request_id': 'req-e4589aab-0bc5-44b9-8268-69a9d358cf5a'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:48:43.442998 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee81fd07-c255-42ef-bf38-e884956b7c84 None None] REQUEST_METHOD: `POST` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:48:43.444276 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee81fd07-c255-42ef-bf38-e884956b7c84 None None] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:48:43.444754 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee81fd07-c255-42ef-bf38-e884956b7c84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:48:43.446365 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-e4589aab-0bc5-44b9-8268-69a9d358cf5a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '201d91d9661447ae8137c2772a7b3783', 'request_id': 'req-e4589aab-0bc5-44b9-8268-69a9d358cf5a'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:48:43.494026 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-e4589aab-0bc5-44b9-8268-69a9d358cf5a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '201d91d9661447ae8137c2772a7b3783', 'request_id': 'req-e4589aab-0bc5-44b9-8268-69a9d358cf5a'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:48:43.497655 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:48:43.537881 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.auth.core [None req-ee81fd07-c255-42ef-bf38-e884956b7c84 None None] MFA Rules not processed for user `5693f186c6ad4d9394f02ee3477cdcd3`. Rule list: `[]` (Enabled: `True`). {{(pid=87955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:48:43.539472 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-e4589aab-0bc5-44b9-8268-69a9d358cf5a admin admin] The token cache is being invalidate because project 201d91d9661447ae8137c2772a7b3783 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87956) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 00:48:43.540839 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-e4589aab-0bc5-44b9-8268-69a9d358cf5a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:48:43.542377 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-ee81fd07-c255-42ef-bf38-e884956b7c84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:48:43.545056 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-e4589aab-0bc5-44b9-8268-69a9d358cf5a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:48:43.553071 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 716/1428] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 30 00:48:42 2022] DELETE /identity/v3/projects/201d91d9661447ae8137c2772a7b3783 => generated 0 bytes in 598 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 00:48:43.554883 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1949e0df-1747-4ad4-8cc3-802223565efe None None] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:48:43.555576 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1949e0df-1747-4ad4-8cc3-802223565efe None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:48:43.558023 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1949e0df-1747-4ad4-8cc3-802223565efe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:48:43.624942 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.auth.core [None req-1949e0df-1747-4ad4-8cc3-802223565efe None None] MFA Rules not processed for user `eb55b6cbca4945abb21b0e49eb745e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=87956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:48:43.626626 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-1949e0df-1747-4ad4-8cc3-802223565efe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:48:43.771330 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 713/1429] 10.222.0.45 () {58 vars in 1015 bytes} [Sun Oct 30 00:48:43 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 329 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:48:43.773023 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee81fd07-c255-42ef-bf38-e884956b7c84 None None] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:48:43.778766 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-ee81fd07-c255-42ef-bf38-e884956b7c84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:48:43.823908 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 717/1430] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 30 00:48:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:48:43.823908 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1949e0df-1747-4ad4-8cc3-802223565efe None None] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:48:43.824950 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-1949e0df-1747-4ad4-8cc3-802223565efe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:48:43.825468 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:48:43.867067 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1949e0df-1747-4ad4-8cc3-802223565efe None None] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:48:43.876634 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50830026-4798-4271-adf7-6e3ba1979c1c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5693f186c6ad4d9394f02ee3477cdcd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d2387fdf794d4eaef07bbcd7b39f2a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:48:43.878006 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50830026-4798-4271-adf7-6e3ba1979c1c service neutron] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:48:43.880129 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50830026-4798-4271-adf7-6e3ba1979c1c service neutron] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:48:43.880502 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50830026-4798-4271-adf7-6e3ba1979c1c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:48:43.902515 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50830026-4798-4271-adf7-6e3ba1979c1c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:48:43.908601 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50830026-4798-4271-adf7-6e3ba1979c1c service neutron] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:48:43.931944 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 718/1431] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 30 00:48:43 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 00:48:43.937822 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeeeccb0-b79b-44c9-a207-b446122631bf None None] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:48:43.939309 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeeeccb0-b79b-44c9-a207-b446122631bf None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:48:43.940473 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeeeccb0-b79b-44c9-a207-b446122631bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:48:43.992933 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.auth.core [None req-eeeeccb0-b79b-44c9-a207-b446122631bf None None] MFA Rules not processed for user `eb55b6cbca4945abb21b0e49eb745e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=87956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:48:43.998160 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee81fd07-c255-42ef-bf38-e884956b7c84 None None] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:48:44.000338 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-eeeeccb0-b79b-44c9-a207-b446122631bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:48:44.011607 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5df868-ac09-4059-bb82-cee1ccd3f1c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:48:44.013020 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5df868-ac09-4059-bb82-cee1ccd3f1c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:48:44.014086 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5df868-ac09-4059-bb82-cee1ccd3f1c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:48:44.014905 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5df868-ac09-4059-bb82-cee1ccd3f1c0 admin admin] PATH_INFO: `/v3/users/30c8610724d5465a85441c2d8193080b` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:48:44.017669 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5df868-ac09-4059-bb82-cee1ccd3f1c0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=30c8610724d5465a85441c2d8193080b)` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:48:44.022250 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5df868-ac09-4059-bb82-cee1ccd3f1c0 admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:48:44.025601 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 719/1432] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 30 00:48:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:48:44.028714 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeeeccb0-b79b-44c9-a207-b446122631bf None None] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:48:44.060274 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeeeccb0-b79b-44c9-a207-b446122631bf None None] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:48:44.085706 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cf6146-65c9-43ec-b486-f8553b16503a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:48:44.088333 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cf6146-65c9-43ec-b486-f8553b16503a admin admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:48:44.088678 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cf6146-65c9-43ec-b486-f8553b16503a admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:48:44.088956 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cf6146-65c9-43ec-b486-f8553b16503a admin admin] PATH_INFO: `/v3/domains` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:48:44.093037 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69cf6146-65c9-43ec-b486-f8553b16503a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87956) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:48:44.093636 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69cf6146-65c9-43ec-b486-f8553b16503a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:48:44.099812 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69cf6146-65c9-43ec-b486-f8553b16503a admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:48:44.144330 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 720/1433] 10.222.0.42 () {58 vars in 1153 bytes} [Sun Oct 30 00:48:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:48:44.149849 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cf6146-65c9-43ec-b486-f8553b16503a admin admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:48:44.182920 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-cb5df868-ac09-4059-bb82-cee1ccd3f1c0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '30c8610724d5465a85441c2d8193080b'} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:48:44.183905 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-cb5df868-ac09-4059-bb82-cee1ccd3f1c0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '30c8610724d5465a85441c2d8193080b'} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:48:44.185043 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cf6146-65c9-43ec-b486-f8553b16503a admin admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:48:44.197650 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddb1826-bd74-4d58-af7e-98a823ece088 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:48:44.198287 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddb1826-bd74-4d58-af7e-98a823ece088 admin admin] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:48:44.200472 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddb1826-bd74-4d58-af7e-98a823ece088 admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:48:44.202456 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddb1826-bd74-4d58-af7e-98a823ece088 admin admin] PATH_INFO: `/v3/projects` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:48:44.205354 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dddb1826-bd74-4d58-af7e-98a823ece088 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:48:44.206405 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-cb5df868-ac09-4059-bb82-cee1ccd3f1c0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '30c8610724d5465a85441c2d8193080b'} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:48:44.207814 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-cb5df868-ac09-4059-bb82-cee1ccd3f1c0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '30c8610724d5465a85441c2d8193080b'} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:48:44.210038 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dddb1826-bd74-4d58-af7e-98a823ece088 admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:48:44.270987 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-cb5df868-ac09-4059-bb82-cee1ccd3f1c0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '30c8610724d5465a85441c2d8193080b'} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:48:44.313238 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 714/1434] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 30 00:48:43 2022] DELETE /identity/v3/users/30c8610724d5465a85441c2d8193080b => generated 0 bytes in 538 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 00:48:44.318411 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ed6135-9d64-42f0-b7f7-eec0aebf57d5 None None] REQUEST_METHOD: `POST` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:48:44.318699 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ed6135-9d64-42f0-b7f7-eec0aebf57d5 None None] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:48:44.320728 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ed6135-9d64-42f0-b7f7-eec0aebf57d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:48:44.329694 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 721/1435] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 30 00:48:44 2022] POST /identity/v3/projects => generated 367 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 00:48:44.333090 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddb1826-bd74-4d58-af7e-98a823ece088 admin admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:48:44.338830 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-dddb1826-bd74-4d58-af7e-98a823ece088 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:48:44.382693 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.auth.core [None req-39ed6135-9d64-42f0-b7f7-eec0aebf57d5 None None] MFA Rules not processed for user `eb55b6cbca4945abb21b0e49eb745e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=87955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:48:44.385153 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-39ed6135-9d64-42f0-b7f7-eec0aebf57d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:48:44.556667 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddb1826-bd74-4d58-af7e-98a823ece088 admin admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:48:44.560462 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 715/1436] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 30 00:48:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:48:44.579635 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af5a5f8-db4b-42aa-afd9-8fc61c077613 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:48:44.580278 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af5a5f8-db4b-42aa-afd9-8fc61c077613 admin admin] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:48:44.580626 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af5a5f8-db4b-42aa-afd9-8fc61c077613 admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:48:44.581018 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af5a5f8-db4b-42aa-afd9-8fc61c077613 admin admin] PATH_INFO: `/v3/users` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:48:44.581676 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af5a5f8-db4b-42aa-afd9-8fc61c077613 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:48:44.590350 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af5a5f8-db4b-42aa-afd9-8fc61c077613 admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:48:44.659980 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ed6135-9d64-42f0-b7f7-eec0aebf57d5 None None] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:48:44.661776 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-39ed6135-9d64-42f0-b7f7-eec0aebf57d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:48:44.666331 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 722/1437] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 30 00:48:44 2022] POST /identity/v3/users => generated 284 bytes in 332 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 00:48:44.668159 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af5a5f8-db4b-42aa-afd9-8fc61c077613 admin admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:48:44.707396 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af5a5f8-db4b-42aa-afd9-8fc61c077613 admin admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:48:44.721861 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3fb9bc-7469-49a2-ab84-5be93a305952 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:48:44.722607 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3fb9bc-7469-49a2-ab84-5be93a305952 admin admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:48:44.722607 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3fb9bc-7469-49a2-ab84-5be93a305952 admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:48:44.722779 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3fb9bc-7469-49a2-ab84-5be93a305952 admin admin] PATH_INFO: `/v3/roles` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:48:44.723422 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3fb9bc-7469-49a2-ab84-5be93a305952 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:48:44.732770 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3fb9bc-7469-49a2-ab84-5be93a305952 admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:48:44.758162 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:48:44.791038 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 723/1438] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 30 00:48:44 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 00:48:44.792297 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3fb9bc-7469-49a2-ab84-5be93a305952 admin admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:48:44.835264 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3fb9bc-7469-49a2-ab84-5be93a305952 admin admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:48:44.868504 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caed7c69-53c0-4442-b3fb-da77c37a3688 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:48:44.869153 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caed7c69-53c0-4442-b3fb-da77c37a3688 admin admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:48:44.869463 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caed7c69-53c0-4442-b3fb-da77c37a3688 admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:48:44.869738 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caed7c69-53c0-4442-b3fb-da77c37a3688 admin admin] PATH_INFO: `/v3/roles` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:48:44.875430 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caed7c69-53c0-4442-b3fb-da77c37a3688 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:48:44.880587 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caed7c69-53c0-4442-b3fb-da77c37a3688 admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:48:44.881409 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ed6135-9d64-42f0-b7f7-eec0aebf57d5 None None] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:48:44.892286 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c989cd28-02a6-42c5-b91f-34ac9aa12052 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5693f186c6ad4d9394f02ee3477cdcd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d2387fdf794d4eaef07bbcd7b39f2a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:48:44.893390 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c989cd28-02a6-42c5-b91f-34ac9aa12052 service neutron] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:48:44.894491 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c989cd28-02a6-42c5-b91f-34ac9aa12052 service neutron] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:48:44.907623 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c989cd28-02a6-42c5-b91f-34ac9aa12052 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:48:44.936391 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 724/1439] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 30 00:48:44 2022] GET /identity/v3/roles => generated 1420 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 00:48:44.939738 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caed7c69-53c0-4442-b3fb-da77c37a3688 admin admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:48:44.954271 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c989cd28-02a6-42c5-b91f-34ac9aa12052 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:48:44.958383 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c989cd28-02a6-42c5-b91f-34ac9aa12052 service neutron] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:48:44.966880 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:DELETE=2,keystone:SELECT=94,keystone:INSERT=4 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:48:44.978648 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caed7c69-53c0-4442-b3fb-da77c37a3688 admin admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:48:44.988982 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecaa6b5-79c5-411a-91ae-23a849a589ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:48:44.989990 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecaa6b5-79c5-411a-91ae-23a849a589ea admin admin] REQUEST_METHOD: `PUT` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:48:44.990423 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecaa6b5-79c5-411a-91ae-23a849a589ea admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:48:44.990855 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecaa6b5-79c5-411a-91ae-23a849a589ea admin admin] PATH_INFO: `/v3/projects/85abc34ba1f14642bb6efe872c1e5631/users/8e1ccadf3c694a39ade0055179904158/roles/1c93019874174c4b91118d9ce2347e47` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:48:45.012359 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 716/1440] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 30 00:48:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 30 00:48:45.059833 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ecaa6b5-79c5-411a-91ae-23a849a589ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=85abc34ba1f14642bb6efe872c1e5631, user_id=8e1ccadf3c694a39ade0055179904158, role_id=1c93019874174c4b91118d9ce2347e47)` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:48:45.092467 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ecaa6b5-79c5-411a-91ae-23a849a589ea admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:48:45.150692 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 725/1441] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 30 00:48:44 2022] PUT /identity/v3/projects/85abc34ba1f14642bb6efe872c1e5631/users/8e1ccadf3c694a39ade0055179904158/roles/1c93019874174c4b91118d9ce2347e47 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 00:48:45.162315 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde2d43a-07e9-45a9-b62c-bc61ccce5384 None None] REQUEST_METHOD: `POST` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:48:45.162721 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde2d43a-07e9-45a9-b62c-bc61ccce5384 None None] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:48:45.163100 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde2d43a-07e9-45a9-b62c-bc61ccce5384 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:48:45.249742 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.auth.core [None req-bde2d43a-07e9-45a9-b62c-bc61ccce5384 None None] MFA Rules not processed for user `8e1ccadf3c694a39ade0055179904158`. Rule list: `[]` (Enabled: `True`). {{(pid=87955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:48:45.265093 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-bde2d43a-07e9-45a9-b62c-bc61ccce5384 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:48:45.396097 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecaa6b5-79c5-411a-91ae-23a849a589ea admin admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:48:45.398260 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-4ecaa6b5-79c5-411a-91ae-23a849a589ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:48:45.545535 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 717/1442] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 30 00:48:45 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 384 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:48:45.551485 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde2d43a-07e9-45a9-b62c-bc61ccce5384 None None] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:48:45.726517 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde2d43a-07e9-45a9-b62c-bc61ccce5384 None None] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:48:45.764055 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535fb23a-1cb4-4071-bead-41947e9c6474 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:48:45.765948 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecaa6b5-79c5-411a-91ae-23a849a589ea admin admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:48:45.767981 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535fb23a-1cb4-4071-bead-41947e9c6474 admin admin] REQUEST_METHOD: `POST` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:48:45.773225 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535fb23a-1cb4-4071-bead-41947e9c6474 admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:48:45.773519 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535fb23a-1cb4-4071-bead-41947e9c6474 admin admin] PATH_INFO: `/v3/projects` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:48:45.777788 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535fb23a-1cb4-4071-bead-41947e9c6474 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:48:45.790003 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a58e0a-6a19-4cdd-a2b2-ad8995544ca0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:48:45.792681 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a58e0a-6a19-4cdd-a2b2-ad8995544ca0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:48:45.794265 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535fb23a-1cb4-4071-bead-41947e9c6474 admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:48:45.794856 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a58e0a-6a19-4cdd-a2b2-ad8995544ca0 admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:48:45.797325 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a58e0a-6a19-4cdd-a2b2-ad8995544ca0 admin admin] PATH_INFO: `/v3/projects/0ee2fb35e7c8457fa6407cb647bee859` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:48:45.803513 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a58e0a-6a19-4cdd-a2b2-ad8995544ca0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0ee2fb35e7c8457fa6407cb647bee859)` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:48:45.814222 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a58e0a-6a19-4cdd-a2b2-ad8995544ca0 admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:48:45.886417 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 718/1443] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 30 00:48:45 2022] POST /identity/v3/projects => generated 367 bytes in 336 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 00:48:45.887830 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535fb23a-1cb4-4071-bead-41947e9c6474 admin admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:48:46.025231 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-e4a58e0a-6a19-4cdd-a2b2-ad8995544ca0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0ee2fb35e7c8457fa6407cb647bee859', 'request_id': 'req-e4a58e0a-6a19-4cdd-a2b2-ad8995544ca0'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:48:46.046357 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-e4a58e0a-6a19-4cdd-a2b2-ad8995544ca0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0ee2fb35e7c8457fa6407cb647bee859', 'request_id': 'req-e4a58e0a-6a19-4cdd-a2b2-ad8995544ca0'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:48:46.066355 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-e4a58e0a-6a19-4cdd-a2b2-ad8995544ca0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0ee2fb35e7c8457fa6407cb647bee859', 'request_id': 'req-e4a58e0a-6a19-4cdd-a2b2-ad8995544ca0'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:48:46.109877 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:48:46.115688 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-e4a58e0a-6a19-4cdd-a2b2-ad8995544ca0 admin admin] The token cache is being invalidate because project 0ee2fb35e7c8457fa6407cb647bee859 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87956) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 00:48:46.116121 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-e4a58e0a-6a19-4cdd-a2b2-ad8995544ca0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:48:46.116917 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-e4a58e0a-6a19-4cdd-a2b2-ad8995544ca0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:48:46.122296 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 726/1444] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 30 00:48:45 2022] DELETE /identity/v3/projects/0ee2fb35e7c8457fa6407cb647bee859 => generated 0 bytes in 724 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 00:48:46.124123 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292f4a53-257a-4371-9cd6-6f6dc22227b1 None None] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:48:46.124506 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292f4a53-257a-4371-9cd6-6f6dc22227b1 None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:48:46.125042 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292f4a53-257a-4371-9cd6-6f6dc22227b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:48:46.154021 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535fb23a-1cb4-4071-bead-41947e9c6474 admin admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:48:46.214644 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.auth.core [None req-292f4a53-257a-4371-9cd6-6f6dc22227b1 None None] MFA Rules not processed for user `eb55b6cbca4945abb21b0e49eb745e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=87956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:48:46.222229 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-292f4a53-257a-4371-9cd6-6f6dc22227b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:48:46.379149 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30702364-b59f-4387-9ca6-8ce8e2363ece admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:48:46.380149 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30702364-b59f-4387-9ca6-8ce8e2363ece admin admin] REQUEST_METHOD: `POST` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:48:46.380464 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30702364-b59f-4387-9ca6-8ce8e2363ece admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:48:46.380768 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30702364-b59f-4387-9ca6-8ce8e2363ece admin admin] PATH_INFO: `/v3/users` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:48:46.381711 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30702364-b59f-4387-9ca6-8ce8e2363ece admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:48:46.398044 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30702364-b59f-4387-9ca6-8ce8e2363ece admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:48:46.410828 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 727/1445] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 30 00:48:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 288 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:48:46.418687 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4986606-b196-47c6-9ed9-52564b4a20aa None None] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:48:46.419297 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4986606-b196-47c6-9ed9-52564b4a20aa None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:48:46.424043 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4986606-b196-47c6-9ed9-52564b4a20aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:48:46.451599 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 719/1446] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 30 00:48:45 2022] POST /identity/v3/users => generated 290 bytes in 564 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 00:48:46.455013 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30702364-b59f-4387-9ca6-8ce8e2363ece admin admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:48:46.457034 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-30702364-b59f-4387-9ca6-8ce8e2363ece admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:48:46.498004 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30702364-b59f-4387-9ca6-8ce8e2363ece admin admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:48:46.508226 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f1b5da-deaa-4294-ba75-de4744281589 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:48:46.510973 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f1b5da-deaa-4294-ba75-de4744281589 admin admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:48:46.510973 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f1b5da-deaa-4294-ba75-de4744281589 admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:48:46.512767 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f1b5da-deaa-4294-ba75-de4744281589 admin admin] PATH_INFO: `/v3/roles` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:48:46.514049 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f1b5da-deaa-4294-ba75-de4744281589 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:48:46.516141 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.auth.core [None req-e4986606-b196-47c6-9ed9-52564b4a20aa None None] MFA Rules not processed for user `eb55b6cbca4945abb21b0e49eb745e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=87956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:48:46.522298 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-e4986606-b196-47c6-9ed9-52564b4a20aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:48:46.523580 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f1b5da-deaa-4294-ba75-de4744281589 admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:48:46.558081 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 728/1447] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 30 00:48:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:48:46.571781 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4986606-b196-47c6-9ed9-52564b4a20aa None None] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:48:46.572658 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 720/1448] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 30 00:48:46 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 00:48:46.578600 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:48:46.580297 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f1b5da-deaa-4294-ba75-de4744281589 admin admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:48:46.611595 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4986606-b196-47c6-9ed9-52564b4a20aa None None] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:48:46.626319 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f1b5da-deaa-4294-ba75-de4744281589 admin admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:48:46.633272 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21981985-4a22-4ef3-9ea8-d2b4c6240581 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:48:46.634355 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21981985-4a22-4ef3-9ea8-d2b4c6240581 admin admin] REQUEST_METHOD: `PUT` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:48:46.634643 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21981985-4a22-4ef3-9ea8-d2b4c6240581 admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:48:46.635058 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21981985-4a22-4ef3-9ea8-d2b4c6240581 admin admin] PATH_INFO: `/v3/projects/71c4945f1bb047108f2b7451d4b97c0c/users/e5428571143446c4920ef8331e547f93/roles/6ccaa8c11f29456fb4e4eeccb21616c7` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:48:46.635920 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b3d338-664b-451d-bc3e-91d06f7abe06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:48:46.639438 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b3d338-664b-451d-bc3e-91d06f7abe06 admin admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:48:46.639862 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b3d338-664b-451d-bc3e-91d06f7abe06 admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:48:46.640283 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b3d338-664b-451d-bc3e-91d06f7abe06 admin admin] PATH_INFO: `/v3/domains` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:48:46.642343 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b3d338-664b-451d-bc3e-91d06f7abe06 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87956) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:48:46.642799 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b3d338-664b-451d-bc3e-91d06f7abe06 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:48:46.648190 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b3d338-664b-451d-bc3e-91d06f7abe06 admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:48:46.679850 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 729/1449] 10.222.0.42 () {58 vars in 1153 bytes} [Sun Oct 30 00:48:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:48:46.684213 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b3d338-664b-451d-bc3e-91d06f7abe06 admin admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:48:46.684901 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21981985-4a22-4ef3-9ea8-d2b4c6240581 admin admin] RBAC: Authorizing `identity:create_grant(project_id=71c4945f1bb047108f2b7451d4b97c0c, user_id=e5428571143446c4920ef8331e547f93, role_id=6ccaa8c11f29456fb4e4eeccb21616c7)` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:48:46.690956 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21981985-4a22-4ef3-9ea8-d2b4c6240581 admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:48:46.708343 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b3d338-664b-451d-bc3e-91d06f7abe06 admin admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:48:46.721594 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9803d768-e820-469d-999f-6c753e8894ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:48:46.722483 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9803d768-e820-469d-999f-6c753e8894ad admin admin] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:48:46.722822 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9803d768-e820-469d-999f-6c753e8894ad admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:48:46.723185 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9803d768-e820-469d-999f-6c753e8894ad admin admin] PATH_INFO: `/v3/projects` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:48:46.724333 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9803d768-e820-469d-999f-6c753e8894ad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:48:46.726425 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9803d768-e820-469d-999f-6c753e8894ad admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:48:46.738046 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 721/1450] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 30 00:48:46 2022] PUT /identity/v3/projects/71c4945f1bb047108f2b7451d4b97c0c/users/e5428571143446c4920ef8331e547f93/roles/6ccaa8c11f29456fb4e4eeccb21616c7 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 00:48:46.740230 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21981985-4a22-4ef3-9ea8-d2b4c6240581 admin admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:48:46.795769 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 730/1451] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 30 00:48:46 2022] POST /identity/v3/projects => generated 367 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 00:48:46.817470 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9803d768-e820-469d-999f-6c753e8894ad admin admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:48:46.929523 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9803d768-e820-469d-999f-6c753e8894ad admin admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:48:46.935150 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b787d9-3a89-48ac-8be5-1317aa3a94bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:48:46.935828 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b787d9-3a89-48ac-8be5-1317aa3a94bb admin admin] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:48:46.936276 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b787d9-3a89-48ac-8be5-1317aa3a94bb admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:48:46.936553 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b787d9-3a89-48ac-8be5-1317aa3a94bb admin admin] PATH_INFO: `/v3/users` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:48:46.937382 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b787d9-3a89-48ac-8be5-1317aa3a94bb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:48:46.940078 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b787d9-3a89-48ac-8be5-1317aa3a94bb admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:48:46.967850 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21981985-4a22-4ef3-9ea8-d2b4c6240581 admin admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:48:46.977996 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 731/1452] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 30 00:48:46 2022] POST /identity/v3/users => generated 284 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 30 00:48:46.981920 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b42acc-afce-46c7-9783-1e682bd83fec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:48:46.982574 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b42acc-afce-46c7-9783-1e682bd83fec admin admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:48:46.982860 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b42acc-afce-46c7-9783-1e682bd83fec admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:48:46.983133 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b42acc-afce-46c7-9783-1e682bd83fec admin admin] PATH_INFO: `/v3/roles` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:48:46.986483 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b787d9-3a89-48ac-8be5-1317aa3a94bb admin admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:48:46.986623 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b42acc-afce-46c7-9783-1e682bd83fec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:48:47.005267 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b42acc-afce-46c7-9783-1e682bd83fec admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:48:47.016251 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b787d9-3a89-48ac-8be5-1317aa3a94bb admin admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:48:47.032845 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d695002-13ba-4159-b821-6affd8ba07b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:48:47.037589 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 722/1453] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 30 00:48:46 2022] GET /identity/v3/roles => generated 1420 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 00:48:47.038512 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b42acc-afce-46c7-9783-1e682bd83fec admin admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:48:47.045869 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d695002-13ba-4159-b821-6affd8ba07b7 admin admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:48:47.046301 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d695002-13ba-4159-b821-6affd8ba07b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:48:47.046681 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d695002-13ba-4159-b821-6affd8ba07b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:48:47.047632 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d695002-13ba-4159-b821-6affd8ba07b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:48:47.052419 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d695002-13ba-4159-b821-6affd8ba07b7 admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:48:47.068647 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b42acc-afce-46c7-9783-1e682bd83fec admin admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:48:47.076757 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c811f5-6903-4ecd-a46c-38771263fbd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:48:47.077461 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c811f5-6903-4ecd-a46c-38771263fbd0 admin admin] REQUEST_METHOD: `PUT` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:48:47.081540 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c811f5-6903-4ecd-a46c-38771263fbd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:48:47.081795 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 732/1454] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 30 00:48:46 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 00:48:47.082208 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c811f5-6903-4ecd-a46c-38771263fbd0 admin admin] PATH_INFO: `/v3/projects/71c4945f1bb047108f2b7451d4b97c0c/users/e5428571143446c4920ef8331e547f93/roles/6ccaa8c11f29456fb4e4eeccb21616c7` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:48:47.084543 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c811f5-6903-4ecd-a46c-38771263fbd0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=71c4945f1bb047108f2b7451d4b97c0c, user_id=e5428571143446c4920ef8331e547f93, role_id=6ccaa8c11f29456fb4e4eeccb21616c7)` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:48:47.085935 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d695002-13ba-4159-b821-6affd8ba07b7 admin admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:48:47.090079 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c811f5-6903-4ecd-a46c-38771263fbd0 admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:48:47.110681 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d695002-13ba-4159-b821-6affd8ba07b7 admin admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:48:47.124786 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 723/1455] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 30 00:48:47 2022] PUT /identity/v3/projects/71c4945f1bb047108f2b7451d4b97c0c/users/e5428571143446c4920ef8331e547f93/roles/6ccaa8c11f29456fb4e4eeccb21616c7 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 00:48:47.126310 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf43bd0-4a26-454a-a46b-9a88d2bdb625 None None] REQUEST_METHOD: `POST` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:48:47.126607 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf43bd0-4a26-454a-a46b-9a88d2bdb625 None None] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:48:47.126877 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf43bd0-4a26-454a-a46b-9a88d2bdb625 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:48:47.191361 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.auth.core [None req-faf43bd0-4a26-454a-a46b-9a88d2bdb625 None None] MFA Rules not processed for user `e5428571143446c4920ef8331e547f93`. Rule list: `[]` (Enabled: `True`). {{(pid=87955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:48:47.194584 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-faf43bd0-4a26-454a-a46b-9a88d2bdb625 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:48:47.226883 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:48:47.247905 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e644204-781d-4f5a-adb9-8dfd7c6fda24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:48:47.249103 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e644204-781d-4f5a-adb9-8dfd7c6fda24 admin admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:48:47.249483 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e644204-781d-4f5a-adb9-8dfd7c6fda24 admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:48:47.250038 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e644204-781d-4f5a-adb9-8dfd7c6fda24 admin admin] PATH_INFO: `/v3/roles` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:48:47.250946 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e644204-781d-4f5a-adb9-8dfd7c6fda24 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:48:47.252730 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e644204-781d-4f5a-adb9-8dfd7c6fda24 admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:48:47.286635 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 733/1456] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 30 00:48:47 2022] GET /identity/v3/roles => generated 1420 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 00:48:47.297251 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e644204-781d-4f5a-adb9-8dfd7c6fda24 admin admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:48:47.312501 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e644204-781d-4f5a-adb9-8dfd7c6fda24 admin admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:48:47.318762 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1f93a8-0b78-40c8-a125-a969990fddcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:48:47.320089 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1f93a8-0b78-40c8-a125-a969990fddcc admin admin] REQUEST_METHOD: `PUT` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:48:47.320375 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1f93a8-0b78-40c8-a125-a969990fddcc admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:48:47.320715 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1f93a8-0b78-40c8-a125-a969990fddcc admin admin] PATH_INFO: `/v3/projects/70415c9a474547ebad7bc3e7de6d3c47/users/bd5993cccf7d4b8d83d6b15595da7f46/roles/1c93019874174c4b91118d9ce2347e47` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:48:47.341432 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 724/1457] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 30 00:48:47 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:48:47.371757 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf43bd0-4a26-454a-a46b-9a88d2bdb625 None None] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:48:47.374107 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-faf43bd0-4a26-454a-a46b-9a88d2bdb625 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:48:47.406448 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1f93a8-0b78-40c8-a125-a969990fddcc admin admin] RBAC: Authorizing `identity:create_grant(project_id=70415c9a474547ebad7bc3e7de6d3c47, user_id=bd5993cccf7d4b8d83d6b15595da7f46, role_id=1c93019874174c4b91118d9ce2347e47)` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:48:47.419846 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1f93a8-0b78-40c8-a125-a969990fddcc admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:48:47.464722 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 734/1458] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 30 00:48:47 2022] PUT /identity/v3/projects/70415c9a474547ebad7bc3e7de6d3c47/users/bd5993cccf7d4b8d83d6b15595da7f46/roles/1c93019874174c4b91118d9ce2347e47 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 00:48:47.477349 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56ac34a-e432-4d6a-b291-3ceaad6848af None None] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:48:47.477810 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56ac34a-e432-4d6a-b291-3ceaad6848af None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:48:47.478095 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56ac34a-e432-4d6a-b291-3ceaad6848af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:48:47.528025 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf43bd0-4a26-454a-a46b-9a88d2bdb625 None None] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:48:47.600544 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.auth.core [None req-f56ac34a-e432-4d6a-b291-3ceaad6848af None None] MFA Rules not processed for user `bd5993cccf7d4b8d83d6b15595da7f46`. Rule list: `[]` (Enabled: `True`). {{(pid=87956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:48:47.601895 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-f56ac34a-e432-4d6a-b291-3ceaad6848af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:48:47.618450 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:48:47.672399 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5565ec82-cb60-4594-8659-5270d1ab9365 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48d928ff7fe24348ac900f09c56acc20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d2387fdf794d4eaef07bbcd7b39f2a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:48:47.676255 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5565ec82-cb60-4594-8659-5270d1ab9365 service cinder] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:48:47.676818 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5565ec82-cb60-4594-8659-5270d1ab9365 service cinder] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:48:47.679972 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5565ec82-cb60-4594-8659-5270d1ab9365 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:48:47.847010 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 735/1459] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 30 00:48:47 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 372 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:48:47.849379 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56ac34a-e432-4d6a-b291-3ceaad6848af None None] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:48:47.978518 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5565ec82-cb60-4594-8659-5270d1ab9365 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:48:47.979782 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56ac34a-e432-4d6a-b291-3ceaad6848af None None] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:48:47.981310 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5565ec82-cb60-4594-8659-5270d1ab9365 service cinder] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:48:48.009078 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e51bad0-2793-4506-b098-88c6a42db5d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:48:48.009798 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e51bad0-2793-4506-b098-88c6a42db5d3 admin admin] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:48:48.010082 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e51bad0-2793-4506-b098-88c6a42db5d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:48:48.010354 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e51bad0-2793-4506-b098-88c6a42db5d3 admin admin] PATH_INFO: `/v3/projects` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:48:48.011094 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e51bad0-2793-4506-b098-88c6a42db5d3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:48:48.013884 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e51bad0-2793-4506-b098-88c6a42db5d3 admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:48:48.016885 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 725/1460] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 30 00:48:47 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 646 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 00:48:48.132947 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5565ec82-cb60-4594-8659-5270d1ab9365 service cinder] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:48:48.154570 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 736/1461] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 30 00:48:47 2022] POST /identity/v3/projects => generated 367 bytes in 307 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 00:48:48.159913 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5565ec82-cb60-4594-8659-5270d1ab9365 service cinder] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:48:48.161171 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e51bad0-2793-4506-b098-88c6a42db5d3 admin admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:48:48.277900 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=100 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:48:48.367666 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e51bad0-2793-4506-b098-88c6a42db5d3 admin admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:48:48.375713 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac319ff7-f471-4ad3-b612-67786d6ef9a5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48d928ff7fe24348ac900f09c56acc20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d2387fdf794d4eaef07bbcd7b39f2a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:48:48.376355 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac319ff7-f471-4ad3-b612-67786d6ef9a5 service cinder] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:48:48.376637 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac319ff7-f471-4ad3-b612-67786d6ef9a5 service cinder] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:48:48.376971 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac319ff7-f471-4ad3-b612-67786d6ef9a5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:48:48.380089 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-ac319ff7-f471-4ad3-b612-67786d6ef9a5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:48:48.415628 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc742d7-5554-424a-a3f0-9b29ae051667 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:48:48.417338 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc742d7-5554-424a-a3f0-9b29ae051667 admin admin] REQUEST_METHOD: `POST` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:48:48.419117 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc742d7-5554-424a-a3f0-9b29ae051667 admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:48:48.419635 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc742d7-5554-424a-a3f0-9b29ae051667 admin admin] PATH_INFO: `/v3/users` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:48:48.423475 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc742d7-5554-424a-a3f0-9b29ae051667 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:48:48.427374 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc742d7-5554-424a-a3f0-9b29ae051667 admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:48:48.503603 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 726/1462] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 30 00:48:48 2022] POST /identity/v3/users => generated 290 bytes in 371 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 00:48:48.509385 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:48:48.510072 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc742d7-5554-424a-a3f0-9b29ae051667 admin admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:48:48.517303 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-4bc742d7-5554-424a-a3f0-9b29ae051667 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:48:48.544399 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac319ff7-f471-4ad3-b612-67786d6ef9a5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:48:48.550061 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac319ff7-f471-4ad3-b612-67786d6ef9a5 service cinder] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:48:48.560059 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc742d7-5554-424a-a3f0-9b29ae051667 admin admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:48:48.575418 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c26e8be-614a-4687-8461-1e627ee84c92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:48:48.576338 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 737/1463] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 30 00:48:48 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 00:48:48.577790 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac319ff7-f471-4ad3-b612-67786d6ef9a5 service cinder] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:48:48.578509 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c26e8be-614a-4687-8461-1e627ee84c92 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:48:48.579606 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c26e8be-614a-4687-8461-1e627ee84c92 admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:48:48.580496 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c26e8be-614a-4687-8461-1e627ee84c92 admin admin] PATH_INFO: `/v3/users/2f10ee9c6d1b49459b8b72701a9b0461` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:48:48.582672 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c26e8be-614a-4687-8461-1e627ee84c92 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2f10ee9c6d1b49459b8b72701a9b0461)` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:48:48.593034 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac319ff7-f471-4ad3-b612-67786d6ef9a5 service cinder] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:48:48.599943 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7ff84a-5cfd-45a8-8932-b197a536362e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:48:48.600644 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7ff84a-5cfd-45a8-8932-b197a536362e admin admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:48:48.600911 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7ff84a-5cfd-45a8-8932-b197a536362e admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:48:48.601229 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7ff84a-5cfd-45a8-8932-b197a536362e admin admin] PATH_INFO: `/v3/roles` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:48:48.603713 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7ff84a-5cfd-45a8-8932-b197a536362e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:48:48.606328 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7ff84a-5cfd-45a8-8932-b197a536362e admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:48:48.611281 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c26e8be-614a-4687-8461-1e627ee84c92 admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:48:48.621748 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 738/1464] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 30 00:48:48 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 00:48:48.626713 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7ff84a-5cfd-45a8-8932-b197a536362e admin admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:48:48.639797 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7ff84a-5cfd-45a8-8932-b197a536362e admin admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:48:48.648380 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45e2c51-b6df-41e5-99c4-5b1184c9bb60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:48:48.649215 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45e2c51-b6df-41e5-99c4-5b1184c9bb60 admin admin] REQUEST_METHOD: `PUT` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:48:48.649769 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45e2c51-b6df-41e5-99c4-5b1184c9bb60 admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:48:48.650154 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45e2c51-b6df-41e5-99c4-5b1184c9bb60 admin admin] PATH_INFO: `/v3/projects/b9e6747a718b456a82af0d611a809b34/users/2d7fa7b969e346b6a379371c37cb9eeb/roles/6ccaa8c11f29456fb4e4eeccb21616c7` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:48:48.675302 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45e2c51-b6df-41e5-99c4-5b1184c9bb60 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b9e6747a718b456a82af0d611a809b34, user_id=2d7fa7b969e346b6a379371c37cb9eeb, role_id=6ccaa8c11f29456fb4e4eeccb21616c7)` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:48:48.678990 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45e2c51-b6df-41e5-99c4-5b1184c9bb60 admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:48:48.717603 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 739/1465] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 30 00:48:48 2022] PUT /identity/v3/projects/b9e6747a718b456a82af0d611a809b34/users/2d7fa7b969e346b6a379371c37cb9eeb/roles/6ccaa8c11f29456fb4e4eeccb21616c7 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 00:48:48.726806 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45e2c51-b6df-41e5-99c4-5b1184c9bb60 admin admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:48:48.808605 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-1c26e8be-614a-4687-8461-1e627ee84c92 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2f10ee9c6d1b49459b8b72701a9b0461'} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:48:48.808605 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-1c26e8be-614a-4687-8461-1e627ee84c92 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2f10ee9c6d1b49459b8b72701a9b0461'} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:48:48.824765 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-1c26e8be-614a-4687-8461-1e627ee84c92 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2f10ee9c6d1b49459b8b72701a9b0461'} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:48:48.825591 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-1c26e8be-614a-4687-8461-1e627ee84c92 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2f10ee9c6d1b49459b8b72701a9b0461'} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:48:48.854350 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-1c26e8be-614a-4687-8461-1e627ee84c92 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2f10ee9c6d1b49459b8b72701a9b0461'} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:48:48.870165 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45e2c51-b6df-41e5-99c4-5b1184c9bb60 admin admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:48:48.886581 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc8883b-4d62-44b1-b91d-720e455b8578 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:48:48.887774 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc8883b-4d62-44b1-b91d-720e455b8578 admin admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:48:48.887893 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 727/1466] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 30 00:48:48 2022] DELETE /identity/v3/users/2f10ee9c6d1b49459b8b72701a9b0461 => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 00:48:48.888418 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc8883b-4d62-44b1-b91d-720e455b8578 admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:48:48.888898 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc8883b-4d62-44b1-b91d-720e455b8578 admin admin] PATH_INFO: `/v3/roles` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:48:48.889761 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc8883b-4d62-44b1-b91d-720e455b8578 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:48:48.891913 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc8883b-4d62-44b1-b91d-720e455b8578 admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:48:48.892601 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67146c6b-5d58-49fc-8500-b2fbb6fe1e48 None None] REQUEST_METHOD: `POST` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:48:48.892885 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67146c6b-5d58-49fc-8500-b2fbb6fe1e48 None None] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:48:48.893159 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67146c6b-5d58-49fc-8500-b2fbb6fe1e48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:48:48.921890 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 740/1467] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 30 00:48:48 2022] GET /identity/v3/roles => generated 1420 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 00:48:48.927327 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc8883b-4d62-44b1-b91d-720e455b8578 admin admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:48:48.931075 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-cfc8883b-4d62-44b1-b91d-720e455b8578 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:48:48.955546 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.auth.core [None req-67146c6b-5d58-49fc-8500-b2fbb6fe1e48 None None] MFA Rules not processed for user `eb55b6cbca4945abb21b0e49eb745e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=87955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:48:48.961351 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-67146c6b-5d58-49fc-8500-b2fbb6fe1e48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:48:48.964397 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc8883b-4d62-44b1-b91d-720e455b8578 admin admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:48:49.189865 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 728/1468] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 30 00:48:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 298 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 30 00:48:49.217713 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67146c6b-5d58-49fc-8500-b2fbb6fe1e48 None None] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:48:49.219513 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-67146c6b-5d58-49fc-8500-b2fbb6fe1e48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:48:49.248324 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952fef83-1b15-418a-b66b-df5e3dbbbc02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:48:49.250170 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952fef83-1b15-418a-b66b-df5e3dbbbc02 admin admin] REQUEST_METHOD: `PUT` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:48:49.250514 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952fef83-1b15-418a-b66b-df5e3dbbbc02 admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:48:49.250807 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952fef83-1b15-418a-b66b-df5e3dbbbc02 admin admin] PATH_INFO: `/v3/projects/b9e6747a718b456a82af0d611a809b34/users/2d7fa7b969e346b6a379371c37cb9eeb/roles/6ccaa8c11f29456fb4e4eeccb21616c7` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:48:49.259704 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952fef83-1b15-418a-b66b-df5e3dbbbc02 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b9e6747a718b456a82af0d611a809b34, user_id=2d7fa7b969e346b6a379371c37cb9eeb, role_id=6ccaa8c11f29456fb4e4eeccb21616c7)` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:48:49.271576 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952fef83-1b15-418a-b66b-df5e3dbbbc02 admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:48:49.314314 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:48:49.341926 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 741/1469] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 30 00:48:48 2022] PUT /identity/v3/projects/b9e6747a718b456a82af0d611a809b34/users/2d7fa7b969e346b6a379371c37cb9eeb/roles/6ccaa8c11f29456fb4e4eeccb21616c7 => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 00:48:49.354350 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42a1eb9-30e7-4054-8916-d28d96181cfe None None] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:48:49.354350 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42a1eb9-30e7-4054-8916-d28d96181cfe None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:48:49.354698 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42a1eb9-30e7-4054-8916-d28d96181cfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:48:49.467006 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67146c6b-5d58-49fc-8500-b2fbb6fe1e48 None None] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:48:49.471242 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.auth.core [None req-c42a1eb9-30e7-4054-8916-d28d96181cfe None None] MFA Rules not processed for user `2d7fa7b969e346b6a379371c37cb9eeb`. Rule list: `[]` (Enabled: `True`). {{(pid=87956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:48:49.478221 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-c42a1eb9-30e7-4054-8916-d28d96181cfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:48:49.588427 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8b901c-822e-40c0-914f-64aa104edd04 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5693f186c6ad4d9394f02ee3477cdcd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d2387fdf794d4eaef07bbcd7b39f2a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:48:49.589244 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8b901c-822e-40c0-914f-64aa104edd04 service neutron] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:48:49.590262 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8b901c-822e-40c0-914f-64aa104edd04 service neutron] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:48:49.591042 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8b901c-822e-40c0-914f-64aa104edd04 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:48:49.632119 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:48:49.792482 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 742/1470] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 30 00:48:49 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 439 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:48:49.795415 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4f7cf2-9ba2-4905-9e34-380cac6471d7 None None] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:48:49.807941 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4f7cf2-9ba2-4905-9e34-380cac6471d7 None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:48:49.809040 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4f7cf2-9ba2-4905-9e34-380cac6471d7 None None] PATH_INFO: `/` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:48:49.815427 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 743/1471] 10.222.0.42 () {54 vars in 921 bytes} [Sun Oct 30 00:48:49 2022] GET /identity => generated 270 bytes in 22 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:48:49.820017 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4f7cf2-9ba2-4905-9e34-380cac6471d7 None None] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:48:49.827290 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-bd4f7cf2-9ba2-4905-9e34-380cac6471d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:48:49.874352 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8b901c-822e-40c0-914f-64aa104edd04 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:48:49.886262 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8b901c-822e-40c0-914f-64aa104edd04 service neutron] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:48:49.930374 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 729/1472] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 30 00:48:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 713 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 00:48:50.001785 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4f7cf2-9ba2-4905-9e34-380cac6471d7 None None] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:48:50.011076 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85437720-14fe-4f80-acbe-401b5b8d9dc5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48d928ff7fe24348ac900f09c56acc20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d2387fdf794d4eaef07bbcd7b39f2a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:48:50.013443 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85437720-14fe-4f80-acbe-401b5b8d9dc5 service cinder] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:48:50.015133 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85437720-14fe-4f80-acbe-401b5b8d9dc5 service cinder] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:48:50.016176 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85437720-14fe-4f80-acbe-401b5b8d9dc5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:48:50.061516 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85437720-14fe-4f80-acbe-401b5b8d9dc5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:48:50.063427 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85437720-14fe-4f80-acbe-401b5b8d9dc5 service cinder] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:48:50.138134 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 744/1473] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 30 00:48:49 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 00:48:50.147632 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3c445c-ea70-4edc-8de2-bbb1e7a0229b None None] REQUEST_METHOD: `POST` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:48:50.148115 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3c445c-ea70-4edc-8de2-bbb1e7a0229b None None] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:48:50.148589 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3c445c-ea70-4edc-8de2-bbb1e7a0229b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:48:50.214078 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.auth.core [None req-6f3c445c-ea70-4edc-8de2-bbb1e7a0229b None None] MFA Rules not processed for user `fde877b6ddc74f4a87baf21471eb31d2`. Rule list: `[]` (Enabled: `True`). {{(pid=87955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:48:50.218295 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-6f3c445c-ea70-4edc-8de2-bbb1e7a0229b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:48:50.264330 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979b4f06-8779-45cd-92b1-39247f5f3093 None None] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:48:50.264943 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979b4f06-8779-45cd-92b1-39247f5f3093 None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:48:50.265178 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979b4f06-8779-45cd-92b1-39247f5f3093 None None] PATH_INFO: `/` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:48:50.267481 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 745/1474] 10.222.0.42 () {54 vars in 921 bytes} [Sun Oct 30 00:48:50 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:48:50.312845 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979b4f06-8779-45cd-92b1-39247f5f3093 None None] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:48:50.330626 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979b4f06-8779-45cd-92b1-39247f5f3093 None None] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:48:50.343473 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272e0b81-9ff7-484b-9812-e73800f0a874 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48d928ff7fe24348ac900f09c56acc20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d2387fdf794d4eaef07bbcd7b39f2a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:48:50.344753 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272e0b81-9ff7-484b-9812-e73800f0a874 service cinder] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:48:50.346413 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272e0b81-9ff7-484b-9812-e73800f0a874 service cinder] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:48:50.346876 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272e0b81-9ff7-484b-9812-e73800f0a874 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:48:50.351180 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-272e0b81-9ff7-484b-9812-e73800f0a874 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:48:50.456391 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 730/1475] 10.222.0.42 () {58 vars in 1018 bytes} [Sun Oct 30 00:48:50 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 310 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:48:50.510686 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dfd62c-c044-4922-a63e-d202ecb72f4b None None] REQUEST_METHOD: `POST` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:48:50.511268 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dfd62c-c044-4922-a63e-d202ecb72f4b None None] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:48:50.511798 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dfd62c-c044-4922-a63e-d202ecb72f4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:48:50.567260 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.auth.core [None req-76dfd62c-c044-4922-a63e-d202ecb72f4b None None] MFA Rules not processed for user `fde877b6ddc74f4a87baf21471eb31d2`. Rule list: `[]` (Enabled: `True`). {{(pid=87955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:48:50.573287 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-76dfd62c-c044-4922-a63e-d202ecb72f4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:48:50.581438 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272e0b81-9ff7-484b-9812-e73800f0a874 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:48:50.582895 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272e0b81-9ff7-484b-9812-e73800f0a874 service cinder] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:48:50.610198 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 731/1476] 10.222.0.42 () {58 vars in 1018 bytes} [Sun Oct 30 00:48:50 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:48:50.626658 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 746/1477] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 30 00:48:50 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 30 00:48:51.193308 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76dfd62c-c044-4922-a63e-d202ecb72f4b None None] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:48:51.195014 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-76dfd62c-c044-4922-a63e-d202ecb72f4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:48:51.208609 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272e0b81-9ff7-484b-9812-e73800f0a874 service cinder] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:48:51.211066 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-272e0b81-9ff7-484b-9812-e73800f0a874 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:48:51.236981 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76dfd62c-c044-4922-a63e-d202ecb72f4b None None] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:48:51.256572 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272e0b81-9ff7-484b-9812-e73800f0a874 service cinder] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:48:51.264132 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745c58a0-f239-4f3c-b9ad-1e1c9c734f63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:48:51.266468 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745c58a0-f239-4f3c-b9ad-1e1c9c734f63 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:48:51.268286 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745c58a0-f239-4f3c-b9ad-1e1c9c734f63 admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:48:51.269490 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745c58a0-f239-4f3c-b9ad-1e1c9c734f63 admin admin] PATH_INFO: `/v3/projects/671aa3b2a72249cb8a2a840d522f96cc` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:48:51.275745 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745c58a0-f239-4f3c-b9ad-1e1c9c734f63 admin admin] RBAC: Authorizing `identity:delete_project(project_id=671aa3b2a72249cb8a2a840d522f96cc)` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:48:51.284762 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745c58a0-f239-4f3c-b9ad-1e1c9c734f63 admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:48:51.288980 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82214d0f-4e65-4464-9c7e-7535c7edd1f9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fde877b6ddc74f4a87baf21471eb31d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d2387fdf794d4eaef07bbcd7b39f2a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:48:51.292123 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82214d0f-4e65-4464-9c7e-7535c7edd1f9 service nova] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:48:51.294036 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82214d0f-4e65-4464-9c7e-7535c7edd1f9 service nova] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:48:51.295301 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82214d0f-4e65-4464-9c7e-7535c7edd1f9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:48:51.339883 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=100 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:48:51.340240 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82214d0f-4e65-4464-9c7e-7535c7edd1f9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:48:51.340240 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82214d0f-4e65-4464-9c7e-7535c7edd1f9 service nova] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:48:51.372868 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 747/1478] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 30 00:48:51 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 30 00:48:51.459981 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-745c58a0-f239-4f3c-b9ad-1e1c9c734f63 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '671aa3b2a72249cb8a2a840d522f96cc', 'request_id': 'req-745c58a0-f239-4f3c-b9ad-1e1c9c734f63'} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:48:51.475033 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-745c58a0-f239-4f3c-b9ad-1e1c9c734f63 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '671aa3b2a72249cb8a2a840d522f96cc', 'request_id': 'req-745c58a0-f239-4f3c-b9ad-1e1c9c734f63'} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:48:51.491495 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-745c58a0-f239-4f3c-b9ad-1e1c9c734f63 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '671aa3b2a72249cb8a2a840d522f96cc', 'request_id': 'req-745c58a0-f239-4f3c-b9ad-1e1c9c734f63'} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:48:51.552891 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-745c58a0-f239-4f3c-b9ad-1e1c9c734f63 admin admin] The token cache is being invalidate because project 671aa3b2a72249cb8a2a840d522f96cc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87955) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 00:48:51.553192 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-745c58a0-f239-4f3c-b9ad-1e1c9c734f63 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:48:51.555343 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-745c58a0-f239-4f3c-b9ad-1e1c9c734f63 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:48:51.564545 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 732/1479] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 30 00:48:51 2022] DELETE /identity/v3/projects/671aa3b2a72249cb8a2a840d522f96cc => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 00:48:51.578343 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c11e6e-156a-4ede-993d-cf2e7269aefe None None] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:48:51.578679 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c11e6e-156a-4ede-993d-cf2e7269aefe None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:48:51.579066 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c11e6e-156a-4ede-993d-cf2e7269aefe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:48:51.600752 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745c58a0-f239-4f3c-b9ad-1e1c9c734f63 admin admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:48:51.602182 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-745c58a0-f239-4f3c-b9ad-1e1c9c734f63 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:48:51.631521 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.auth.core [None req-14c11e6e-156a-4ede-993d-cf2e7269aefe None None] MFA Rules not processed for user `eb55b6cbca4945abb21b0e49eb745e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=87956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:48:51.632806 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-14c11e6e-156a-4ede-993d-cf2e7269aefe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:48:51.801170 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=100 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:48:51.827265 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 748/1480] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 30 00:48:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:48:51.842041 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d4ae21-46f1-4967-a24e-ad507078acd6 None None] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:48:51.843926 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d4ae21-46f1-4967-a24e-ad507078acd6 None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:48:51.844231 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d4ae21-46f1-4967-a24e-ad507078acd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:48:51.886132 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745c58a0-f239-4f3c-b9ad-1e1c9c734f63 admin admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:48:51.897816 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.auth.core [None req-02d4ae21-46f1-4967-a24e-ad507078acd6 None None] MFA Rules not processed for user `eb55b6cbca4945abb21b0e49eb745e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=87956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:48:51.899122 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-02d4ae21-46f1-4967-a24e-ad507078acd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:48:51.900154 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49fa26c-f5d1-4815-bbc0-6e520cf677c0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fde877b6ddc74f4a87baf21471eb31d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d2387fdf794d4eaef07bbcd7b39f2a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:48:51.902092 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49fa26c-f5d1-4815-bbc0-6e520cf677c0 service nova] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:48:51.903189 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49fa26c-f5d1-4815-bbc0-6e520cf677c0 service nova] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:48:51.904384 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49fa26c-f5d1-4815-bbc0-6e520cf677c0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:48:51.907904 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-e49fa26c-f5d1-4815-bbc0-6e520cf677c0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:48:51.921220 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 749/1481] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 30 00:48:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:48:51.925698 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d4ae21-46f1-4967-a24e-ad507078acd6 None None] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:48:51.943085 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49fa26c-f5d1-4815-bbc0-6e520cf677c0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:48:51.945718 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49fa26c-f5d1-4815-bbc0-6e520cf677c0 service nova] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:48:51.946957 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d4ae21-46f1-4967-a24e-ad507078acd6 None None] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:48:51.964162 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ed42d5-e08a-4aed-b1fa-4e8bea790d3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:48:51.964880 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ed42d5-e08a-4aed-b1fa-4e8bea790d3b admin admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:48:51.965167 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ed42d5-e08a-4aed-b1fa-4e8bea790d3b admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:48:51.965467 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ed42d5-e08a-4aed-b1fa-4e8bea790d3b admin admin] PATH_INFO: `/v3/domains` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:48:51.966252 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ed42d5-e08a-4aed-b1fa-4e8bea790d3b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87956) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:48:51.966548 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ed42d5-e08a-4aed-b1fa-4e8bea790d3b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:48:51.968551 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ed42d5-e08a-4aed-b1fa-4e8bea790d3b admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:48:51.970498 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 733/1482] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 30 00:48:51 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 00:48:52.017247 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49fa26c-f5d1-4815-bbc0-6e520cf677c0 service nova] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:48:52.036774 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 750/1483] 10.222.0.42 () {58 vars in 1153 bytes} [Sun Oct 30 00:48:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 30 00:48:52.044492 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49fa26c-f5d1-4815-bbc0-6e520cf677c0 service nova] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:48:52.084642 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290d065c-7cce-45b8-b067-831c342d0708 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:48:52.085397 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290d065c-7cce-45b8-b067-831c342d0708 admin admin] REQUEST_METHOD: `POST` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:48:52.088659 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290d065c-7cce-45b8-b067-831c342d0708 admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:48:52.089248 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290d065c-7cce-45b8-b067-831c342d0708 admin admin] PATH_INFO: `/v3/projects` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:48:52.091369 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290d065c-7cce-45b8-b067-831c342d0708 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:48:52.098157 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290d065c-7cce-45b8-b067-831c342d0708 admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:48:52.203305 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ed42d5-e08a-4aed-b1fa-4e8bea790d3b admin admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:48:52.215625 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 734/1484] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 30 00:48:52 2022] POST /identity/v3/projects => generated 403 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 00:48:52.220968 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ed42d5-e08a-4aed-b1fa-4e8bea790d3b admin admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:48:52.406875 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f80f7f3-09fb-43e8-bbeb-a0ede8e361b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:48:52.407568 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f80f7f3-09fb-43e8-bbeb-a0ede8e361b7 admin admin] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:48:52.407568 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f80f7f3-09fb-43e8-bbeb-a0ede8e361b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:48:52.407738 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f80f7f3-09fb-43e8-bbeb-a0ede8e361b7 admin admin] PATH_INFO: `/v3/users` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:48:52.408304 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f80f7f3-09fb-43e8-bbeb-a0ede8e361b7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:48:52.425001 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f80f7f3-09fb-43e8-bbeb-a0ede8e361b7 admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:48:52.489490 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 751/1485] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 30 00:48:52 2022] POST /identity/v3/users => generated 302 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 00:48:52.499164 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290d065c-7cce-45b8-b067-831c342d0708 admin admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:48:52.520670 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290d065c-7cce-45b8-b067-831c342d0708 admin admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:48:52.527989 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763a15bf-b3e1-48c2-b548-e249ec7cca92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:48:52.528689 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763a15bf-b3e1-48c2-b548-e249ec7cca92 admin admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:48:52.528974 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763a15bf-b3e1-48c2-b548-e249ec7cca92 admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:48:52.529245 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763a15bf-b3e1-48c2-b548-e249ec7cca92 admin admin] PATH_INFO: `/v3/roles` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:48:52.530475 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763a15bf-b3e1-48c2-b548-e249ec7cca92 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:48:52.534305 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763a15bf-b3e1-48c2-b548-e249ec7cca92 admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:48:52.565464 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 735/1486] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 30 00:48:52 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 00:48:52.565862 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f80f7f3-09fb-43e8-bbeb-a0ede8e361b7 admin admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:48:52.591329 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f80f7f3-09fb-43e8-bbeb-a0ede8e361b7 admin admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:48:52.598596 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea42f6a-bb6d-443e-9a9e-244565920e47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:48:52.599327 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea42f6a-bb6d-443e-9a9e-244565920e47 admin admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:48:52.599605 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea42f6a-bb6d-443e-9a9e-244565920e47 admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:48:52.599967 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea42f6a-bb6d-443e-9a9e-244565920e47 admin admin] PATH_INFO: `/v3/roles` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:48:52.600891 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea42f6a-bb6d-443e-9a9e-244565920e47 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:48:52.603660 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea42f6a-bb6d-443e-9a9e-244565920e47 admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:48:52.618418 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 752/1487] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 30 00:48:52 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 00:48:52.622687 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763a15bf-b3e1-48c2-b548-e249ec7cca92 admin admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:48:52.640103 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763a15bf-b3e1-48c2-b548-e249ec7cca92 admin admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:48:52.657656 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59af30b2-2202-4150-9461-f2acf74731a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:48:52.659999 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59af30b2-2202-4150-9461-f2acf74731a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:48:52.660469 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59af30b2-2202-4150-9461-f2acf74731a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:48:52.661717 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59af30b2-2202-4150-9461-f2acf74731a1 admin admin] PATH_INFO: `/v3/projects/3e3e72d990f54416902d002db0e237cd/users/44968b5c2b4e46319e36bf9b1ce23279/roles/1c93019874174c4b91118d9ce2347e47` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:48:52.724684 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59af30b2-2202-4150-9461-f2acf74731a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e3e72d990f54416902d002db0e237cd, user_id=44968b5c2b4e46319e36bf9b1ce23279, role_id=1c93019874174c4b91118d9ce2347e47)` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:48:52.727664 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59af30b2-2202-4150-9461-f2acf74731a1 admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:48:52.800197 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 736/1488] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 30 00:48:52 2022] PUT /identity/v3/projects/3e3e72d990f54416902d002db0e237cd/users/44968b5c2b4e46319e36bf9b1ce23279/roles/1c93019874174c4b91118d9ce2347e47 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 00:48:52.812313 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d2328b-fc44-407d-9787-8bff57cb9d38 None None] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:48:52.812799 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d2328b-fc44-407d-9787-8bff57cb9d38 None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:48:52.813163 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d2328b-fc44-407d-9787-8bff57cb9d38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:48:52.929587 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.auth.core [None req-35d2328b-fc44-407d-9787-8bff57cb9d38 None None] MFA Rules not processed for user `44968b5c2b4e46319e36bf9b1ce23279`. Rule list: `[]` (Enabled: `True`). {{(pid=87956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:48:52.931402 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-35d2328b-fc44-407d-9787-8bff57cb9d38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:48:53.107129 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59af30b2-2202-4150-9461-f2acf74731a1 admin admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:48:53.107334 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 753/1489] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 30 00:48:52 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 296 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:48:53.157072 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:48:53.235006 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59af30b2-2202-4150-9461-f2acf74731a1 admin admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:48:53.255339 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7e4c14-3bad-4012-afc6-51ab7305e72a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:48:53.255999 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7e4c14-3bad-4012-afc6-51ab7305e72a admin admin] REQUEST_METHOD: `POST` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:48:53.256396 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7e4c14-3bad-4012-afc6-51ab7305e72a admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:48:53.256773 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7e4c14-3bad-4012-afc6-51ab7305e72a admin admin] PATH_INFO: `/v3/projects` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:48:53.257986 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7e4c14-3bad-4012-afc6-51ab7305e72a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:48:53.260960 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7e4c14-3bad-4012-afc6-51ab7305e72a admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:48:53.338499 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d2328b-fc44-407d-9787-8bff57cb9d38 None None] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:48:53.340131 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 737/1490] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 30 00:48:53 2022] POST /identity/v3/projects => generated 401 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 30 00:48:53.356048 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d2328b-fc44-407d-9787-8bff57cb9d38 None None] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:48:53.520830 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:48:53.570801 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41448be-b963-42bc-9b2b-9e94c6d69a7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:48:53.571449 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41448be-b963-42bc-9b2b-9e94c6d69a7b admin admin] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:48:53.571788 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41448be-b963-42bc-9b2b-9e94c6d69a7b admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:48:53.571981 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41448be-b963-42bc-9b2b-9e94c6d69a7b admin admin] PATH_INFO: `/v3/users` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:48:53.572624 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41448be-b963-42bc-9b2b-9e94c6d69a7b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:48:53.576382 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41448be-b963-42bc-9b2b-9e94c6d69a7b admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:48:53.633049 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 754/1491] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 30 00:48:53 2022] POST /identity/v3/users => generated 307 bytes in 292 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 00:48:53.634126 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7e4c14-3bad-4012-afc6-51ab7305e72a admin admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:48:53.662668 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7e4c14-3bad-4012-afc6-51ab7305e72a admin admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:48:53.680447 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fba76d-6edd-4d86-b29e-37ffff269e0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:48:53.681717 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fba76d-6edd-4d86-b29e-37ffff269e0f admin admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:48:53.682364 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fba76d-6edd-4d86-b29e-37ffff269e0f admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:48:53.682838 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fba76d-6edd-4d86-b29e-37ffff269e0f admin admin] PATH_INFO: `/v3/roles` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:48:53.684030 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fba76d-6edd-4d86-b29e-37ffff269e0f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:48:53.686920 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fba76d-6edd-4d86-b29e-37ffff269e0f admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:48:53.729278 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41448be-b963-42bc-9b2b-9e94c6d69a7b admin admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:48:53.739356 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 738/1492] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 30 00:48:53 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 00:48:53.742863 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41448be-b963-42bc-9b2b-9e94c6d69a7b admin admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:48:53.777835 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce880fd4-d4f1-4d8f-8272-fd0ca0e9d709 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:48:53.778524 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce880fd4-d4f1-4d8f-8272-fd0ca0e9d709 admin admin] REQUEST_METHOD: `PUT` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:48:53.781455 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce880fd4-d4f1-4d8f-8272-fd0ca0e9d709 admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:48:53.781770 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce880fd4-d4f1-4d8f-8272-fd0ca0e9d709 admin admin] PATH_INFO: `/v3/projects/e06ee9a1445f44de85344809db1af230/users/a913dd3436f04c69b25a69f6d0b1784e/roles/6ccaa8c11f29456fb4e4eeccb21616c7` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:48:53.836344 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce880fd4-d4f1-4d8f-8272-fd0ca0e9d709 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e06ee9a1445f44de85344809db1af230, user_id=a913dd3436f04c69b25a69f6d0b1784e, role_id=6ccaa8c11f29456fb4e4eeccb21616c7)` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:48:53.842337 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce880fd4-d4f1-4d8f-8272-fd0ca0e9d709 admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:48:53.867370 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 755/1493] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 30 00:48:53 2022] PUT /identity/v3/projects/e06ee9a1445f44de85344809db1af230/users/a913dd3436f04c69b25a69f6d0b1784e/roles/6ccaa8c11f29456fb4e4eeccb21616c7 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 00:48:53.871054 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fba76d-6edd-4d86-b29e-37ffff269e0f admin admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:48:53.889256 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce880fd4-d4f1-4d8f-8272-fd0ca0e9d709 admin admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:48:53.892488 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fba76d-6edd-4d86-b29e-37ffff269e0f admin admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:48:53.894367 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-ce880fd4-d4f1-4d8f-8272-fd0ca0e9d709 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:48:54.046694 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ef778a-5aa8-4195-8f00-530cb85aa07d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:48:54.052424 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ef778a-5aa8-4195-8f00-530cb85aa07d admin admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:48:54.052424 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ef778a-5aa8-4195-8f00-530cb85aa07d admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:48:54.052424 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ef778a-5aa8-4195-8f00-530cb85aa07d admin admin] PATH_INFO: `/v3/roles` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:48:54.052424 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ef778a-5aa8-4195-8f00-530cb85aa07d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:48:54.052424 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ef778a-5aa8-4195-8f00-530cb85aa07d admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:48:54.090329 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 739/1494] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 30 00:48:53 2022] GET /identity/v3/roles => generated 1420 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 00:48:54.090329 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ef778a-5aa8-4195-8f00-530cb85aa07d admin admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:48:54.093541 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce880fd4-d4f1-4d8f-8272-fd0ca0e9d709 admin admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:48:54.098060 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-c3ef778a-5aa8-4195-8f00-530cb85aa07d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:48:54.106494 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fc9bf0-7867-4177-9fbd-335be33bfd65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:48:54.107318 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fc9bf0-7867-4177-9fbd-335be33bfd65 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:48:54.107668 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fc9bf0-7867-4177-9fbd-335be33bfd65 admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:48:54.108056 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fc9bf0-7867-4177-9fbd-335be33bfd65 admin admin] PATH_INFO: `/v3/projects/001d0f86be04403ab185a7b7b2fc2410` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:48:54.112842 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fc9bf0-7867-4177-9fbd-335be33bfd65 admin admin] RBAC: Authorizing `identity:delete_project(project_id=001d0f86be04403ab185a7b7b2fc2410)` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:48:54.115625 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fc9bf0-7867-4177-9fbd-335be33bfd65 admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:48:54.137388 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ef778a-5aa8-4195-8f00-530cb85aa07d admin admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:48:54.146390 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a95a83f-2b44-4203-945a-1320fd16df37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:48:54.148246 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a95a83f-2b44-4203-945a-1320fd16df37 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:48:54.149192 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a95a83f-2b44-4203-945a-1320fd16df37 admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:48:54.149946 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a95a83f-2b44-4203-945a-1320fd16df37 admin admin] PATH_INFO: `/v3/users/8e1ccadf3c694a39ade0055179904158` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:48:54.154775 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a95a83f-2b44-4203-945a-1320fd16df37 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8e1ccadf3c694a39ade0055179904158)` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:48:54.160084 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a95a83f-2b44-4203-945a-1320fd16df37 admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:48:54.274690 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-d2fc9bf0-7867-4177-9fbd-335be33bfd65 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '001d0f86be04403ab185a7b7b2fc2410', 'request_id': 'req-d2fc9bf0-7867-4177-9fbd-335be33bfd65'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:48:54.295326 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-8a95a83f-2b44-4203-945a-1320fd16df37 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8e1ccadf3c694a39ade0055179904158'} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:48:54.297290 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-8a95a83f-2b44-4203-945a-1320fd16df37 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8e1ccadf3c694a39ade0055179904158'} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:48:54.306200 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-d2fc9bf0-7867-4177-9fbd-335be33bfd65 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '001d0f86be04403ab185a7b7b2fc2410', 'request_id': 'req-d2fc9bf0-7867-4177-9fbd-335be33bfd65'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:48:54.323015 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-8a95a83f-2b44-4203-945a-1320fd16df37 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8e1ccadf3c694a39ade0055179904158'} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:48:54.325395 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-8a95a83f-2b44-4203-945a-1320fd16df37 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8e1ccadf3c694a39ade0055179904158'} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:48:54.337350 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-d2fc9bf0-7867-4177-9fbd-335be33bfd65 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '001d0f86be04403ab185a7b7b2fc2410', 'request_id': 'req-d2fc9bf0-7867-4177-9fbd-335be33bfd65'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:48:54.371333 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-d2fc9bf0-7867-4177-9fbd-335be33bfd65 admin admin] The token cache is being invalidate because project 001d0f86be04403ab185a7b7b2fc2410 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87956) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 00:48:54.371885 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-d2fc9bf0-7867-4177-9fbd-335be33bfd65 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:48:54.373268 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-8a95a83f-2b44-4203-945a-1320fd16df37 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8e1ccadf3c694a39ade0055179904158'} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:48:54.373506 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-d2fc9bf0-7867-4177-9fbd-335be33bfd65 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:48:54.376595 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 756/1495] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 30 00:48:53 2022] DELETE /identity/v3/projects/001d0f86be04403ab185a7b7b2fc2410 => generated 0 bytes in 489 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 00:48:54.377600 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fc9bf0-7867-4177-9fbd-335be33bfd65 admin admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:48:54.379399 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-d2fc9bf0-7867-4177-9fbd-335be33bfd65 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:48:54.419115 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 740/1496] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 30 00:48:54 2022] DELETE /identity/v3/users/8e1ccadf3c694a39ade0055179904158 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 00:48:54.420674 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a95a83f-2b44-4203-945a-1320fd16df37 admin admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:48:54.428491 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-8a95a83f-2b44-4203-945a-1320fd16df37 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:48:54.463510 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:48:54.557945 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:48:54.620956 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a95a83f-2b44-4203-945a-1320fd16df37 admin admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:48:54.626318 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b48a03d-51a9-4fba-b01f-6d4085dcc0a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:48:54.626969 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b48a03d-51a9-4fba-b01f-6d4085dcc0a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:48:54.627293 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b48a03d-51a9-4fba-b01f-6d4085dcc0a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:48:54.627567 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b48a03d-51a9-4fba-b01f-6d4085dcc0a6 admin admin] PATH_INFO: `/v3/users/c8453468624c4302a55c9849086e242c` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:48:54.628708 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b48a03d-51a9-4fba-b01f-6d4085dcc0a6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c8453468624c4302a55c9849086e242c)` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:48:54.629677 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fc9bf0-7867-4177-9fbd-335be33bfd65 admin admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:48:54.630699 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b48a03d-51a9-4fba-b01f-6d4085dcc0a6 admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:48:54.654765 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27789bf7-b055-40b3-b525-82d9574babb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:48:54.655560 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27789bf7-b055-40b3-b525-82d9574babb7 admin admin] REQUEST_METHOD: `PUT` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:48:54.655848 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27789bf7-b055-40b3-b525-82d9574babb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:48:54.656198 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27789bf7-b055-40b3-b525-82d9574babb7 admin admin] PATH_INFO: `/v3/projects/e06ee9a1445f44de85344809db1af230/users/a913dd3436f04c69b25a69f6d0b1784e/roles/6ccaa8c11f29456fb4e4eeccb21616c7` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:48:54.662422 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27789bf7-b055-40b3-b525-82d9574babb7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e06ee9a1445f44de85344809db1af230, user_id=a913dd3436f04c69b25a69f6d0b1784e, role_id=6ccaa8c11f29456fb4e4eeccb21616c7)` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:48:54.665277 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27789bf7-b055-40b3-b525-82d9574babb7 admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:48:54.687048 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 757/1497] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 30 00:48:54 2022] PUT /identity/v3/projects/e06ee9a1445f44de85344809db1af230/users/a913dd3436f04c69b25a69f6d0b1784e/roles/6ccaa8c11f29456fb4e4eeccb21616c7 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 00:48:54.700007 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a87354-3777-4327-a29f-5c5407569f24 None None] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:48:54.700007 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a87354-3777-4327-a29f-5c5407569f24 None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:48:54.700308 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a87354-3777-4327-a29f-5c5407569f24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:48:54.738115 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.auth.core [None req-80a87354-3777-4327-a29f-5c5407569f24 None None] MFA Rules not processed for user `eb55b6cbca4945abb21b0e49eb745e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=87956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:48:54.739399 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-80a87354-3777-4327-a29f-5c5407569f24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:48:54.746654 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-0b48a03d-51a9-4fba-b01f-6d4085dcc0a6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c8453468624c4302a55c9849086e242c'} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:48:54.747636 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-0b48a03d-51a9-4fba-b01f-6d4085dcc0a6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c8453468624c4302a55c9849086e242c'} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:48:54.761411 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-0b48a03d-51a9-4fba-b01f-6d4085dcc0a6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c8453468624c4302a55c9849086e242c'} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:48:54.762533 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-0b48a03d-51a9-4fba-b01f-6d4085dcc0a6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c8453468624c4302a55c9849086e242c'} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:48:54.782051 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-0b48a03d-51a9-4fba-b01f-6d4085dcc0a6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c8453468624c4302a55c9849086e242c'} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:48:54.813144 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 741/1498] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 30 00:48:54 2022] DELETE /identity/v3/users/c8453468624c4302a55c9849086e242c => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 00:48:54.814326 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e902e22-259e-474a-bf3f-dc90dd4aca44 None None] REQUEST_METHOD: `POST` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:48:54.814608 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e902e22-259e-474a-bf3f-dc90dd4aca44 None None] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:48:54.814881 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e902e22-259e-474a-bf3f-dc90dd4aca44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:48:54.860003 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.auth.core [None req-2e902e22-259e-474a-bf3f-dc90dd4aca44 None None] MFA Rules not processed for user `a913dd3436f04c69b25a69f6d0b1784e`. Rule list: `[]` (Enabled: `True`). {{(pid=87955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:48:54.861586 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-2e902e22-259e-474a-bf3f-dc90dd4aca44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:48:54.874463 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 758/1499] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 30 00:48:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:48:54.918633 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a87354-3777-4327-a29f-5c5407569f24 None None] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:48:54.922218 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-80a87354-3777-4327-a29f-5c5407569f24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:48:55.017418 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 742/1500] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 30 00:48:54 2022] POST /identity/v3/auth/tokens => generated 3345 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:48:55.030509 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e902e22-259e-474a-bf3f-dc90dd4aca44 None None] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:48:55.032318 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-2e902e22-259e-474a-bf3f-dc90dd4aca44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:48:55.039542 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a87354-3777-4327-a29f-5c5407569f24 None None] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:48:55.059660 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:48:55.152730 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890b060d-95fc-4f6b-af31-d6a90bad8f1b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5693f186c6ad4d9394f02ee3477cdcd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d2387fdf794d4eaef07bbcd7b39f2a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:48:55.153366 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890b060d-95fc-4f6b-af31-d6a90bad8f1b service neutron] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:48:55.153644 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890b060d-95fc-4f6b-af31-d6a90bad8f1b service neutron] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:48:55.153915 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890b060d-95fc-4f6b-af31-d6a90bad8f1b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:48:55.155659 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e902e22-259e-474a-bf3f-dc90dd4aca44 None None] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:48:55.161885 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d22f63-f16a-4b00-876d-7b83fde05147 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48d928ff7fe24348ac900f09c56acc20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d2387fdf794d4eaef07bbcd7b39f2a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:48:55.164078 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d22f63-f16a-4b00-876d-7b83fde05147 service cinder] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:48:55.164368 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d22f63-f16a-4b00-876d-7b83fde05147 service cinder] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:48:55.164644 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d22f63-f16a-4b00-876d-7b83fde05147 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:48:55.183866 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d22f63-f16a-4b00-876d-7b83fde05147 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:48:55.185327 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d22f63-f16a-4b00-876d-7b83fde05147 service cinder] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:48:55.211240 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 743/1501] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 30 00:48:55 2022] GET /identity/v3/auth/tokens => generated 3345 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 30 00:48:55.241842 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:48:55.268137 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890b060d-95fc-4f6b-af31-d6a90bad8f1b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:48:55.269903 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890b060d-95fc-4f6b-af31-d6a90bad8f1b service neutron] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:48:55.286475 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 759/1502] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 30 00:48:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 30 00:48:55.529448 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d22f63-f16a-4b00-876d-7b83fde05147 service cinder] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:48:55.531678 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-57d22f63-f16a-4b00-876d-7b83fde05147 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:48:55.547383 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d22f63-f16a-4b00-876d-7b83fde05147 service cinder] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:48:55.552953 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4002871-5fe4-4bc3-8e64-68a2866d6f7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:48:55.554270 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4002871-5fe4-4bc3-8e64-68a2866d6f7c admin admin] REQUEST_METHOD: `DELETE` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:48:55.555253 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4002871-5fe4-4bc3-8e64-68a2866d6f7c admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:48:55.555253 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4002871-5fe4-4bc3-8e64-68a2866d6f7c admin admin] PATH_INFO: `/v3/users/44968b5c2b4e46319e36bf9b1ce23279` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:48:55.556475 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4002871-5fe4-4bc3-8e64-68a2866d6f7c admin admin] RBAC: Authorizing `identity:delete_user(user_id=44968b5c2b4e46319e36bf9b1ce23279)` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:48:55.558697 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4002871-5fe4-4bc3-8e64-68a2866d6f7c admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:48:55.628206 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-b4002871-5fe4-4bc3-8e64-68a2866d6f7c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '44968b5c2b4e46319e36bf9b1ce23279'} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:48:55.629462 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-b4002871-5fe4-4bc3-8e64-68a2866d6f7c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '44968b5c2b4e46319e36bf9b1ce23279'} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:48:55.640104 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-b4002871-5fe4-4bc3-8e64-68a2866d6f7c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '44968b5c2b4e46319e36bf9b1ce23279'} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:48:55.641051 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-b4002871-5fe4-4bc3-8e64-68a2866d6f7c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '44968b5c2b4e46319e36bf9b1ce23279'} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:48:55.660535 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-b4002871-5fe4-4bc3-8e64-68a2866d6f7c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '44968b5c2b4e46319e36bf9b1ce23279'} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:48:55.682099 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 744/1503] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 30 00:48:55 2022] DELETE /identity/v3/users/44968b5c2b4e46319e36bf9b1ce23279 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 00:48:55.684044 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8068ed01-8302-4b24-8f57-d6e26305660c None None] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:48:55.684511 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8068ed01-8302-4b24-8f57-d6e26305660c None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:48:55.684584 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8068ed01-8302-4b24-8f57-d6e26305660c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:48:55.712948 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.auth.core [None req-8068ed01-8302-4b24-8f57-d6e26305660c None None] MFA Rules not processed for user `eb55b6cbca4945abb21b0e49eb745e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=87956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:48:55.714190 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-8068ed01-8302-4b24-8f57-d6e26305660c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:48:55.835272 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 760/1504] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 30 00:48:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:48:55.847779 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4002871-5fe4-4bc3-8e64-68a2866d6f7c admin admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:48:55.851296 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-b4002871-5fe4-4bc3-8e64-68a2866d6f7c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:48:55.901247 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8068ed01-8302-4b24-8f57-d6e26305660c None None] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:48:55.911956 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-8068ed01-8302-4b24-8f57-d6e26305660c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:48:55.973709 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8068ed01-8302-4b24-8f57-d6e26305660c None None] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:48:55.984449 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4002871-5fe4-4bc3-8e64-68a2866d6f7c admin admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:48:55.985333 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632dc3cc-a121-4b85-85c2-568d1fb85309 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:48:55.986126 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632dc3cc-a121-4b85-85c2-568d1fb85309 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:48:55.986398 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632dc3cc-a121-4b85-85c2-568d1fb85309 admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:48:55.986670 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632dc3cc-a121-4b85-85c2-568d1fb85309 admin admin] PATH_INFO: `/v3/projects/674d0c9628e44ac6bd85a6991868b3f1` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:48:55.989726 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632dc3cc-a121-4b85-85c2-568d1fb85309 admin admin] RBAC: Authorizing `identity:delete_project(project_id=674d0c9628e44ac6bd85a6991868b3f1)` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:48:55.992433 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632dc3cc-a121-4b85-85c2-568d1fb85309 admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:48:55.995629 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc8c88c-7477-4e3d-a9e0-d09fad7586da service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5693f186c6ad4d9394f02ee3477cdcd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d2387fdf794d4eaef07bbcd7b39f2a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:48:55.996264 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc8c88c-7477-4e3d-a9e0-d09fad7586da service neutron] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:48:55.996542 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc8c88c-7477-4e3d-a9e0-d09fad7586da service neutron] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:48:55.996814 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc8c88c-7477-4e3d-a9e0-d09fad7586da service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:48:56.016208 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc8c88c-7477-4e3d-a9e0-d09fad7586da service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:48:56.017945 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc8c88c-7477-4e3d-a9e0-d09fad7586da service neutron] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:48:56.030109 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 745/1505] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 30 00:48:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 30 00:48:56.077611 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-632dc3cc-a121-4b85-85c2-568d1fb85309 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '674d0c9628e44ac6bd85a6991868b3f1', 'request_id': 'req-632dc3cc-a121-4b85-85c2-568d1fb85309'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:48:56.090785 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-632dc3cc-a121-4b85-85c2-568d1fb85309 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '674d0c9628e44ac6bd85a6991868b3f1', 'request_id': 'req-632dc3cc-a121-4b85-85c2-568d1fb85309'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:48:56.103304 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-632dc3cc-a121-4b85-85c2-568d1fb85309 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '674d0c9628e44ac6bd85a6991868b3f1', 'request_id': 'req-632dc3cc-a121-4b85-85c2-568d1fb85309'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:48:56.159908 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-632dc3cc-a121-4b85-85c2-568d1fb85309 admin admin] The token cache is being invalidate because project 674d0c9628e44ac6bd85a6991868b3f1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87956) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 00:48:56.165632 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-632dc3cc-a121-4b85-85c2-568d1fb85309 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:48:56.166494 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-632dc3cc-a121-4b85-85c2-568d1fb85309 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:48:56.170239 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 761/1506] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 30 00:48:55 2022] DELETE /identity/v3/projects/674d0c9628e44ac6bd85a6991868b3f1 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 00:48:56.176842 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87dbe02-115a-4a95-ab63-0cee7312ca94 None None] REQUEST_METHOD: `POST` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:48:56.177903 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87dbe02-115a-4a95-ab63-0cee7312ca94 None None] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:48:56.178689 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87dbe02-115a-4a95-ab63-0cee7312ca94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:48:56.211085 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.auth.core [None req-f87dbe02-115a-4a95-ab63-0cee7312ca94 None None] MFA Rules not processed for user `eb55b6cbca4945abb21b0e49eb745e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=87955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:48:56.212531 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-f87dbe02-115a-4a95-ab63-0cee7312ca94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:48:56.262420 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:48:56.315548 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 746/1507] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 30 00:48:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:48:56.324864 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f7d76f-6e83-42ca-8a4c-535c1b121c20 None None] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:48:56.325214 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f7d76f-6e83-42ca-8a4c-535c1b121c20 None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:48:56.325475 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f7d76f-6e83-42ca-8a4c-535c1b121c20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:48:56.348522 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.auth.core [None req-27f7d76f-6e83-42ca-8a4c-535c1b121c20 None None] MFA Rules not processed for user `eb55b6cbca4945abb21b0e49eb745e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=87956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:48:56.349926 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-27f7d76f-6e83-42ca-8a4c-535c1b121c20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:48:56.359903 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 762/1508] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 30 00:48:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:48:56.364379 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87dbe02-115a-4a95-ab63-0cee7312ca94 None None] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:48:56.375369 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87dbe02-115a-4a95-ab63-0cee7312ca94 None None] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:48:56.380608 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cf2b12-a6c3-46f5-a00a-44aa8dc43c0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:48:56.383010 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cf2b12-a6c3-46f5-a00a-44aa8dc43c0a admin admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:48:56.383321 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cf2b12-a6c3-46f5-a00a-44aa8dc43c0a admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:48:56.383587 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cf2b12-a6c3-46f5-a00a-44aa8dc43c0a admin admin] PATH_INFO: `/v3/domains` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:48:56.384317 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1cf2b12-a6c3-46f5-a00a-44aa8dc43c0a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:48:56.384552 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1cf2b12-a6c3-46f5-a00a-44aa8dc43c0a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:48:56.386172 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1cf2b12-a6c3-46f5-a00a-44aa8dc43c0a admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:48:56.400446 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 747/1509] 10.222.0.42 () {58 vars in 1153 bytes} [Sun Oct 30 00:48:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:48:56.404593 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f7d76f-6e83-42ca-8a4c-535c1b121c20 None None] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:48:56.414791 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f7d76f-6e83-42ca-8a4c-535c1b121c20 None None] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:48:56.422854 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f14b76-616f-481b-9bb6-f3708eb814d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:48:56.423995 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f14b76-616f-481b-9bb6-f3708eb814d0 admin admin] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:48:56.424276 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f14b76-616f-481b-9bb6-f3708eb814d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:48:56.424546 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f14b76-616f-481b-9bb6-f3708eb814d0 admin admin] PATH_INFO: `/v3/projects` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:48:56.425209 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f14b76-616f-481b-9bb6-f3708eb814d0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:48:56.427388 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f14b76-616f-481b-9bb6-f3708eb814d0 admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:48:56.484799 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 763/1510] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 30 00:48:56 2022] POST /identity/v3/projects => generated 367 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 00:48:56.485715 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cf2b12-a6c3-46f5-a00a-44aa8dc43c0a admin admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:48:56.502283 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cf2b12-a6c3-46f5-a00a-44aa8dc43c0a admin admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:48:56.534134 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f14b76-616f-481b-9bb6-f3708eb814d0 admin admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:48:56.536072 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-b7f14b76-616f-481b-9bb6-f3708eb814d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:48:56.620659 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:48:56.636986 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb310464-5ecd-4c8a-b483-653d8bed11cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:48:56.637622 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb310464-5ecd-4c8a-b483-653d8bed11cb admin admin] REQUEST_METHOD: `POST` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:48:56.637913 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb310464-5ecd-4c8a-b483-653d8bed11cb admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:48:56.638372 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb310464-5ecd-4c8a-b483-653d8bed11cb admin admin] PATH_INFO: `/v3/users` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:48:56.640374 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb310464-5ecd-4c8a-b483-653d8bed11cb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:48:56.644089 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb310464-5ecd-4c8a-b483-653d8bed11cb admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:48:56.656449 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f14b76-616f-481b-9bb6-f3708eb814d0 admin admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:48:56.662395 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18108b12-aabc-4da3-b2fe-63f8e496093a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:48:56.663108 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18108b12-aabc-4da3-b2fe-63f8e496093a admin admin] REQUEST_METHOD: `DELETE` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:48:56.663450 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18108b12-aabc-4da3-b2fe-63f8e496093a admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:48:56.663750 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18108b12-aabc-4da3-b2fe-63f8e496093a admin admin] PATH_INFO: `/v3/projects/85abc34ba1f14642bb6efe872c1e5631` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:48:56.675169 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 748/1511] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 30 00:48:56 2022] POST /identity/v3/users => generated 284 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 00:48:56.679078 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb310464-5ecd-4c8a-b483-653d8bed11cb admin admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:48:56.681143 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18108b12-aabc-4da3-b2fe-63f8e496093a admin admin] RBAC: Authorizing `identity:delete_project(project_id=85abc34ba1f14642bb6efe872c1e5631)` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:48:56.683813 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18108b12-aabc-4da3-b2fe-63f8e496093a admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:48:56.699595 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb310464-5ecd-4c8a-b483-653d8bed11cb admin admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:48:56.706973 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a6c6aa-6d27-43c5-8bc0-93da59e9a31d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:48:56.708276 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a6c6aa-6d27-43c5-8bc0-93da59e9a31d admin admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:48:56.708900 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a6c6aa-6d27-43c5-8bc0-93da59e9a31d admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:48:56.709325 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a6c6aa-6d27-43c5-8bc0-93da59e9a31d admin admin] PATH_INFO: `/v3/roles` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:48:56.710169 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a6c6aa-6d27-43c5-8bc0-93da59e9a31d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:48:56.712395 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a6c6aa-6d27-43c5-8bc0-93da59e9a31d admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:48:56.729873 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 749/1512] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 30 00:48:56 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 00:48:56.735965 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a6c6aa-6d27-43c5-8bc0-93da59e9a31d admin admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:48:56.749404 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-18108b12-aabc-4da3-b2fe-63f8e496093a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '85abc34ba1f14642bb6efe872c1e5631', 'request_id': 'req-18108b12-aabc-4da3-b2fe-63f8e496093a'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:48:56.753001 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a6c6aa-6d27-43c5-8bc0-93da59e9a31d admin admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:48:56.759797 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-18108b12-aabc-4da3-b2fe-63f8e496093a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '85abc34ba1f14642bb6efe872c1e5631', 'request_id': 'req-18108b12-aabc-4da3-b2fe-63f8e496093a'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:48:56.768851 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-18108b12-aabc-4da3-b2fe-63f8e496093a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '85abc34ba1f14642bb6efe872c1e5631', 'request_id': 'req-18108b12-aabc-4da3-b2fe-63f8e496093a'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:48:56.786837 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-18108b12-aabc-4da3-b2fe-63f8e496093a admin admin] The token cache is being invalidate because project 85abc34ba1f14642bb6efe872c1e5631 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87956) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 00:48:56.787229 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-18108b12-aabc-4da3-b2fe-63f8e496093a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:48:56.788278 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-18108b12-aabc-4da3-b2fe-63f8e496093a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:48:56.793992 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 764/1513] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 30 00:48:56 2022] DELETE /identity/v3/projects/85abc34ba1f14642bb6efe872c1e5631 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 00:48:56.795453 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18108b12-aabc-4da3-b2fe-63f8e496093a admin admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:48:56.800760 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-18108b12-aabc-4da3-b2fe-63f8e496093a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:48:56.875983 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7877dc-d0dd-47a0-9566-c9d8853aa970 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:48:56.876846 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7877dc-d0dd-47a0-9566-c9d8853aa970 admin admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:48:56.877254 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7877dc-d0dd-47a0-9566-c9d8853aa970 admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:48:56.878089 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7877dc-d0dd-47a0-9566-c9d8853aa970 admin admin] PATH_INFO: `/v3/roles` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:48:56.878396 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7877dc-d0dd-47a0-9566-c9d8853aa970 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:48:56.880152 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7877dc-d0dd-47a0-9566-c9d8853aa970 admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:48:56.889146 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18108b12-aabc-4da3-b2fe-63f8e496093a admin admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:48:56.897544 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 750/1514] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 30 00:48:56 2022] GET /identity/v3/roles => generated 1420 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 00:48:56.898404 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7877dc-d0dd-47a0-9566-c9d8853aa970 admin admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:48:56.900664 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bd2ac5-d484-407a-88a3-1ac0dfdeccc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:48:56.901528 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bd2ac5-d484-407a-88a3-1ac0dfdeccc3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:48:56.901900 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bd2ac5-d484-407a-88a3-1ac0dfdeccc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:48:56.902262 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bd2ac5-d484-407a-88a3-1ac0dfdeccc3 admin admin] PATH_INFO: `/v3/users/e5428571143446c4920ef8331e547f93` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:48:56.903692 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bd2ac5-d484-407a-88a3-1ac0dfdeccc3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e5428571143446c4920ef8331e547f93)` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:48:56.905893 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bd2ac5-d484-407a-88a3-1ac0dfdeccc3 admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:48:56.909894 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-4e7877dc-d0dd-47a0-9566-c9d8853aa970 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:48:56.937465 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7877dc-d0dd-47a0-9566-c9d8853aa970 admin admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:48:56.943594 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ae0c73-35ca-47f0-97e4-dacdfa4f3dc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:48:56.944364 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ae0c73-35ca-47f0-97e4-dacdfa4f3dc3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:48:56.944857 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ae0c73-35ca-47f0-97e4-dacdfa4f3dc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:48:56.947703 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ae0c73-35ca-47f0-97e4-dacdfa4f3dc3 admin admin] PATH_INFO: `/v3/projects/3e3e72d990f54416902d002db0e237cd` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:48:56.949396 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ae0c73-35ca-47f0-97e4-dacdfa4f3dc3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3e3e72d990f54416902d002db0e237cd)` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:48:56.952363 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ae0c73-35ca-47f0-97e4-dacdfa4f3dc3 admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:48:56.978189 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-d4bd2ac5-d484-407a-88a3-1ac0dfdeccc3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e5428571143446c4920ef8331e547f93'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:48:56.978848 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-d4bd2ac5-d484-407a-88a3-1ac0dfdeccc3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e5428571143446c4920ef8331e547f93'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:48:56.993509 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=95,keystone:INSERT=3,keystone:DELETE=2 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:48:56.993849 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-d4bd2ac5-d484-407a-88a3-1ac0dfdeccc3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e5428571143446c4920ef8331e547f93'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:48:56.996512 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:48:57.003895 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-d4bd2ac5-d484-407a-88a3-1ac0dfdeccc3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e5428571143446c4920ef8331e547f93'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:48:57.014165 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-d4bd2ac5-d484-407a-88a3-1ac0dfdeccc3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e5428571143446c4920ef8331e547f93'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:48:57.022899 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 765/1515] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 30 00:48:56 2022] DELETE /identity/v3/users/e5428571143446c4920ef8331e547f93 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 00:48:57.026781 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bd2ac5-d484-407a-88a3-1ac0dfdeccc3 admin admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:48:57.027958 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-d4bd2ac5-d484-407a-88a3-1ac0dfdeccc3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:48:57.046052 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-b4ae0c73-35ca-47f0-97e4-dacdfa4f3dc3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3e3e72d990f54416902d002db0e237cd', 'request_id': 'req-b4ae0c73-35ca-47f0-97e4-dacdfa4f3dc3'} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:48:57.072295 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-b4ae0c73-35ca-47f0-97e4-dacdfa4f3dc3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3e3e72d990f54416902d002db0e237cd', 'request_id': 'req-b4ae0c73-35ca-47f0-97e4-dacdfa4f3dc3'} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:48:57.085278 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-b4ae0c73-35ca-47f0-97e4-dacdfa4f3dc3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3e3e72d990f54416902d002db0e237cd', 'request_id': 'req-b4ae0c73-35ca-47f0-97e4-dacdfa4f3dc3'} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:48:57.109282 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-b4ae0c73-35ca-47f0-97e4-dacdfa4f3dc3 admin admin] The token cache is being invalidate because project 3e3e72d990f54416902d002db0e237cd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87955) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 00:48:57.110083 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-b4ae0c73-35ca-47f0-97e4-dacdfa4f3dc3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:48:57.110985 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-b4ae0c73-35ca-47f0-97e4-dacdfa4f3dc3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:48:57.113762 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 751/1516] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 30 00:48:56 2022] DELETE /identity/v3/projects/3e3e72d990f54416902d002db0e237cd => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 00:48:57.118950 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ae0c73-35ca-47f0-97e4-dacdfa4f3dc3 admin admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:48:57.120747 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-b4ae0c73-35ca-47f0-97e4-dacdfa4f3dc3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:48:57.155570 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bd2ac5-d484-407a-88a3-1ac0dfdeccc3 admin admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:48:57.162023 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29fcf90-ef64-4ef6-abfa-548d3d072706 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:48:57.163168 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29fcf90-ef64-4ef6-abfa-548d3d072706 admin admin] REQUEST_METHOD: `PUT` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:48:57.163830 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29fcf90-ef64-4ef6-abfa-548d3d072706 admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:48:57.164387 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29fcf90-ef64-4ef6-abfa-548d3d072706 admin admin] PATH_INFO: `/v3/projects/723bdd71d0d74bc18e333238fdca8706/users/6369a5851d304bdfad1d4f6d36b64612/roles/1c93019874174c4b91118d9ce2347e47` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:48:57.198124 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29fcf90-ef64-4ef6-abfa-548d3d072706 admin admin] RBAC: Authorizing `identity:create_grant(project_id=723bdd71d0d74bc18e333238fdca8706, user_id=6369a5851d304bdfad1d4f6d36b64612, role_id=1c93019874174c4b91118d9ce2347e47)` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:48:57.205268 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29fcf90-ef64-4ef6-abfa-548d3d072706 admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:48:57.228933 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 766/1517] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 30 00:48:57 2022] PUT /identity/v3/projects/723bdd71d0d74bc18e333238fdca8706/users/6369a5851d304bdfad1d4f6d36b64612/roles/1c93019874174c4b91118d9ce2347e47 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 00:48:57.241110 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f551da93-84d6-41fd-9b71-35c2abad5f0e None None] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:48:57.241489 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f551da93-84d6-41fd-9b71-35c2abad5f0e None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:48:57.241823 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f551da93-84d6-41fd-9b71-35c2abad5f0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:48:57.264368 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ae0c73-35ca-47f0-97e4-dacdfa4f3dc3 admin admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:48:57.281180 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.auth.core [None req-f551da93-84d6-41fd-9b71-35c2abad5f0e None None] MFA Rules not processed for user `6369a5851d304bdfad1d4f6d36b64612`. Rule list: `[]` (Enabled: `True`). {{(pid=87956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:48:57.282886 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-f551da93-84d6-41fd-9b71-35c2abad5f0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:48:57.354071 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c875bfdc-d76d-4e6f-b5b2-7c026da283ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:48:57.354721 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c875bfdc-d76d-4e6f-b5b2-7c026da283ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:48:57.354994 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c875bfdc-d76d-4e6f-b5b2-7c026da283ce admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:48:57.355399 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c875bfdc-d76d-4e6f-b5b2-7c026da283ce admin admin] PATH_INFO: `/v3/users/a913dd3436f04c69b25a69f6d0b1784e` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:48:57.356649 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c875bfdc-d76d-4e6f-b5b2-7c026da283ce admin admin] RBAC: Authorizing `identity:delete_user(user_id=a913dd3436f04c69b25a69f6d0b1784e)` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:48:57.358896 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c875bfdc-d76d-4e6f-b5b2-7c026da283ce admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:48:57.368519 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 767/1518] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 30 00:48:57 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:48:57.369841 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f551da93-84d6-41fd-9b71-35c2abad5f0e None None] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:48:57.375290 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-f551da93-84d6-41fd-9b71-35c2abad5f0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:48:57.410005 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f551da93-84d6-41fd-9b71-35c2abad5f0e None None] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:48:57.432500 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c3a4eb-a287-46bd-995a-3564242b943b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:48:57.433160 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c3a4eb-a287-46bd-995a-3564242b943b admin admin] REQUEST_METHOD: `DELETE` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:48:57.433436 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c3a4eb-a287-46bd-995a-3564242b943b admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:48:57.433710 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c3a4eb-a287-46bd-995a-3564242b943b admin admin] PATH_INFO: `/v3/users/bd5993cccf7d4b8d83d6b15595da7f46` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:48:57.435020 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c3a4eb-a287-46bd-995a-3564242b943b admin admin] RBAC: Authorizing `identity:delete_user(user_id=bd5993cccf7d4b8d83d6b15595da7f46)` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:48:57.437447 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c3a4eb-a287-46bd-995a-3564242b943b admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:48:57.442559 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-c875bfdc-d76d-4e6f-b5b2-7c026da283ce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a913dd3436f04c69b25a69f6d0b1784e'} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:48:57.443446 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-c875bfdc-d76d-4e6f-b5b2-7c026da283ce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a913dd3436f04c69b25a69f6d0b1784e'} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:48:57.455369 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-c875bfdc-d76d-4e6f-b5b2-7c026da283ce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a913dd3436f04c69b25a69f6d0b1784e'} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:48:57.456446 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-c875bfdc-d76d-4e6f-b5b2-7c026da283ce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a913dd3436f04c69b25a69f6d0b1784e'} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:48:57.471148 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:48:57.482537 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-c875bfdc-d76d-4e6f-b5b2-7c026da283ce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a913dd3436f04c69b25a69f6d0b1784e'} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:48:57.500452 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 752/1519] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 30 00:48:57 2022] DELETE /identity/v3/users/a913dd3436f04c69b25a69f6d0b1784e => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 00:48:57.501507 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c875bfdc-d76d-4e6f-b5b2-7c026da283ce admin admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:48:57.511452 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-c875bfdc-d76d-4e6f-b5b2-7c026da283ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:48:57.528632 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-10c3a4eb-a287-46bd-995a-3564242b943b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bd5993cccf7d4b8d83d6b15595da7f46'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:48:57.529339 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-10c3a4eb-a287-46bd-995a-3564242b943b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bd5993cccf7d4b8d83d6b15595da7f46'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:48:57.536122 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:48:57.547789 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-10c3a4eb-a287-46bd-995a-3564242b943b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bd5993cccf7d4b8d83d6b15595da7f46'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:48:57.558194 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-10c3a4eb-a287-46bd-995a-3564242b943b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bd5993cccf7d4b8d83d6b15595da7f46'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:48:57.576223 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-10c3a4eb-a287-46bd-995a-3564242b943b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bd5993cccf7d4b8d83d6b15595da7f46'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:48:57.590224 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 768/1520] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 30 00:48:57 2022] DELETE /identity/v3/users/bd5993cccf7d4b8d83d6b15595da7f46 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 00:48:57.591384 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c3a4eb-a287-46bd-995a-3564242b943b admin admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:48:57.593702 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-10c3a4eb-a287-46bd-995a-3564242b943b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:48:57.671091 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c875bfdc-d76d-4e6f-b5b2-7c026da283ce admin admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:48:57.712196 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c3a4eb-a287-46bd-995a-3564242b943b admin admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:48:57.720569 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b51c91-c85f-4301-9e9c-1c26e6de30a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:48:57.721504 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b51c91-c85f-4301-9e9c-1c26e6de30a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:48:57.721950 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b51c91-c85f-4301-9e9c-1c26e6de30a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:48:57.722283 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b51c91-c85f-4301-9e9c-1c26e6de30a4 admin admin] PATH_INFO: `/v3/projects/71c4945f1bb047108f2b7451d4b97c0c` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:48:57.723545 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b51c91-c85f-4301-9e9c-1c26e6de30a4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=71c4945f1bb047108f2b7451d4b97c0c)` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:48:57.725551 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b51c91-c85f-4301-9e9c-1c26e6de30a4 admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:48:57.786395 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5481c8-9d49-4acf-a156-303ceb589b2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:48:57.787474 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5481c8-9d49-4acf-a156-303ceb589b2e admin admin] REQUEST_METHOD: `POST` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:48:57.787947 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5481c8-9d49-4acf-a156-303ceb589b2e admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:48:57.788599 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5481c8-9d49-4acf-a156-303ceb589b2e admin admin] PATH_INFO: `/v3/projects` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:48:57.789846 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5481c8-9d49-4acf-a156-303ceb589b2e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:48:57.792673 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5481c8-9d49-4acf-a156-303ceb589b2e admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:48:57.793811 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-95b51c91-c85f-4301-9e9c-1c26e6de30a4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '71c4945f1bb047108f2b7451d4b97c0c', 'request_id': 'req-95b51c91-c85f-4301-9e9c-1c26e6de30a4'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:48:57.807598 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-95b51c91-c85f-4301-9e9c-1c26e6de30a4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '71c4945f1bb047108f2b7451d4b97c0c', 'request_id': 'req-95b51c91-c85f-4301-9e9c-1c26e6de30a4'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:48:57.817288 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-95b51c91-c85f-4301-9e9c-1c26e6de30a4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '71c4945f1bb047108f2b7451d4b97c0c', 'request_id': 'req-95b51c91-c85f-4301-9e9c-1c26e6de30a4'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:48:57.831228 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 753/1521] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 30 00:48:57 2022] POST /identity/v3/projects => generated 369 bytes in 330 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 00:48:57.832945 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f96212-d76c-45f4-906e-b5a6d8cc5958 None None] REQUEST_METHOD: `POST` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:48:57.833237 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f96212-d76c-45f4-906e-b5a6d8cc5958 None None] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:48:57.833480 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f96212-d76c-45f4-906e-b5a6d8cc5958 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:48:57.835928 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-95b51c91-c85f-4301-9e9c-1c26e6de30a4 admin admin] The token cache is being invalidate because project 71c4945f1bb047108f2b7451d4b97c0c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87956) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 00:48:57.837371 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-95b51c91-c85f-4301-9e9c-1c26e6de30a4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:48:57.838311 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-95b51c91-c85f-4301-9e9c-1c26e6de30a4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:48:57.840878 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 769/1522] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 30 00:48:57 2022] DELETE /identity/v3/projects/71c4945f1bb047108f2b7451d4b97c0c => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 00:48:57.844679 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b51c91-c85f-4301-9e9c-1c26e6de30a4 admin admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:48:57.852146 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-95b51c91-c85f-4301-9e9c-1c26e6de30a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:48:57.857316 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.auth.core [None req-18f96212-d76c-45f4-906e-b5a6d8cc5958 None None] MFA Rules not processed for user `eb55b6cbca4945abb21b0e49eb745e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=87955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:48:57.859397 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-18f96212-d76c-45f4-906e-b5a6d8cc5958 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:48:57.946200 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 754/1523] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 30 00:48:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:48:57.948020 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820731bb-3891-492b-9bbe-e564ecaa796e None None] REQUEST_METHOD: `POST` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:48:57.948402 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820731bb-3891-492b-9bbe-e564ecaa796e None None] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:48:57.948849 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820731bb-3891-492b-9bbe-e564ecaa796e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:48:57.954835 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b51c91-c85f-4301-9e9c-1c26e6de30a4 admin admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:48:57.959832 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc291f2-b02e-485e-b0db-4324e8ff6304 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:48:57.960571 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc291f2-b02e-485e-b0db-4324e8ff6304 admin admin] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:48:57.963053 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc291f2-b02e-485e-b0db-4324e8ff6304 admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:48:57.963053 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc291f2-b02e-485e-b0db-4324e8ff6304 admin admin] PATH_INFO: `/v3/users` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:48:57.963053 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc291f2-b02e-485e-b0db-4324e8ff6304 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:48:57.964701 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc291f2-b02e-485e-b0db-4324e8ff6304 admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:48:57.975339 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:DELETE=10,keystone:SELECT=88,keystone:INSERT=2 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:48:57.977796 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.auth.core [None req-820731bb-3891-492b-9bbe-e564ecaa796e None None] MFA Rules not processed for user `eb55b6cbca4945abb21b0e49eb745e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=87955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:48:57.979634 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-820731bb-3891-492b-9bbe-e564ecaa796e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:48:57.992936 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 755/1524] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 30 00:48:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:48:58.001187 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 770/1525] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 30 00:48:57 2022] POST /identity/v3/users => generated 291 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 00:48:58.001826 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ad6566-4edc-4602-bf78-9a45229c39c7 None None] REQUEST_METHOD: `POST` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:48:58.002083 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc291f2-b02e-485e-b0db-4324e8ff6304 admin admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:48:58.002367 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ad6566-4edc-4602-bf78-9a45229c39c7 None None] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:48:58.002732 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ad6566-4edc-4602-bf78-9a45229c39c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:48:58.017157 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc291f2-b02e-485e-b0db-4324e8ff6304 admin admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:48:58.023842 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0264139b-076a-4e9f-b20f-031dab59e0ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:48:58.024461 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0264139b-076a-4e9f-b20f-031dab59e0ba admin admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:48:58.024799 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0264139b-076a-4e9f-b20f-031dab59e0ba admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:48:58.025073 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0264139b-076a-4e9f-b20f-031dab59e0ba admin admin] PATH_INFO: `/v3/roles` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:48:58.025722 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0264139b-076a-4e9f-b20f-031dab59e0ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:48:58.027424 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0264139b-076a-4e9f-b20f-031dab59e0ba admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:48:58.028592 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.auth.core [None req-47ad6566-4edc-4602-bf78-9a45229c39c7 None None] MFA Rules not processed for user `eb55b6cbca4945abb21b0e49eb745e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=87955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:48:58.030499 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-47ad6566-4edc-4602-bf78-9a45229c39c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:48:58.046163 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 756/1526] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 30 00:48:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 30 00:48:58.048358 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ad6566-4edc-4602-bf78-9a45229c39c7 None None] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:48:58.056757 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-47ad6566-4edc-4602-bf78-9a45229c39c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:48:58.063475 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 771/1527] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 30 00:48:58 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 00:48:58.064536 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0264139b-076a-4e9f-b20f-031dab59e0ba admin admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:48:58.070432 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=96,keystone:DELETE=2,keystone:INSERT=2 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:48:58.094299 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0264139b-076a-4e9f-b20f-031dab59e0ba admin admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:48:58.107178 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f057f0e1-94ba-4dc3-a90c-4337c4d0cc25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:48:58.108362 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f057f0e1-94ba-4dc3-a90c-4337c4d0cc25 admin admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:48:58.108729 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f057f0e1-94ba-4dc3-a90c-4337c4d0cc25 admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:48:58.109861 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f057f0e1-94ba-4dc3-a90c-4337c4d0cc25 admin admin] PATH_INFO: `/v3/domains` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:48:58.110759 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f057f0e1-94ba-4dc3-a90c-4337c4d0cc25 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87956) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:48:58.111165 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f057f0e1-94ba-4dc3-a90c-4337c4d0cc25 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:48:58.113153 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f057f0e1-94ba-4dc3-a90c-4337c4d0cc25 admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:48:58.131670 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 772/1528] 10.222.0.42 () {58 vars in 1153 bytes} [Sun Oct 30 00:48:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:48:58.133581 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f057f0e1-94ba-4dc3-a90c-4337c4d0cc25 admin admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:48:58.163284 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f057f0e1-94ba-4dc3-a90c-4337c4d0cc25 admin admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:48:58.188309 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6677c673-071d-46bf-bb55-a9260b00a7f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:48:58.190576 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6677c673-071d-46bf-bb55-a9260b00a7f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:48:58.191513 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6677c673-071d-46bf-bb55-a9260b00a7f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:48:58.193832 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6677c673-071d-46bf-bb55-a9260b00a7f0 admin admin] PATH_INFO: `/v3/projects/220fa9ac94e94c77b6d09bb8dc401eca/users/53ba56431a0940b3b7e5b9835653d377/roles/6ccaa8c11f29456fb4e4eeccb21616c7` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:48:58.220815 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ad6566-4edc-4602-bf78-9a45229c39c7 None None] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:48:58.226848 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea86b31f-dc40-43cf-8295-de48b3fe2db4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5693f186c6ad4d9394f02ee3477cdcd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d2387fdf794d4eaef07bbcd7b39f2a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:48:58.227410 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6677c673-071d-46bf-bb55-a9260b00a7f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=220fa9ac94e94c77b6d09bb8dc401eca, user_id=53ba56431a0940b3b7e5b9835653d377, role_id=6ccaa8c11f29456fb4e4eeccb21616c7)` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:48:58.228071 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea86b31f-dc40-43cf-8295-de48b3fe2db4 service neutron] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:48:58.228387 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea86b31f-dc40-43cf-8295-de48b3fe2db4 service neutron] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:48:58.228602 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea86b31f-dc40-43cf-8295-de48b3fe2db4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:48:58.232097 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6677c673-071d-46bf-bb55-a9260b00a7f0 admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:48:58.243870 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea86b31f-dc40-43cf-8295-de48b3fe2db4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:48:58.249032 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea86b31f-dc40-43cf-8295-de48b3fe2db4 service neutron] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:48:58.256879 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 773/1529] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 30 00:48:58 2022] PUT /identity/v3/projects/220fa9ac94e94c77b6d09bb8dc401eca/users/53ba56431a0940b3b7e5b9835653d377/roles/6ccaa8c11f29456fb4e4eeccb21616c7 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 00:48:58.258083 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6677c673-071d-46bf-bb55-a9260b00a7f0 admin admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:48:58.271297 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 757/1530] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 30 00:48:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 00:48:58.272197 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea86b31f-dc40-43cf-8295-de48b3fe2db4 service neutron] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:48:58.294925 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea86b31f-dc40-43cf-8295-de48b3fe2db4 service neutron] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:48:58.375521 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6677c673-071d-46bf-bb55-a9260b00a7f0 admin admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:48:58.383068 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d313fb5e-6b01-4171-91a5-30da9823e5fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:48:58.383796 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d313fb5e-6b01-4171-91a5-30da9823e5fa admin admin] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:48:58.384523 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d313fb5e-6b01-4171-91a5-30da9823e5fa admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:48:58.385169 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d313fb5e-6b01-4171-91a5-30da9823e5fa admin admin] PATH_INFO: `/v3/projects` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:48:58.386635 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d313fb5e-6b01-4171-91a5-30da9823e5fa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:48:58.389252 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d313fb5e-6b01-4171-91a5-30da9823e5fa admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:48:58.402659 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b20f58-a1b1-4b8e-928e-05e5fa454d2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:48:58.404309 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b20f58-a1b1-4b8e-928e-05e5fa454d2c admin admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:48:58.404730 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b20f58-a1b1-4b8e-928e-05e5fa454d2c admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:48:58.405516 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b20f58-a1b1-4b8e-928e-05e5fa454d2c admin admin] PATH_INFO: `/v3/roles` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:48:58.406715 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b20f58-a1b1-4b8e-928e-05e5fa454d2c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:48:58.409455 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b20f58-a1b1-4b8e-928e-05e5fa454d2c admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:48:58.426297 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 758/1531] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 30 00:48:58 2022] GET /identity/v3/roles => generated 1420 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 00:48:58.431235 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b20f58-a1b1-4b8e-928e-05e5fa454d2c admin admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:48:58.441671 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 774/1532] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 30 00:48:58 2022] POST /identity/v3/projects => generated 379 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 00:48:58.459238 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b20f58-a1b1-4b8e-928e-05e5fa454d2c admin admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:48:58.460903 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d313fb5e-6b01-4171-91a5-30da9823e5fa admin admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:48:58.579821 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8330283d-2803-4272-819d-f28347347304 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:48:58.580937 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8330283d-2803-4272-819d-f28347347304 admin admin] REQUEST_METHOD: `PUT` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:48:58.581815 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8330283d-2803-4272-819d-f28347347304 admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:48:58.582298 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8330283d-2803-4272-819d-f28347347304 admin admin] PATH_INFO: `/v3/projects/220fa9ac94e94c77b6d09bb8dc401eca/users/53ba56431a0940b3b7e5b9835653d377/roles/6ccaa8c11f29456fb4e4eeccb21616c7` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:48:58.591618 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d313fb5e-6b01-4171-91a5-30da9823e5fa admin admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:48:58.595017 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8330283d-2803-4272-819d-f28347347304 admin admin] RBAC: Authorizing `identity:create_grant(project_id=220fa9ac94e94c77b6d09bb8dc401eca, user_id=53ba56431a0940b3b7e5b9835653d377, role_id=6ccaa8c11f29456fb4e4eeccb21616c7)` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:48:58.600000 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8330283d-2803-4272-819d-f28347347304 admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:48:58.605947 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0735c1ba-7c23-4c52-a3bd-95d1165b4ee5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:48:58.606513 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0735c1ba-7c23-4c52-a3bd-95d1165b4ee5 admin admin] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:48:58.606923 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0735c1ba-7c23-4c52-a3bd-95d1165b4ee5 admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:48:58.607149 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0735c1ba-7c23-4c52-a3bd-95d1165b4ee5 admin admin] PATH_INFO: `/v3/users` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:48:58.608295 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0735c1ba-7c23-4c52-a3bd-95d1165b4ee5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:48:58.610835 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0735c1ba-7c23-4c52-a3bd-95d1165b4ee5 admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:48:58.648528 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 759/1533] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 30 00:48:58 2022] PUT /identity/v3/projects/220fa9ac94e94c77b6d09bb8dc401eca/users/53ba56431a0940b3b7e5b9835653d377/roles/6ccaa8c11f29456fb4e4eeccb21616c7 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 00:48:58.651280 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8330283d-2803-4272-819d-f28347347304 admin admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:48:58.661727 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-8330283d-2803-4272-819d-f28347347304 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:48:58.666375 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 775/1534] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 30 00:48:58 2022] POST /identity/v3/users => generated 290 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 30 00:48:58.670062 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a05379-dbaa-4204-9988-ca482f1dc47c None None] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:48:58.670356 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a05379-dbaa-4204-9988-ca482f1dc47c None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:48:58.670631 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a05379-dbaa-4204-9988-ca482f1dc47c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:48:58.724008 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.auth.core [None req-b8a05379-dbaa-4204-9988-ca482f1dc47c None None] MFA Rules not processed for user `53ba56431a0940b3b7e5b9835653d377`. Rule list: `[]` (Enabled: `True`). {{(pid=87956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:48:58.725453 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-b8a05379-dbaa-4204-9988-ca482f1dc47c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:48:58.730033 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:INSERT=8,keystone:SELECT=92 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:48:58.742083 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:48:58.782838 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8330283d-2803-4272-819d-f28347347304 admin admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:48:58.789451 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f600f0a9-974d-4fac-b0f3-e71e857011a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:48:58.790535 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f600f0a9-974d-4fac-b0f3-e71e857011a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:48:58.791173 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f600f0a9-974d-4fac-b0f3-e71e857011a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:48:58.791610 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f600f0a9-974d-4fac-b0f3-e71e857011a5 admin admin] PATH_INFO: `/v3/projects/e06ee9a1445f44de85344809db1af230` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:48:58.793076 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f600f0a9-974d-4fac-b0f3-e71e857011a5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e06ee9a1445f44de85344809db1af230)` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:48:58.795154 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f600f0a9-974d-4fac-b0f3-e71e857011a5 admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:48:58.811495 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 776/1535] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 30 00:48:58 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:48:58.812361 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a05379-dbaa-4204-9988-ca482f1dc47c None None] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:48:58.828365 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a05379-dbaa-4204-9988-ca482f1dc47c None None] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:48:58.833730 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc47f0b1-2d74-4d10-99fb-bc9e39463669 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:48:58.834403 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc47f0b1-2d74-4d10-99fb-bc9e39463669 admin admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:48:58.834742 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc47f0b1-2d74-4d10-99fb-bc9e39463669 admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:48:58.835016 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc47f0b1-2d74-4d10-99fb-bc9e39463669 admin admin] PATH_INFO: `/v3/roles` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:48:58.835855 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc47f0b1-2d74-4d10-99fb-bc9e39463669 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:48:58.837607 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc47f0b1-2d74-4d10-99fb-bc9e39463669 admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:48:58.849664 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 777/1536] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 30 00:48:58 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 00:48:58.850585 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc47f0b1-2d74-4d10-99fb-bc9e39463669 admin admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:48:58.851974 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-f600f0a9-974d-4fac-b0f3-e71e857011a5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e06ee9a1445f44de85344809db1af230', 'request_id': 'req-f600f0a9-974d-4fac-b0f3-e71e857011a5'} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:48:58.853437 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-fc47f0b1-2d74-4d10-99fb-bc9e39463669 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:48:58.859640 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-f600f0a9-974d-4fac-b0f3-e71e857011a5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e06ee9a1445f44de85344809db1af230', 'request_id': 'req-f600f0a9-974d-4fac-b0f3-e71e857011a5'} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:48:58.867047 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc47f0b1-2d74-4d10-99fb-bc9e39463669 admin admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:48:58.868737 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-f600f0a9-974d-4fac-b0f3-e71e857011a5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e06ee9a1445f44de85344809db1af230', 'request_id': 'req-f600f0a9-974d-4fac-b0f3-e71e857011a5'} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:48:58.881410 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-f600f0a9-974d-4fac-b0f3-e71e857011a5 admin admin] The token cache is being invalidate because project e06ee9a1445f44de85344809db1af230 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87955) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 00:48:58.881781 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-f600f0a9-974d-4fac-b0f3-e71e857011a5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:48:58.882657 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-f600f0a9-974d-4fac-b0f3-e71e857011a5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:48:58.884475 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 760/1537] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 30 00:48:58 2022] DELETE /identity/v3/projects/e06ee9a1445f44de85344809db1af230 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 00:48:58.885104 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f600f0a9-974d-4fac-b0f3-e71e857011a5 admin admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:48:58.886483 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-f600f0a9-974d-4fac-b0f3-e71e857011a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:48:58.932514 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800bafaf-b9a6-4b89-806c-92c194370cb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:48:58.933565 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800bafaf-b9a6-4b89-806c-92c194370cb1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:48:58.933565 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800bafaf-b9a6-4b89-806c-92c194370cb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:48:58.934032 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800bafaf-b9a6-4b89-806c-92c194370cb1 admin admin] PATH_INFO: `/v3/projects/70415c9a474547ebad7bc3e7de6d3c47` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:48:58.935380 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800bafaf-b9a6-4b89-806c-92c194370cb1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=70415c9a474547ebad7bc3e7de6d3c47)` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:48:58.937453 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800bafaf-b9a6-4b89-806c-92c194370cb1 admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:48:58.950869 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f600f0a9-974d-4fac-b0f3-e71e857011a5 admin admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:48:58.956519 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a66622a-c371-4a10-9ff2-57c4bd1b5b4c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48d928ff7fe24348ac900f09c56acc20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d2387fdf794d4eaef07bbcd7b39f2a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:48:58.957677 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a66622a-c371-4a10-9ff2-57c4bd1b5b4c service cinder] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:48:58.958018 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a66622a-c371-4a10-9ff2-57c4bd1b5b4c service cinder] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:48:58.958379 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a66622a-c371-4a10-9ff2-57c4bd1b5b4c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:48:58.961350 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-5a66622a-c371-4a10-9ff2-57c4bd1b5b4c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:48:58.992342 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-800bafaf-b9a6-4b89-806c-92c194370cb1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '70415c9a474547ebad7bc3e7de6d3c47', 'request_id': 'req-800bafaf-b9a6-4b89-806c-92c194370cb1'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:48:59.001978 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-800bafaf-b9a6-4b89-806c-92c194370cb1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '70415c9a474547ebad7bc3e7de6d3c47', 'request_id': 'req-800bafaf-b9a6-4b89-806c-92c194370cb1'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:48:59.010467 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-800bafaf-b9a6-4b89-806c-92c194370cb1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '70415c9a474547ebad7bc3e7de6d3c47', 'request_id': 'req-800bafaf-b9a6-4b89-806c-92c194370cb1'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:48:59.023920 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-800bafaf-b9a6-4b89-806c-92c194370cb1 admin admin] The token cache is being invalidate because project 70415c9a474547ebad7bc3e7de6d3c47 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87956) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 00:48:59.024279 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-800bafaf-b9a6-4b89-806c-92c194370cb1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:48:59.025605 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-800bafaf-b9a6-4b89-806c-92c194370cb1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:48:59.028120 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 778/1538] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 30 00:48:58 2022] DELETE /identity/v3/projects/70415c9a474547ebad7bc3e7de6d3c47 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 00:48:59.031472 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800bafaf-b9a6-4b89-806c-92c194370cb1 admin admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:48:59.032578 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-800bafaf-b9a6-4b89-806c-92c194370cb1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:48:59.033897 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a66622a-c371-4a10-9ff2-57c4bd1b5b4c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:48:59.035426 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a66622a-c371-4a10-9ff2-57c4bd1b5b4c service cinder] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:48:59.045644 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 761/1539] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 30 00:48:58 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 00:48:59.046994 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d00bc39-09e7-472f-b022-44acfb4dd39e None None] REQUEST_METHOD: `POST` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:48:59.047342 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d00bc39-09e7-472f-b022-44acfb4dd39e None None] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:48:59.047615 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d00bc39-09e7-472f-b022-44acfb4dd39e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:48:59.064425 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:48:59.072213 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.auth.core [None req-2d00bc39-09e7-472f-b022-44acfb4dd39e None None] MFA Rules not processed for user `eb55b6cbca4945abb21b0e49eb745e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=87955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:48:59.074440 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-2d00bc39-09e7-472f-b022-44acfb4dd39e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:48:59.104409 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:48:59.149847 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800bafaf-b9a6-4b89-806c-92c194370cb1 admin admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:48:59.155272 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef558d63-3c82-413e-9e7b-5965d3b98aec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:48:59.156008 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef558d63-3c82-413e-9e7b-5965d3b98aec admin admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:48:59.156410 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef558d63-3c82-413e-9e7b-5965d3b98aec admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:48:59.156770 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef558d63-3c82-413e-9e7b-5965d3b98aec admin admin] PATH_INFO: `/v3/roles` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:48:59.157877 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef558d63-3c82-413e-9e7b-5965d3b98aec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:48:59.159763 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef558d63-3c82-413e-9e7b-5965d3b98aec admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:48:59.177985 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 779/1540] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 30 00:48:59 2022] GET /identity/v3/roles => generated 1420 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 00:48:59.178695 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef558d63-3c82-413e-9e7b-5965d3b98aec admin admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:48:59.197682 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-ef558d63-3c82-413e-9e7b-5965d3b98aec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:48:59.250295 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 762/1541] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 30 00:48:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:48:59.253819 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef558d63-3c82-413e-9e7b-5965d3b98aec admin admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:48:59.257968 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d00bc39-09e7-472f-b022-44acfb4dd39e None None] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:48:59.268678 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3aba04-42b8-4fb2-8016-f50c1bf75308 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:48:59.271453 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3aba04-42b8-4fb2-8016-f50c1bf75308 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:48:59.272312 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3aba04-42b8-4fb2-8016-f50c1bf75308 admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:48:59.274468 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3aba04-42b8-4fb2-8016-f50c1bf75308 admin admin] PATH_INFO: `/v3/users/2d7fa7b969e346b6a379371c37cb9eeb` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:48:59.277856 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3aba04-42b8-4fb2-8016-f50c1bf75308 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2d7fa7b969e346b6a379371c37cb9eeb)` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:48:59.283545 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3aba04-42b8-4fb2-8016-f50c1bf75308 admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:48:59.286454 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d00bc39-09e7-472f-b022-44acfb4dd39e None None] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:48:59.298481 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700e7735-fbba-4846-82d5-7c6012bab011 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:48:59.299172 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700e7735-fbba-4846-82d5-7c6012bab011 admin admin] REQUEST_METHOD: `PUT` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:48:59.302606 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700e7735-fbba-4846-82d5-7c6012bab011 admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:48:59.302913 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700e7735-fbba-4846-82d5-7c6012bab011 admin admin] PATH_INFO: `/v3/projects/4118dae625164319bf92c75a1415df8e/users/68945b4022224eee92001c024ba4f865/roles/1c93019874174c4b91118d9ce2347e47` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:48:59.344083 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700e7735-fbba-4846-82d5-7c6012bab011 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4118dae625164319bf92c75a1415df8e, user_id=68945b4022224eee92001c024ba4f865, role_id=1c93019874174c4b91118d9ce2347e47)` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:48:59.355830 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700e7735-fbba-4846-82d5-7c6012bab011 admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:48:59.378590 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-9e3aba04-42b8-4fb2-8016-f50c1bf75308 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2d7fa7b969e346b6a379371c37cb9eeb'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:48:59.379825 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-9e3aba04-42b8-4fb2-8016-f50c1bf75308 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2d7fa7b969e346b6a379371c37cb9eeb'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:48:59.395768 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-9e3aba04-42b8-4fb2-8016-f50c1bf75308 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2d7fa7b969e346b6a379371c37cb9eeb'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:48:59.396490 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 763/1542] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 30 00:48:59 2022] PUT /identity/v3/projects/4118dae625164319bf92c75a1415df8e/users/68945b4022224eee92001c024ba4f865/roles/1c93019874174c4b91118d9ce2347e47 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 00:48:59.398011 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06650b0a-841c-430a-a292-5d01f2a1df7d None None] REQUEST_METHOD: `POST` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:48:59.398296 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06650b0a-841c-430a-a292-5d01f2a1df7d None None] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:48:59.398571 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06650b0a-841c-430a-a292-5d01f2a1df7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:48:59.407685 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-9e3aba04-42b8-4fb2-8016-f50c1bf75308 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2d7fa7b969e346b6a379371c37cb9eeb'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:48:59.437822 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-9e3aba04-42b8-4fb2-8016-f50c1bf75308 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2d7fa7b969e346b6a379371c37cb9eeb'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:48:59.445209 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 780/1543] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 30 00:48:59 2022] DELETE /identity/v3/users/2d7fa7b969e346b6a379371c37cb9eeb => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 00:48:59.446821 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7a4f88-6351-4a8a-8987-50c1679dc3c6 None None] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:48:59.447425 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7a4f88-6351-4a8a-8987-50c1679dc3c6 None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:48:59.447778 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7a4f88-6351-4a8a-8987-50c1679dc3c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:48:59.462557 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.auth.core [None req-06650b0a-841c-430a-a292-5d01f2a1df7d None None] MFA Rules not processed for user `eb55b6cbca4945abb21b0e49eb745e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=87955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:48:59.468465 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-06650b0a-841c-430a-a292-5d01f2a1df7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:48:59.484709 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.auth.core [None req-7b7a4f88-6351-4a8a-8987-50c1679dc3c6 None None] MFA Rules not processed for user `68945b4022224eee92001c024ba4f865`. Rule list: `[]` (Enabled: `True`). {{(pid=87956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:48:59.486071 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-7b7a4f88-6351-4a8a-8987-50c1679dc3c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:48:59.604269 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 764/1544] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 30 00:48:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:48:59.608616 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 781/1545] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 30 00:48:59 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:48:59.609173 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06650b0a-841c-430a-a292-5d01f2a1df7d None None] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:48:59.620747 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7a4f88-6351-4a8a-8987-50c1679dc3c6 None None] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:48:59.623814 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06650b0a-841c-430a-a292-5d01f2a1df7d None None] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:48:59.628689 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-7b7a4f88-6351-4a8a-8987-50c1679dc3c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:48:59.639769 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f91ecf-f644-4d32-8923-e38b0e242de5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:48:59.641861 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f91ecf-f644-4d32-8923-e38b0e242de5 admin admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:48:59.642369 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f91ecf-f644-4d32-8923-e38b0e242de5 admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:48:59.642872 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f91ecf-f644-4d32-8923-e38b0e242de5 admin admin] PATH_INFO: `/v3/domains` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:48:59.644560 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f91ecf-f644-4d32-8923-e38b0e242de5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:48:59.645491 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f91ecf-f644-4d32-8923-e38b0e242de5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:48:59.651161 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f91ecf-f644-4d32-8923-e38b0e242de5 admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:48:59.658659 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7a4f88-6351-4a8a-8987-50c1679dc3c6 None None] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:48:59.671613 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cd71ee-1fa0-43ff-ac7b-0b12f4e9c2fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:48:59.674677 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cd71ee-1fa0-43ff-ac7b-0b12f4e9c2fc admin admin] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:48:59.675072 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cd71ee-1fa0-43ff-ac7b-0b12f4e9c2fc admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:48:59.677457 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cd71ee-1fa0-43ff-ac7b-0b12f4e9c2fc admin admin] PATH_INFO: `/v3/projects` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:48:59.678389 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82cd71ee-1fa0-43ff-ac7b-0b12f4e9c2fc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:48:59.684022 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82cd71ee-1fa0-43ff-ac7b-0b12f4e9c2fc admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:48:59.686747 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 765/1546] 10.222.0.42 () {58 vars in 1153 bytes} [Sun Oct 30 00:48:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 30 00:48:59.689739 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f91ecf-f644-4d32-8923-e38b0e242de5 admin admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:48:59.713720 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f91ecf-f644-4d32-8923-e38b0e242de5 admin admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:48:59.723815 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3500ab31-28f2-419d-b114-1c0d50d0df34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:48:59.724628 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3500ab31-28f2-419d-b114-1c0d50d0df34 admin admin] REQUEST_METHOD: `POST` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:48:59.726173 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3500ab31-28f2-419d-b114-1c0d50d0df34 admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:48:59.726311 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3500ab31-28f2-419d-b114-1c0d50d0df34 admin admin] PATH_INFO: `/v3/projects` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:48:59.726754 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:48:59.727667 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3500ab31-28f2-419d-b114-1c0d50d0df34 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:48:59.730051 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3500ab31-28f2-419d-b114-1c0d50d0df34 admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:48:59.750773 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 782/1547] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 30 00:48:59 2022] POST /identity/v3/projects => generated 379 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 30 00:48:59.754673 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cd71ee-1fa0-43ff-ac7b-0b12f4e9c2fc admin admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:48:59.789364 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 766/1548] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 30 00:48:59 2022] POST /identity/v3/projects => generated 373 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 00:48:59.793565 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3500ab31-28f2-419d-b114-1c0d50d0df34 admin admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:48:59.909288 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cd71ee-1fa0-43ff-ac7b-0b12f4e9c2fc admin admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:48:59.933432 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:48:59.940424 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3500ab31-28f2-419d-b114-1c0d50d0df34 admin admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:48:59.954398 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9d8fb0-dda8-4461-be71-3ecdc0e77f67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:48:59.954971 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9d8fb0-dda8-4461-be71-3ecdc0e77f67 admin admin] REQUEST_METHOD: `POST` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:48:59.955263 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9d8fb0-dda8-4461-be71-3ecdc0e77f67 admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:48:59.955538 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9d8fb0-dda8-4461-be71-3ecdc0e77f67 admin admin] PATH_INFO: `/v3/users` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:48:59.956177 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9d8fb0-dda8-4461-be71-3ecdc0e77f67 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:48:59.960808 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9d8fb0-dda8-4461-be71-3ecdc0e77f67 admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:49:00.010796 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 767/1549] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 30 00:48:59 2022] POST /identity/v3/users => generated 287 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 00:49:00.014874 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9d8fb0-dda8-4461-be71-3ecdc0e77f67 admin admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:49:00.036839 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9d8fb0-dda8-4461-be71-3ecdc0e77f67 admin admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:49:00.045408 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b3f86a-bdcb-4895-bb99-c3232e1639e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:49:00.046253 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b3f86a-bdcb-4895-bb99-c3232e1639e2 admin admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:00.046533 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b3f86a-bdcb-4895-bb99-c3232e1639e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:00.046848 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b3f86a-bdcb-4895-bb99-c3232e1639e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:00.047536 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b3f86a-bdcb-4895-bb99-c3232e1639e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:49:00.055628 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b3f86a-bdcb-4895-bb99-c3232e1639e2 admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:49:00.083841 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 768/1550] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 30 00:49:00 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 00:49:00.091734 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b3f86a-bdcb-4895-bb99-c3232e1639e2 admin admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:49:00.096641 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88271921-ba85-4651-8cd2-2385119e9189 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:49:00.100143 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88271921-ba85-4651-8cd2-2385119e9189 admin admin] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:00.100634 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88271921-ba85-4651-8cd2-2385119e9189 admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:00.101092 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88271921-ba85-4651-8cd2-2385119e9189 admin admin] PATH_INFO: `/v3/users` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:00.103642 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88271921-ba85-4651-8cd2-2385119e9189 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:49:00.106256 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88271921-ba85-4651-8cd2-2385119e9189 admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:49:00.118685 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b3f86a-bdcb-4895-bb99-c3232e1639e2 admin admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:49:00.129420 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d38878-65ca-45d7-90d5-989836b184df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:49:00.130052 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d38878-65ca-45d7-90d5-989836b184df admin admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:00.130332 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d38878-65ca-45d7-90d5-989836b184df admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:00.130604 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d38878-65ca-45d7-90d5-989836b184df admin admin] PATH_INFO: `/v3/roles` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:00.131278 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d38878-65ca-45d7-90d5-989836b184df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:49:00.132886 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d38878-65ca-45d7-90d5-989836b184df admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:49:00.156584 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 769/1551] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 30 00:49:00 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 00:49:00.165098 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 783/1552] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 30 00:48:59 2022] POST /identity/v3/users => generated 296 bytes in 411 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 00:49:00.167032 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d38878-65ca-45d7-90d5-989836b184df admin admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:49:00.168523 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88271921-ba85-4651-8cd2-2385119e9189 admin admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:49:00.188822 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d38878-65ca-45d7-90d5-989836b184df admin admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:49:00.202877 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88271921-ba85-4651-8cd2-2385119e9189 admin admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:49:00.203740 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7deea464-f60a-48ca-bf7a-8a7a60c7080b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:49:00.204675 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7deea464-f60a-48ca-bf7a-8a7a60c7080b admin admin] REQUEST_METHOD: `PUT` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:00.204956 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7deea464-f60a-48ca-bf7a-8a7a60c7080b admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:00.205243 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7deea464-f60a-48ca-bf7a-8a7a60c7080b admin admin] PATH_INFO: `/v3/projects/94519552c40f420fa3aa9e1dc7867bfa/users/fc09e42fa5cc41118dfe413ecc674200/roles/1c93019874174c4b91118d9ce2347e47` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:00.211469 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e78d2b3-72a1-4ec1-914f-9195a2264c14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:49:00.212631 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e78d2b3-72a1-4ec1-914f-9195a2264c14 admin admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:00.227293 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e78d2b3-72a1-4ec1-914f-9195a2264c14 admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:00.229884 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e78d2b3-72a1-4ec1-914f-9195a2264c14 admin admin] PATH_INFO: `/v3/roles` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:00.233172 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e78d2b3-72a1-4ec1-914f-9195a2264c14 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:49:00.239727 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e78d2b3-72a1-4ec1-914f-9195a2264c14 admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:49:00.243613 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7deea464-f60a-48ca-bf7a-8a7a60c7080b admin admin] RBAC: Authorizing `identity:create_grant(project_id=94519552c40f420fa3aa9e1dc7867bfa, user_id=fc09e42fa5cc41118dfe413ecc674200, role_id=1c93019874174c4b91118d9ce2347e47)` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:49:00.246338 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7deea464-f60a-48ca-bf7a-8a7a60c7080b admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:49:00.266367 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 784/1553] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 30 00:49:00 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 00:49:00.270342 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e78d2b3-72a1-4ec1-914f-9195a2264c14 admin admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:49:00.282842 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 770/1554] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 30 00:49:00 2022] PUT /identity/v3/projects/94519552c40f420fa3aa9e1dc7867bfa/users/fc09e42fa5cc41118dfe413ecc674200/roles/1c93019874174c4b91118d9ce2347e47 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 00:49:00.293364 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e78d2b3-72a1-4ec1-914f-9195a2264c14 admin admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:49:00.294207 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1c4edf-e02a-4029-8911-ad1cf3d37d11 None None] REQUEST_METHOD: `POST` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:00.294493 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1c4edf-e02a-4029-8911-ad1cf3d37d11 None None] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:00.294769 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1c4edf-e02a-4029-8911-ad1cf3d37d11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:00.349161 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.auth.core [None req-ca1c4edf-e02a-4029-8911-ad1cf3d37d11 None None] MFA Rules not processed for user `fc09e42fa5cc41118dfe413ecc674200`. Rule list: `[]` (Enabled: `True`). {{(pid=87955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:49:00.350767 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-ca1c4edf-e02a-4029-8911-ad1cf3d37d11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:49:00.513788 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 771/1555] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 30 00:49:00 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 30 00:49:00.514840 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1c4edf-e02a-4029-8911-ad1cf3d37d11 None None] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:49:00.520423 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3413b5c6-3dea-42aa-bb66-12228087afa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:49:00.530507 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3413b5c6-3dea-42aa-bb66-12228087afa5 admin admin] REQUEST_METHOD: `PUT` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:00.530507 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3413b5c6-3dea-42aa-bb66-12228087afa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:00.530507 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3413b5c6-3dea-42aa-bb66-12228087afa5 admin admin] PATH_INFO: `/v3/projects/9d08bdfb2a954e3bbb4c190aa43647c9/users/382d65f623634804945b7c4eacb3f73f/roles/6ccaa8c11f29456fb4e4eeccb21616c7` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:00.535599 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1c4edf-e02a-4029-8911-ad1cf3d37d11 None None] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:49:00.541909 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6557a46-73df-4d2f-af83-32d077735c10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:49:00.542737 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6557a46-73df-4d2f-af83-32d077735c10 admin admin] REQUEST_METHOD: `POST` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:00.543191 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6557a46-73df-4d2f-af83-32d077735c10 admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:00.543695 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6557a46-73df-4d2f-af83-32d077735c10 admin admin] PATH_INFO: `/v3/projects` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:00.544516 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6557a46-73df-4d2f-af83-32d077735c10 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:49:00.546809 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6557a46-73df-4d2f-af83-32d077735c10 admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:49:00.573215 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3413b5c6-3dea-42aa-bb66-12228087afa5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d08bdfb2a954e3bbb4c190aa43647c9, user_id=382d65f623634804945b7c4eacb3f73f, role_id=6ccaa8c11f29456fb4e4eeccb21616c7)` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:49:00.580195 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3413b5c6-3dea-42aa-bb66-12228087afa5 admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:49:00.613088 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 772/1556] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 30 00:49:00 2022] POST /identity/v3/projects => generated 373 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 00:49:00.616372 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6557a46-73df-4d2f-af83-32d077735c10 admin admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:49:00.616678 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 785/1557] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 30 00:49:00 2022] PUT /identity/v3/projects/9d08bdfb2a954e3bbb4c190aa43647c9/users/382d65f623634804945b7c4eacb3f73f/roles/6ccaa8c11f29456fb4e4eeccb21616c7 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 00:49:00.620993 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3413b5c6-3dea-42aa-bb66-12228087afa5 admin admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:49:00.634299 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:49:00.737414 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6557a46-73df-4d2f-af83-32d077735c10 admin admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:49:00.743956 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1dee6b0-56ed-48c3-859a-20d37ae03e44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:49:00.744917 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dee6b0-56ed-48c3-859a-20d37ae03e44 admin admin] REQUEST_METHOD: `POST` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:00.745377 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dee6b0-56ed-48c3-859a-20d37ae03e44 admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:00.745825 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dee6b0-56ed-48c3-859a-20d37ae03e44 admin admin] PATH_INFO: `/v3/users` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:00.746730 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1dee6b0-56ed-48c3-859a-20d37ae03e44 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:49:00.749230 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1dee6b0-56ed-48c3-859a-20d37ae03e44 admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:49:00.783661 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:49:00.801157 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 773/1558] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 30 00:49:00 2022] POST /identity/v3/users => generated 293 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 00:49:00.802504 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1dee6b0-56ed-48c3-859a-20d37ae03e44 admin admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:49:00.806905 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3413b5c6-3dea-42aa-bb66-12228087afa5 admin admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:49:00.824194 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1dee6b0-56ed-48c3-859a-20d37ae03e44 admin admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:49:00.835759 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b1eda4-dc14-4a14-b6d4-e6dec8705313 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:49:00.836531 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b1eda4-dc14-4a14-b6d4-e6dec8705313 admin admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:00.836814 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b1eda4-dc14-4a14-b6d4-e6dec8705313 admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:00.837083 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b1eda4-dc14-4a14-b6d4-e6dec8705313 admin admin] PATH_INFO: `/v3/roles` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:00.838320 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b1eda4-dc14-4a14-b6d4-e6dec8705313 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:49:00.840352 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b1eda4-dc14-4a14-b6d4-e6dec8705313 admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:49:00.854443 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 786/1559] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 30 00:49:00 2022] GET /identity/v3/roles => generated 1420 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 00:49:00.855323 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b1eda4-dc14-4a14-b6d4-e6dec8705313 admin admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:49:00.863935 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-10b1eda4-dc14-4a14-b6d4-e6dec8705313 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:49:00.866589 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cf766a-f1a2-4b8e-898b-bc7c58e45adc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:49:00.867421 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cf766a-f1a2-4b8e-898b-bc7c58e45adc admin admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:00.867701 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cf766a-f1a2-4b8e-898b-bc7c58e45adc admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:00.867982 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cf766a-f1a2-4b8e-898b-bc7c58e45adc admin admin] PATH_INFO: `/v3/roles` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:00.868617 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96cf766a-f1a2-4b8e-898b-bc7c58e45adc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:49:00.870238 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96cf766a-f1a2-4b8e-898b-bc7c58e45adc admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:49:00.885104 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 774/1560] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 30 00:49:00 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 00:49:00.885996 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cf766a-f1a2-4b8e-898b-bc7c58e45adc admin admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:49:00.886732 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b1eda4-dc14-4a14-b6d4-e6dec8705313 admin admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:49:00.899243 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cf766a-f1a2-4b8e-898b-bc7c58e45adc admin admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:49:00.907395 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216f9cbf-961e-43b6-a4d7-c2460326f5a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:49:00.908616 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216f9cbf-961e-43b6-a4d7-c2460326f5a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:00.908971 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216f9cbf-961e-43b6-a4d7-c2460326f5a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:00.909313 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216f9cbf-961e-43b6-a4d7-c2460326f5a6 admin admin] PATH_INFO: `/v3/projects/9d08bdfb2a954e3bbb4c190aa43647c9/users/382d65f623634804945b7c4eacb3f73f/roles/6ccaa8c11f29456fb4e4eeccb21616c7` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:00.911368 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64210772-bd18-4801-8e10-3ab95c27a98c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:49:00.911877 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216f9cbf-961e-43b6-a4d7-c2460326f5a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d08bdfb2a954e3bbb4c190aa43647c9, user_id=382d65f623634804945b7c4eacb3f73f, role_id=6ccaa8c11f29456fb4e4eeccb21616c7)` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:49:00.913409 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64210772-bd18-4801-8e10-3ab95c27a98c admin admin] REQUEST_METHOD: `DELETE` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:00.914522 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216f9cbf-961e-43b6-a4d7-c2460326f5a6 admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:49:00.915750 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64210772-bd18-4801-8e10-3ab95c27a98c admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:00.916209 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64210772-bd18-4801-8e10-3ab95c27a98c admin admin] PATH_INFO: `/v3/projects/b9e6747a718b456a82af0d611a809b34` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:00.918072 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64210772-bd18-4801-8e10-3ab95c27a98c admin admin] RBAC: Authorizing `identity:delete_project(project_id=b9e6747a718b456a82af0d611a809b34)` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:49:00.920804 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64210772-bd18-4801-8e10-3ab95c27a98c admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:49:00.933865 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 775/1561] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 30 00:49:00 2022] PUT /identity/v3/projects/9d08bdfb2a954e3bbb4c190aa43647c9/users/382d65f623634804945b7c4eacb3f73f/roles/6ccaa8c11f29456fb4e4eeccb21616c7 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 00:49:00.934842 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216f9cbf-961e-43b6-a4d7-c2460326f5a6 admin admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:49:01.016100 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-64210772-bd18-4801-8e10-3ab95c27a98c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b9e6747a718b456a82af0d611a809b34', 'request_id': 'req-64210772-bd18-4801-8e10-3ab95c27a98c'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:49:01.029992 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-64210772-bd18-4801-8e10-3ab95c27a98c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b9e6747a718b456a82af0d611a809b34', 'request_id': 'req-64210772-bd18-4801-8e10-3ab95c27a98c'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:49:01.040517 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-64210772-bd18-4801-8e10-3ab95c27a98c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b9e6747a718b456a82af0d611a809b34', 'request_id': 'req-64210772-bd18-4801-8e10-3ab95c27a98c'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:49:01.042577 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216f9cbf-961e-43b6-a4d7-c2460326f5a6 admin admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:49:01.064693 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-64210772-bd18-4801-8e10-3ab95c27a98c admin admin] The token cache is being invalidate because project b9e6747a718b456a82af0d611a809b34 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87956) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 00:49:01.065161 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-64210772-bd18-4801-8e10-3ab95c27a98c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:49:01.071937 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-64210772-bd18-4801-8e10-3ab95c27a98c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:49:01.074548 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 787/1562] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 30 00:49:00 2022] DELETE /identity/v3/projects/b9e6747a718b456a82af0d611a809b34 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 00:49:01.075928 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bbf838-4be5-4111-8ceb-15bf99e55789 None None] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:01.076686 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bbf838-4be5-4111-8ceb-15bf99e55789 None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:01.079180 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bbf838-4be5-4111-8ceb-15bf99e55789 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:01.141319 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.auth.core [None req-57bbf838-4be5-4111-8ceb-15bf99e55789 None None] MFA Rules not processed for user `382d65f623634804945b7c4eacb3f73f`. Rule list: `[]` (Enabled: `True`). {{(pid=87956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:49:01.142825 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-57bbf838-4be5-4111-8ceb-15bf99e55789 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:49:01.144095 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f05ac4f-a7a1-47e8-b10d-30b6f68ae6b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:49:01.144847 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f05ac4f-a7a1-47e8-b10d-30b6f68ae6b1 admin admin] REQUEST_METHOD: `PUT` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:01.145160 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f05ac4f-a7a1-47e8-b10d-30b6f68ae6b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:01.145438 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f05ac4f-a7a1-47e8-b10d-30b6f68ae6b1 admin admin] PATH_INFO: `/v3/projects/cd0a637112e345a0a87fcac8c50e815f/users/d1ce5f8d24cd4e3b81edd946270b0087/roles/6ccaa8c11f29456fb4e4eeccb21616c7` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:01.166090 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f05ac4f-a7a1-47e8-b10d-30b6f68ae6b1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd0a637112e345a0a87fcac8c50e815f, user_id=d1ce5f8d24cd4e3b81edd946270b0087, role_id=6ccaa8c11f29456fb4e4eeccb21616c7)` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:49:01.169730 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f05ac4f-a7a1-47e8-b10d-30b6f68ae6b1 admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:49:01.193994 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 776/1563] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 30 00:49:00 2022] PUT /identity/v3/projects/cd0a637112e345a0a87fcac8c50e815f/users/d1ce5f8d24cd4e3b81edd946270b0087/roles/6ccaa8c11f29456fb4e4eeccb21616c7 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 00:49:01.199775 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71209f0c-b5e7-4f04-9ff6-b952369dde81 None None] REQUEST_METHOD: `POST` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:01.200061 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71209f0c-b5e7-4f04-9ff6-b952369dde81 None None] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:01.200335 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71209f0c-b5e7-4f04-9ff6-b952369dde81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:01.226825 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.auth.core [None req-71209f0c-b5e7-4f04-9ff6-b952369dde81 None None] MFA Rules not processed for user `eb55b6cbca4945abb21b0e49eb745e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=87955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:49:01.228182 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-71209f0c-b5e7-4f04-9ff6-b952369dde81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:49:01.249405 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 788/1564] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 30 00:49:01 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:49:01.255906 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bbf838-4be5-4111-8ceb-15bf99e55789 None None] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:49:01.257365 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-57bbf838-4be5-4111-8ceb-15bf99e55789 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:49:01.271769 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bbf838-4be5-4111-8ceb-15bf99e55789 None None] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:49:01.278903 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:49:01.343811 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 777/1565] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 30 00:49:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:49:01.345602 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71209f0c-b5e7-4f04-9ff6-b952369dde81 None None] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:49:01.347055 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-71209f0c-b5e7-4f04-9ff6-b952369dde81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:49:01.355577 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:49:01.379295 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fef42e4-5fea-45bf-a4b3-87e72dce58d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:49:01.380171 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fef42e4-5fea-45bf-a4b3-87e72dce58d5 admin admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:01.380858 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fef42e4-5fea-45bf-a4b3-87e72dce58d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:01.381248 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fef42e4-5fea-45bf-a4b3-87e72dce58d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:01.382050 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fef42e4-5fea-45bf-a4b3-87e72dce58d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:49:01.384762 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fef42e4-5fea-45bf-a4b3-87e72dce58d5 admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:49:01.403052 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 789/1566] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 30 00:49:01 2022] GET /identity/v3/roles => generated 1420 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 00:49:01.407008 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991a6762-53cb-4daa-af6e-3f5eb955e957 None None] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:01.407388 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991a6762-53cb-4daa-af6e-3f5eb955e957 None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:01.407728 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991a6762-53cb-4daa-af6e-3f5eb955e957 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:01.434425 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.auth.core [None req-991a6762-53cb-4daa-af6e-3f5eb955e957 None None] MFA Rules not processed for user `eb55b6cbca4945abb21b0e49eb745e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=87956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:49:01.435850 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-991a6762-53cb-4daa-af6e-3f5eb955e957 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:49:01.449786 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 790/1567] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 30 00:49:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:49:01.450611 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991a6762-53cb-4daa-af6e-3f5eb955e957 None None] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:49:01.452405 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71209f0c-b5e7-4f04-9ff6-b952369dde81 None None] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:49:01.461444 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7d0590-a18d-42c9-9042-87ddd3068984 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48d928ff7fe24348ac900f09c56acc20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d2387fdf794d4eaef07bbcd7b39f2a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:49:01.462085 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7d0590-a18d-42c9-9042-87ddd3068984 service cinder] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:01.462369 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7d0590-a18d-42c9-9042-87ddd3068984 service cinder] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:01.462639 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7d0590-a18d-42c9-9042-87ddd3068984 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:01.477949 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991a6762-53cb-4daa-af6e-3f5eb955e957 None None] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:49:01.490753 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a7e828-bf3b-498f-8e7c-d80e53a51342 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:49:01.491990 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a7e828-bf3b-498f-8e7c-d80e53a51342 admin admin] REQUEST_METHOD: `PUT` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:01.493721 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a7e828-bf3b-498f-8e7c-d80e53a51342 admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:01.494013 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a7e828-bf3b-498f-8e7c-d80e53a51342 admin admin] PATH_INFO: `/v3/projects/cd0a637112e345a0a87fcac8c50e815f/users/d1ce5f8d24cd4e3b81edd946270b0087/roles/6ccaa8c11f29456fb4e4eeccb21616c7` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:01.502426 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a7e828-bf3b-498f-8e7c-d80e53a51342 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd0a637112e345a0a87fcac8c50e815f, user_id=d1ce5f8d24cd4e3b81edd946270b0087, role_id=6ccaa8c11f29456fb4e4eeccb21616c7)` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:49:01.509293 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a7e828-bf3b-498f-8e7c-d80e53a51342 admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:49:01.540872 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 791/1568] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 30 00:49:01 2022] PUT /identity/v3/projects/cd0a637112e345a0a87fcac8c50e815f/users/d1ce5f8d24cd4e3b81edd946270b0087/roles/6ccaa8c11f29456fb4e4eeccb21616c7 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 00:49:01.541764 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a7e828-bf3b-498f-8e7c-d80e53a51342 admin admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:49:01.647398 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7d0590-a18d-42c9-9042-87ddd3068984 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:49:01.653059 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7d0590-a18d-42c9-9042-87ddd3068984 service cinder] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:49:01.672104 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 778/1569] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 30 00:49:01 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 00:49:01.673056 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7d0590-a18d-42c9-9042-87ddd3068984 service cinder] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:49:01.674360 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-5f7d0590-a18d-42c9-9042-87ddd3068984 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:49:01.704468 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7d0590-a18d-42c9-9042-87ddd3068984 service cinder] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:49:01.740957 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a7e828-bf3b-498f-8e7c-d80e53a51342 admin admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:49:01.770781 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b6ee27-4b01-42e0-9faa-78f54cbf93e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:49:01.772864 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b6ee27-4b01-42e0-9faa-78f54cbf93e6 admin admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:01.773092 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b6ee27-4b01-42e0-9faa-78f54cbf93e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:01.773365 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b6ee27-4b01-42e0-9faa-78f54cbf93e6 admin admin] PATH_INFO: `/v3/domains` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:01.775258 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b6ee27-4b01-42e0-9faa-78f54cbf93e6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87956) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:49:01.775606 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b6ee27-4b01-42e0-9faa-78f54cbf93e6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:49:01.782587 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b6ee27-4b01-42e0-9faa-78f54cbf93e6 admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:49:01.814514 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 792/1570] 10.222.0.42 () {58 vars in 1153 bytes} [Sun Oct 30 00:49:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:49:01.816102 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5036906-b077-4b34-9918-d04087ad274b None None] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:01.816456 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5036906-b077-4b34-9918-d04087ad274b None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:01.817111 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bcc8d8-50da-4216-bc6c-4cf53af3d91e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:49:01.818082 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bcc8d8-50da-4216-bc6c-4cf53af3d91e admin admin] REQUEST_METHOD: `DELETE` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:01.818422 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bcc8d8-50da-4216-bc6c-4cf53af3d91e admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:01.818869 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bcc8d8-50da-4216-bc6c-4cf53af3d91e admin admin] PATH_INFO: `/v3/users/6369a5851d304bdfad1d4f6d36b64612` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:01.819047 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5036906-b077-4b34-9918-d04087ad274b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:01.820759 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20bcc8d8-50da-4216-bc6c-4cf53af3d91e admin admin] RBAC: Authorizing `identity:delete_user(user_id=6369a5851d304bdfad1d4f6d36b64612)` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:49:01.823734 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20bcc8d8-50da-4216-bc6c-4cf53af3d91e admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:49:01.877933 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.auth.core [None req-a5036906-b077-4b34-9918-d04087ad274b None None] MFA Rules not processed for user `d1ce5f8d24cd4e3b81edd946270b0087`. Rule list: `[]` (Enabled: `True`). {{(pid=87956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:49:01.882470 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-a5036906-b077-4b34-9918-d04087ad274b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:49:01.958398 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-20bcc8d8-50da-4216-bc6c-4cf53af3d91e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6369a5851d304bdfad1d4f6d36b64612'} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:49:01.959102 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-20bcc8d8-50da-4216-bc6c-4cf53af3d91e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6369a5851d304bdfad1d4f6d36b64612'} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:49:01.977244 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-20bcc8d8-50da-4216-bc6c-4cf53af3d91e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6369a5851d304bdfad1d4f6d36b64612'} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:49:01.978003 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-20bcc8d8-50da-4216-bc6c-4cf53af3d91e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6369a5851d304bdfad1d4f6d36b64612'} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:49:01.979399 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:49:02.003185 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-20bcc8d8-50da-4216-bc6c-4cf53af3d91e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6369a5851d304bdfad1d4f6d36b64612'} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:49:02.027629 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 779/1571] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 30 00:49:01 2022] DELETE /identity/v3/users/6369a5851d304bdfad1d4f6d36b64612 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 00:49:02.029083 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582442c6-c948-4736-9b9c-24c4321d1bf9 None None] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:02.029370 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582442c6-c948-4736-9b9c-24c4321d1bf9 None None] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:02.029644 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582442c6-c948-4736-9b9c-24c4321d1bf9 None None] PATH_INFO: `/` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:02.031236 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 793/1572] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 30 00:49:01 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:49:02.031707 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 780/1573] 10.222.0.42 () {54 vars in 921 bytes} [Sun Oct 30 00:49:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:49:02.032613 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d1eb38-cb85-42f9-9414-27e030993b3a None None] REQUEST_METHOD: `POST` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:02.032960 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d1eb38-cb85-42f9-9414-27e030993b3a None None] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:02.033236 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d1eb38-cb85-42f9-9414-27e030993b3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:02.033570 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5036906-b077-4b34-9918-d04087ad274b None None] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:49:02.037581 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-a5036906-b077-4b34-9918-d04087ad274b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:49:02.059593 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.auth.core [None req-48d1eb38-cb85-42f9-9414-27e030993b3a None None] MFA Rules not processed for user `eb55b6cbca4945abb21b0e49eb745e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=87955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:49:02.060809 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-48d1eb38-cb85-42f9-9414-27e030993b3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:49:02.065073 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:49:02.085765 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5036906-b077-4b34-9918-d04087ad274b None None] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:49:02.164447 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 781/1574] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 30 00:49:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:49:02.166404 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d1eb38-cb85-42f9-9414-27e030993b3a None None] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:49:02.168098 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-48d1eb38-cb85-42f9-9414-27e030993b3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:49:02.228389 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cf48ae-54e7-458f-ac92-988425365a05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:49:02.229529 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cf48ae-54e7-458f-ac92-988425365a05 admin admin] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:02.229958 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cf48ae-54e7-458f-ac92-988425365a05 admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:02.230146 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cf48ae-54e7-458f-ac92-988425365a05 admin admin] PATH_INFO: `/v3/projects` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:02.230904 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86cf48ae-54e7-458f-ac92-988425365a05 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:49:02.233191 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86cf48ae-54e7-458f-ac92-988425365a05 admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:49:02.253850 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d1eb38-cb85-42f9-9414-27e030993b3a None None] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:49:02.260373 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eedfca0-86b5-41ba-bfbf-1399b9f6d878 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48d928ff7fe24348ac900f09c56acc20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d2387fdf794d4eaef07bbcd7b39f2a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:49:02.261649 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eedfca0-86b5-41ba-bfbf-1399b9f6d878 service cinder] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:02.261945 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eedfca0-86b5-41ba-bfbf-1399b9f6d878 service cinder] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:02.262222 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eedfca0-86b5-41ba-bfbf-1399b9f6d878 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:02.269727 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 794/1575] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 30 00:49:02 2022] POST /identity/v3/projects => generated 383 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 00:49:02.269727 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d015211-3bdd-48cd-be73-e2c6fd382fe2 None None] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:02.269727 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d015211-3bdd-48cd-be73-e2c6fd382fe2 None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:02.269727 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d015211-3bdd-48cd-be73-e2c6fd382fe2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:02.293284 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.auth.core [None req-1d015211-3bdd-48cd-be73-e2c6fd382fe2 None None] MFA Rules not processed for user `fde877b6ddc74f4a87baf21471eb31d2`. Rule list: `[]` (Enabled: `True`). {{(pid=87956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:49:02.294801 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-1d015211-3bdd-48cd-be73-e2c6fd382fe2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:49:02.399303 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 795/1576] 10.222.0.42 () {58 vars in 1018 bytes} [Sun Oct 30 00:49:02 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:49:02.400464 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d015211-3bdd-48cd-be73-e2c6fd382fe2 None None] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:49:02.401592 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eedfca0-86b5-41ba-bfbf-1399b9f6d878 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:49:02.402186 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-1d015211-3bdd-48cd-be73-e2c6fd382fe2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:49:02.406255 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eedfca0-86b5-41ba-bfbf-1399b9f6d878 service cinder] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:49:02.419276 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 782/1577] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 30 00:49:02 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 00:49:02.426355 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eedfca0-86b5-41ba-bfbf-1399b9f6d878 service cinder] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:49:02.437596 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eedfca0-86b5-41ba-bfbf-1399b9f6d878 service cinder] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:49:02.509745 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:49:02.520712 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d015211-3bdd-48cd-be73-e2c6fd382fe2 None None] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:49:02.526492 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c168fd-894f-463a-ab33-c7894fae04ab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5693f186c6ad4d9394f02ee3477cdcd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d2387fdf794d4eaef07bbcd7b39f2a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:49:02.528337 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c168fd-894f-463a-ab33-c7894fae04ab service neutron] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:02.528776 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c168fd-894f-463a-ab33-c7894fae04ab service neutron] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:02.529075 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c168fd-894f-463a-ab33-c7894fae04ab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:02.586458 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a981a83-32ca-48dd-a612-0c15ba0967c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:49:02.587079 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a981a83-32ca-48dd-a612-0c15ba0967c8 admin admin] REQUEST_METHOD: `POST` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:02.587444 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a981a83-32ca-48dd-a612-0c15ba0967c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:02.587703 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a981a83-32ca-48dd-a612-0c15ba0967c8 admin admin] PATH_INFO: `/v3/users` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:02.588353 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a981a83-32ca-48dd-a612-0c15ba0967c8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:49:02.590576 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a981a83-32ca-48dd-a612-0c15ba0967c8 admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:49:02.601058 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:49:02.616470 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 783/1578] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 30 00:49:02 2022] POST /identity/v3/users => generated 292 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 00:49:02.617150 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a981a83-32ca-48dd-a612-0c15ba0967c8 admin admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:49:02.618862 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-5a981a83-32ca-48dd-a612-0c15ba0967c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:49:02.635060 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c168fd-894f-463a-ab33-c7894fae04ab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:49:02.636645 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c168fd-894f-463a-ab33-c7894fae04ab service neutron] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:49:02.649375 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 796/1579] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 30 00:49:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 249 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 00:49:02.650203 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c168fd-894f-463a-ab33-c7894fae04ab service neutron] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:49:02.651579 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-67c168fd-894f-463a-ab33-c7894fae04ab service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:49:02.669881 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c168fd-894f-463a-ab33-c7894fae04ab service neutron] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:49:02.677988 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7750ed-aa89-45c6-8ce6-a07939100a0e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fde877b6ddc74f4a87baf21471eb31d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d2387fdf794d4eaef07bbcd7b39f2a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:49:02.678827 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7750ed-aa89-45c6-8ce6-a07939100a0e service nova] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:02.679270 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7750ed-aa89-45c6-8ce6-a07939100a0e service nova] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:02.679702 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7750ed-aa89-45c6-8ce6-a07939100a0e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:02.687643 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a981a83-32ca-48dd-a612-0c15ba0967c8 admin admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:49:02.690383 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7750ed-aa89-45c6-8ce6-a07939100a0e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:49:02.692182 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7750ed-aa89-45c6-8ce6-a07939100a0e service nova] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:49:02.693289 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a92b03-7233-4901-91b7-adef6b34c3c3 tempest-VolumeQuotaClassesTest-413694426 tempest-VolumeQuotaClassesTest-413694426-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382d65f623634804945b7c4eacb3f73f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d08bdfb2a954e3bbb4c190aa43647c9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:49:02.693911 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a92b03-7233-4901-91b7-adef6b34c3c3 tempest-VolumeQuotaClassesTest-413694426 tempest-VolumeQuotaClassesTest-413694426-project-admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:02.694192 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a92b03-7233-4901-91b7-adef6b34c3c3 tempest-VolumeQuotaClassesTest-413694426 tempest-VolumeQuotaClassesTest-413694426-project-admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:02.694950 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a92b03-7233-4901-91b7-adef6b34c3c3 tempest-VolumeQuotaClassesTest-413694426 tempest-VolumeQuotaClassesTest-413694426-project-admin] PATH_INFO: `/v3/domains` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:02.695730 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a92b03-7233-4901-91b7-adef6b34c3c3 tempest-VolumeQuotaClassesTest-413694426 tempest-VolumeQuotaClassesTest-413694426-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=87955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:49:02.696036 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a92b03-7233-4901-91b7-adef6b34c3c3 tempest-VolumeQuotaClassesTest-413694426 tempest-VolumeQuotaClassesTest-413694426-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:49:02.697982 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a92b03-7233-4901-91b7-adef6b34c3c3 tempest-VolumeQuotaClassesTest-413694426 tempest-VolumeQuotaClassesTest-413694426-project-admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:49:02.716436 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 784/1581] 10.222.0.42 () {58 vars in 1153 bytes} [Sun Oct 30 00:49:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:49:02.716436 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a92b03-7233-4901-91b7-adef6b34c3c3 tempest-VolumeQuotaClassesTest-413694426 tempest-VolumeQuotaClassesTest-413694426-project-admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:49:02.724192 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 797/1581] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 30 00:49:02 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 00:49:02.728478 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7750ed-aa89-45c6-8ce6-a07939100a0e service nova] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:49:02.755067 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7750ed-aa89-45c6-8ce6-a07939100a0e service nova] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:49:02.769076 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cc75b7-8fd1-4072-a980-8acdd6fa8715 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:49:02.769589 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cc75b7-8fd1-4072-a980-8acdd6fa8715 admin admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:02.769854 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cc75b7-8fd1-4072-a980-8acdd6fa8715 admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:02.770127 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cc75b7-8fd1-4072-a980-8acdd6fa8715 admin admin] PATH_INFO: `/v3/roles` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:02.770810 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40cc75b7-8fd1-4072-a980-8acdd6fa8715 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:49:02.772564 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40cc75b7-8fd1-4072-a980-8acdd6fa8715 admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:49:02.789537 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 798/1582] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 30 00:49:02 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 00:49:02.790387 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cc75b7-8fd1-4072-a980-8acdd6fa8715 admin admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:49:02.814829 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cc75b7-8fd1-4072-a980-8acdd6fa8715 admin admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:49:02.820231 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a92b03-7233-4901-91b7-adef6b34c3c3 tempest-VolumeQuotaClassesTest-413694426 tempest-VolumeQuotaClassesTest-413694426-project-admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:49:02.824181 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9437acc4-4b29-4c67-82c3-814c6ee00437 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48d928ff7fe24348ac900f09c56acc20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d2387fdf794d4eaef07bbcd7b39f2a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:49:02.824800 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9437acc4-4b29-4c67-82c3-814c6ee00437 service cinder] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:02.825103 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9437acc4-4b29-4c67-82c3-814c6ee00437 service cinder] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:02.825333 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9437acc4-4b29-4c67-82c3-814c6ee00437 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:02.827982 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-9437acc4-4b29-4c67-82c3-814c6ee00437 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:49:02.829091 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e75ba6-85b7-4f6c-9c80-4d954164b1c1 tempest-VolumeQuotaClassesTest-413694426 tempest-VolumeQuotaClassesTest-413694426-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382d65f623634804945b7c4eacb3f73f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d08bdfb2a954e3bbb4c190aa43647c9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:49:02.829254 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e75ba6-85b7-4f6c-9c80-4d954164b1c1 tempest-VolumeQuotaClassesTest-413694426 tempest-VolumeQuotaClassesTest-413694426-project-admin] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:02.829634 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e75ba6-85b7-4f6c-9c80-4d954164b1c1 tempest-VolumeQuotaClassesTest-413694426 tempest-VolumeQuotaClassesTest-413694426-project-admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:02.829942 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e75ba6-85b7-4f6c-9c80-4d954164b1c1 tempest-VolumeQuotaClassesTest-413694426 tempest-VolumeQuotaClassesTest-413694426-project-admin] PATH_INFO: `/v3/projects` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:02.830732 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e75ba6-85b7-4f6c-9c80-4d954164b1c1 tempest-VolumeQuotaClassesTest-413694426 tempest-VolumeQuotaClassesTest-413694426-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:49:02.832868 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e75ba6-85b7-4f6c-9c80-4d954164b1c1 tempest-VolumeQuotaClassesTest-413694426 tempest-VolumeQuotaClassesTest-413694426-project-admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:49:02.879247 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 799/1583] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 30 00:49:02 2022] POST /identity/v3/projects => generated 354 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 00:49:02.880105 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e75ba6-85b7-4f6c-9c80-4d954164b1c1 tempest-VolumeQuotaClassesTest-413694426 tempest-VolumeQuotaClassesTest-413694426-project-admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:49:02.924365 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9437acc4-4b29-4c67-82c3-814c6ee00437 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:49:02.925873 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9437acc4-4b29-4c67-82c3-814c6ee00437 service cinder] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:49:02.935835 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 785/1584] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 30 00:49:02 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 00:49:02.936960 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9437acc4-4b29-4c67-82c3-814c6ee00437 service cinder] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:49:02.942860 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:49:02.949210 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9437acc4-4b29-4c67-82c3-814c6ee00437 service cinder] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:49:02.957145 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e75ba6-85b7-4f6c-9c80-4d954164b1c1 tempest-VolumeQuotaClassesTest-413694426 tempest-VolumeQuotaClassesTest-413694426-project-admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:49:02.962259 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af9120b-b7fc-4025-ba15-945c322f606a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:49:02.962886 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af9120b-b7fc-4025-ba15-945c322f606a admin admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:02.963166 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af9120b-b7fc-4025-ba15-945c322f606a admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:02.963466 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af9120b-b7fc-4025-ba15-945c322f606a admin admin] PATH_INFO: `/v3/roles` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:02.964255 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af9120b-b7fc-4025-ba15-945c322f606a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:49:02.965869 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af9120b-b7fc-4025-ba15-945c322f606a admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:49:02.982467 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 800/1585] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 30 00:49:02 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 00:49:02.983615 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af9120b-b7fc-4025-ba15-945c322f606a admin admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:49:02.994508 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af9120b-b7fc-4025-ba15-945c322f606a admin admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:49:03.000502 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d429f795-586f-44af-8d3c-ae5f3b075953 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:49:03.001178 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d429f795-586f-44af-8d3c-ae5f3b075953 admin admin] REQUEST_METHOD: `PUT` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:03.001457 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d429f795-586f-44af-8d3c-ae5f3b075953 admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:03.002838 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d429f795-586f-44af-8d3c-ae5f3b075953 admin admin] PATH_INFO: `/v3/projects/d9ec9b5374d24b2f9c9d76492668b35e/users/053417105dc34f25a8b59ef15e89afa7/roles/1c93019874174c4b91118d9ce2347e47` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:03.024880 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d429f795-586f-44af-8d3c-ae5f3b075953 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d9ec9b5374d24b2f9c9d76492668b35e, user_id=053417105dc34f25a8b59ef15e89afa7, role_id=1c93019874174c4b91118d9ce2347e47)` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:49:03.027720 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d429f795-586f-44af-8d3c-ae5f3b075953 admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:49:03.037351 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e173de1-837f-4416-8393-7da24d4151ac tempest-VolumeQuotaClassesTest-413694426 tempest-VolumeQuotaClassesTest-413694426-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382d65f623634804945b7c4eacb3f73f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d08bdfb2a954e3bbb4c190aa43647c9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:49:03.037748 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e173de1-837f-4416-8393-7da24d4151ac tempest-VolumeQuotaClassesTest-413694426 tempest-VolumeQuotaClassesTest-413694426-project-admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:03.038059 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e173de1-837f-4416-8393-7da24d4151ac tempest-VolumeQuotaClassesTest-413694426 tempest-VolumeQuotaClassesTest-413694426-project-admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:03.038293 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e173de1-837f-4416-8393-7da24d4151ac tempest-VolumeQuotaClassesTest-413694426 tempest-VolumeQuotaClassesTest-413694426-project-admin] PATH_INFO: `/v3/domains` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:03.039273 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e173de1-837f-4416-8393-7da24d4151ac tempest-VolumeQuotaClassesTest-413694426 tempest-VolumeQuotaClassesTest-413694426-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=87955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:49:03.039372 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e173de1-837f-4416-8393-7da24d4151ac tempest-VolumeQuotaClassesTest-413694426 tempest-VolumeQuotaClassesTest-413694426-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:49:03.043516 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e173de1-837f-4416-8393-7da24d4151ac tempest-VolumeQuotaClassesTest-413694426 tempest-VolumeQuotaClassesTest-413694426-project-admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:49:03.055236 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 801/1586] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 30 00:49:02 2022] PUT /identity/v3/projects/d9ec9b5374d24b2f9c9d76492668b35e/users/053417105dc34f25a8b59ef15e89afa7/roles/1c93019874174c4b91118d9ce2347e47 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 00:49:03.074900 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21b9a0c-edea-4d24-8f46-d5a6a564c53f None None] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:03.075186 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21b9a0c-edea-4d24-8f46-d5a6a564c53f None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:03.075483 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21b9a0c-edea-4d24-8f46-d5a6a564c53f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:03.083145 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 786/1587] 10.222.0.42 () {58 vars in 1153 bytes} [Sun Oct 30 00:49:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:49:03.105740 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e173de1-837f-4416-8393-7da24d4151ac tempest-VolumeQuotaClassesTest-413694426 tempest-VolumeQuotaClassesTest-413694426-project-admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:49:03.114435 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-3e173de1-837f-4416-8393-7da24d4151ac tempest-VolumeQuotaClassesTest-413694426 tempest-VolumeQuotaClassesTest-413694426-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:49:03.115245 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.auth.core [None req-d21b9a0c-edea-4d24-8f46-d5a6a564c53f None None] MFA Rules not processed for user `053417105dc34f25a8b59ef15e89afa7`. Rule list: `[]` (Enabled: `True`). {{(pid=87956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:49:03.116276 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-d21b9a0c-edea-4d24-8f46-d5a6a564c53f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:49:03.145996 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e173de1-837f-4416-8393-7da24d4151ac tempest-VolumeQuotaClassesTest-413694426 tempest-VolumeQuotaClassesTest-413694426-project-admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:49:03.228597 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6fc204-7dfd-4b00-8dc8-d2b657b80649 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:49:03.229260 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6fc204-7dfd-4b00-8dc8-d2b657b80649 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:03.229553 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6fc204-7dfd-4b00-8dc8-d2b657b80649 admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:03.229872 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6fc204-7dfd-4b00-8dc8-d2b657b80649 admin admin] PATH_INFO: `/v3/projects/723bdd71d0d74bc18e333238fdca8706` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:03.231028 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6fc204-7dfd-4b00-8dc8-d2b657b80649 admin admin] RBAC: Authorizing `identity:delete_project(project_id=723bdd71d0d74bc18e333238fdca8706)` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:49:03.233328 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6fc204-7dfd-4b00-8dc8-d2b657b80649 admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:49:03.298052 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-ce6fc204-7dfd-4b00-8dc8-d2b657b80649 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '723bdd71d0d74bc18e333238fdca8706', 'request_id': 'req-ce6fc204-7dfd-4b00-8dc8-d2b657b80649'} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:49:03.305794 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-ce6fc204-7dfd-4b00-8dc8-d2b657b80649 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '723bdd71d0d74bc18e333238fdca8706', 'request_id': 'req-ce6fc204-7dfd-4b00-8dc8-d2b657b80649'} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:49:03.308965 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:49:03.317051 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-ce6fc204-7dfd-4b00-8dc8-d2b657b80649 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '723bdd71d0d74bc18e333238fdca8706', 'request_id': 'req-ce6fc204-7dfd-4b00-8dc8-d2b657b80649'} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:49:03.334962 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 802/1588] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 30 00:49:03 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:49:03.336277 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21b9a0c-edea-4d24-8f46-d5a6a564c53f None None] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:49:03.404010 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21b9a0c-edea-4d24-8f46-d5a6a564c53f None None] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:49:03.462815 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-ce6fc204-7dfd-4b00-8dc8-d2b657b80649 admin admin] The token cache is being invalidate because project 723bdd71d0d74bc18e333238fdca8706 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87955) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 00:49:03.462993 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-ce6fc204-7dfd-4b00-8dc8-d2b657b80649 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:49:03.463750 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-ce6fc204-7dfd-4b00-8dc8-d2b657b80649 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:49:03.468031 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 787/1589] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 30 00:49:03 2022] DELETE /identity/v3/projects/723bdd71d0d74bc18e333238fdca8706 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 00:49:03.468031 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6fc204-7dfd-4b00-8dc8-d2b657b80649 admin admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:49:03.468031 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-ce6fc204-7dfd-4b00-8dc8-d2b657b80649 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:49:03.471685 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689ec377-9a08-403c-8042-c03039d4f589 tempest-VolumeQuotaClassesTest-413694426 tempest-VolumeQuotaClassesTest-413694426-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382d65f623634804945b7c4eacb3f73f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d08bdfb2a954e3bbb4c190aa43647c9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:49:03.472743 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689ec377-9a08-403c-8042-c03039d4f589 tempest-VolumeQuotaClassesTest-413694426 tempest-VolumeQuotaClassesTest-413694426-project-admin] REQUEST_METHOD: `DELETE` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:03.473027 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689ec377-9a08-403c-8042-c03039d4f589 tempest-VolumeQuotaClassesTest-413694426 tempest-VolumeQuotaClassesTest-413694426-project-admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:03.473293 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689ec377-9a08-403c-8042-c03039d4f589 tempest-VolumeQuotaClassesTest-413694426 tempest-VolumeQuotaClassesTest-413694426-project-admin] PATH_INFO: `/v3/projects/3883b746a4f74e2fa3d5def1a31845af` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:03.475996 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689ec377-9a08-403c-8042-c03039d4f589 tempest-VolumeQuotaClassesTest-413694426 tempest-VolumeQuotaClassesTest-413694426-project-admin] RBAC: Authorizing `identity:delete_project(project_id=3883b746a4f74e2fa3d5def1a31845af)` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:49:03.478036 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689ec377-9a08-403c-8042-c03039d4f589 tempest-VolumeQuotaClassesTest-413694426 tempest-VolumeQuotaClassesTest-413694426-project-admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:49:03.505129 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:49:03.542308 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-689ec377-9a08-403c-8042-c03039d4f589 tempest-VolumeQuotaClassesTest-413694426 tempest-VolumeQuotaClassesTest-413694426-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3883b746a4f74e2fa3d5def1a31845af', 'request_id': 'req-689ec377-9a08-403c-8042-c03039d4f589'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:49:03.549866 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6fc204-7dfd-4b00-8dc8-d2b657b80649 admin admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:49:03.557741 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-689ec377-9a08-403c-8042-c03039d4f589 tempest-VolumeQuotaClassesTest-413694426 tempest-VolumeQuotaClassesTest-413694426-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3883b746a4f74e2fa3d5def1a31845af', 'request_id': 'req-689ec377-9a08-403c-8042-c03039d4f589'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:49:03.568492 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-689ec377-9a08-403c-8042-c03039d4f589 tempest-VolumeQuotaClassesTest-413694426 tempest-VolumeQuotaClassesTest-413694426-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3883b746a4f74e2fa3d5def1a31845af', 'request_id': 'req-689ec377-9a08-403c-8042-c03039d4f589'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:49:03.589259 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-689ec377-9a08-403c-8042-c03039d4f589 tempest-VolumeQuotaClassesTest-413694426 tempest-VolumeQuotaClassesTest-413694426-project-admin] The token cache is being invalidate because project 3883b746a4f74e2fa3d5def1a31845af was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87956) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 00:49:03.589568 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-689ec377-9a08-403c-8042-c03039d4f589 tempest-VolumeQuotaClassesTest-413694426 tempest-VolumeQuotaClassesTest-413694426-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:49:03.592433 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-689ec377-9a08-403c-8042-c03039d4f589 tempest-VolumeQuotaClassesTest-413694426 tempest-VolumeQuotaClassesTest-413694426-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:49:03.596388 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 803/1590] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 30 00:49:03 2022] DELETE /identity/v3/projects/3883b746a4f74e2fa3d5def1a31845af => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 00:49:03.597355 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689ec377-9a08-403c-8042-c03039d4f589 tempest-VolumeQuotaClassesTest-413694426 tempest-VolumeQuotaClassesTest-413694426-project-admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:49:03.609598 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-689ec377-9a08-403c-8042-c03039d4f589 tempest-VolumeQuotaClassesTest-413694426 tempest-VolumeQuotaClassesTest-413694426-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:49:03.663972 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49eef7d3-e5a0-42d7-8117-9eb2a15cbe28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:49:03.663972 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49eef7d3-e5a0-42d7-8117-9eb2a15cbe28 admin admin] REQUEST_METHOD: `POST` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:03.663972 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49eef7d3-e5a0-42d7-8117-9eb2a15cbe28 admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:03.663972 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49eef7d3-e5a0-42d7-8117-9eb2a15cbe28 admin admin] PATH_INFO: `/v3/projects` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:03.665086 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49eef7d3-e5a0-42d7-8117-9eb2a15cbe28 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:49:03.671037 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49eef7d3-e5a0-42d7-8117-9eb2a15cbe28 admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:49:03.676998 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:49:03.739257 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 788/1591] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 30 00:49:03 2022] POST /identity/v3/projects => generated 381 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 00:49:03.743400 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49eef7d3-e5a0-42d7-8117-9eb2a15cbe28 admin admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:49:03.745215 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-49eef7d3-e5a0-42d7-8117-9eb2a15cbe28 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:49:03.746420 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689ec377-9a08-403c-8042-c03039d4f589 tempest-VolumeQuotaClassesTest-413694426 tempest-VolumeQuotaClassesTest-413694426-project-admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:49:03.835510 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd0cbc6-95fb-4c49-9280-5c9fb7f96ef4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:49:03.836334 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd0cbc6-95fb-4c49-9280-5c9fb7f96ef4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:03.838361 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd0cbc6-95fb-4c49-9280-5c9fb7f96ef4 admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:03.838880 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd0cbc6-95fb-4c49-9280-5c9fb7f96ef4 admin admin] PATH_INFO: `/v3/users/53ba56431a0940b3b7e5b9835653d377` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:03.840255 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd0cbc6-95fb-4c49-9280-5c9fb7f96ef4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=53ba56431a0940b3b7e5b9835653d377)` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:49:03.842346 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd0cbc6-95fb-4c49-9280-5c9fb7f96ef4 admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:49:03.883752 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49eef7d3-e5a0-42d7-8117-9eb2a15cbe28 admin admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:49:03.893890 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f7b0d1-98d7-4684-a69b-6d9dc54edda0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:49:03.894842 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f7b0d1-98d7-4684-a69b-6d9dc54edda0 admin admin] REQUEST_METHOD: `POST` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:03.895496 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f7b0d1-98d7-4684-a69b-6d9dc54edda0 admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:03.896481 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f7b0d1-98d7-4684-a69b-6d9dc54edda0 admin admin] PATH_INFO: `/v3/users` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:03.897631 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f7b0d1-98d7-4684-a69b-6d9dc54edda0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:49:03.901392 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f7b0d1-98d7-4684-a69b-6d9dc54edda0 admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:49:03.902345 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-5dd0cbc6-95fb-4c49-9280-5c9fb7f96ef4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '53ba56431a0940b3b7e5b9835653d377'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:49:03.903058 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-5dd0cbc6-95fb-4c49-9280-5c9fb7f96ef4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '53ba56431a0940b3b7e5b9835653d377'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:49:03.918247 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-5dd0cbc6-95fb-4c49-9280-5c9fb7f96ef4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '53ba56431a0940b3b7e5b9835653d377'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:49:03.928625 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-5dd0cbc6-95fb-4c49-9280-5c9fb7f96ef4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '53ba56431a0940b3b7e5b9835653d377'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:49:03.934272 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 789/1592] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 30 00:49:03 2022] POST /identity/v3/users => generated 297 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 00:49:03.938286 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f7b0d1-98d7-4684-a69b-6d9dc54edda0 admin admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:49:03.941502 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-50f7b0d1-98d7-4684-a69b-6d9dc54edda0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:49:03.941838 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-5dd0cbc6-95fb-4c49-9280-5c9fb7f96ef4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '53ba56431a0940b3b7e5b9835653d377'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:49:03.955836 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 804/1593] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 30 00:49:03 2022] DELETE /identity/v3/users/53ba56431a0940b3b7e5b9835653d377 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 00:49:03.957714 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f7b0d1-98d7-4684-a69b-6d9dc54edda0 admin admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:49:03.969353 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd0cbc6-95fb-4c49-9280-5c9fb7f96ef4 admin admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:49:03.970972 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-5dd0cbc6-95fb-4c49-9280-5c9fb7f96ef4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:49:04.010369 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:49:04.028059 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6fbece-9078-4274-b095-d4d5dc2e04ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:49:04.028726 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6fbece-9078-4274-b095-d4d5dc2e04ef admin admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:04.029005 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6fbece-9078-4274-b095-d4d5dc2e04ef admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:04.029277 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6fbece-9078-4274-b095-d4d5dc2e04ef admin admin] PATH_INFO: `/v3/roles` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:04.029919 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6fbece-9078-4274-b095-d4d5dc2e04ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:49:04.032731 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6fbece-9078-4274-b095-d4d5dc2e04ef admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:49:04.034360 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:49:04.048600 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd0cbc6-95fb-4c49-9280-5c9fb7f96ef4 admin admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:49:04.054077 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 790/1594] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 30 00:49:03 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 30 00:49:04.058450 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6fbece-9078-4274-b095-d4d5dc2e04ef admin admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:49:04.061189 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6d35c9-1ea4-451e-bdcd-03f66bb06108 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:49:04.062752 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6d35c9-1ea4-451e-bdcd-03f66bb06108 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:04.063185 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6d35c9-1ea4-451e-bdcd-03f66bb06108 admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:04.063704 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6d35c9-1ea4-451e-bdcd-03f66bb06108 admin admin] PATH_INFO: `/v3/users/68945b4022224eee92001c024ba4f865` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:04.065239 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6d35c9-1ea4-451e-bdcd-03f66bb06108 admin admin] RBAC: Authorizing `identity:delete_user(user_id=68945b4022224eee92001c024ba4f865)` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:49:04.069352 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6d35c9-1ea4-451e-bdcd-03f66bb06108 admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:49:04.074437 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6fbece-9078-4274-b095-d4d5dc2e04ef admin admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:49:04.083906 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a1d0ea-0912-4cbe-99e1-7889d680261e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:49:04.084584 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a1d0ea-0912-4cbe-99e1-7889d680261e admin admin] REQUEST_METHOD: `PUT` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:04.084994 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a1d0ea-0912-4cbe-99e1-7889d680261e admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:04.085401 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a1d0ea-0912-4cbe-99e1-7889d680261e admin admin] PATH_INFO: `/v3/projects/4ebd7b7f2cc64d33871400762d1ebb95/users/2906d39c9939460a9ccca41addac7055/roles/6ccaa8c11f29456fb4e4eeccb21616c7` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:04.102673 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a1d0ea-0912-4cbe-99e1-7889d680261e admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ebd7b7f2cc64d33871400762d1ebb95, user_id=2906d39c9939460a9ccca41addac7055, role_id=6ccaa8c11f29456fb4e4eeccb21616c7)` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:49:04.105617 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a1d0ea-0912-4cbe-99e1-7889d680261e admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:49:04.124947 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 791/1595] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 30 00:49:04 2022] PUT /identity/v3/projects/4ebd7b7f2cc64d33871400762d1ebb95/users/2906d39c9939460a9ccca41addac7055/roles/6ccaa8c11f29456fb4e4eeccb21616c7 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 00:49:04.126186 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a1d0ea-0912-4cbe-99e1-7889d680261e admin admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:49:04.153170 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-0f6d35c9-1ea4-451e-bdcd-03f66bb06108 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '68945b4022224eee92001c024ba4f865'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:49:04.153884 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-0f6d35c9-1ea4-451e-bdcd-03f66bb06108 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '68945b4022224eee92001c024ba4f865'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:49:04.177129 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-0f6d35c9-1ea4-451e-bdcd-03f66bb06108 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '68945b4022224eee92001c024ba4f865'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:49:04.189257 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-0f6d35c9-1ea4-451e-bdcd-03f66bb06108 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '68945b4022224eee92001c024ba4f865'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:49:04.203458 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-0f6d35c9-1ea4-451e-bdcd-03f66bb06108 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '68945b4022224eee92001c024ba4f865'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:49:04.212080 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 805/1596] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 30 00:49:03 2022] DELETE /identity/v3/users/68945b4022224eee92001c024ba4f865 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 00:49:04.214396 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f66161-e939-4aa2-ba7a-b895da785081 None None] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:04.214901 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f66161-e939-4aa2-ba7a-b895da785081 None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:04.215183 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f66161-e939-4aa2-ba7a-b895da785081 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:04.229810 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a1d0ea-0912-4cbe-99e1-7889d680261e admin admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:49:04.240925 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.auth.core [None req-70f66161-e939-4aa2-ba7a-b895da785081 None None] MFA Rules not processed for user `eb55b6cbca4945abb21b0e49eb745e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=87956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:49:04.243140 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-70f66161-e939-4aa2-ba7a-b895da785081 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:49:04.301267 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19430d58-e008-4cc0-b987-c82c276a08af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:49:04.302032 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19430d58-e008-4cc0-b987-c82c276a08af admin admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:04.302387 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19430d58-e008-4cc0-b987-c82c276a08af admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:04.302593 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19430d58-e008-4cc0-b987-c82c276a08af admin admin] PATH_INFO: `/v3/roles` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:04.303461 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19430d58-e008-4cc0-b987-c82c276a08af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:49:04.305596 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19430d58-e008-4cc0-b987-c82c276a08af admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:49:04.322014 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 792/1597] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 30 00:49:04 2022] GET /identity/v3/roles => generated 1420 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 30 00:49:04.322948 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19430d58-e008-4cc0-b987-c82c276a08af admin admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:49:04.325014 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-19430d58-e008-4cc0-b987-c82c276a08af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:49:04.339269 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19430d58-e008-4cc0-b987-c82c276a08af admin admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:49:04.345167 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 806/1598] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 30 00:49:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:49:04.347732 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d91c9e6-ae6d-4ea6-aa95-fe6db169ef38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:49:04.348677 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d91c9e6-ae6d-4ea6-aa95-fe6db169ef38 admin admin] REQUEST_METHOD: `PUT` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:04.349052 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d91c9e6-ae6d-4ea6-aa95-fe6db169ef38 admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:04.349435 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d91c9e6-ae6d-4ea6-aa95-fe6db169ef38 admin admin] PATH_INFO: `/v3/projects/4ebd7b7f2cc64d33871400762d1ebb95/users/2906d39c9939460a9ccca41addac7055/roles/6ccaa8c11f29456fb4e4eeccb21616c7` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:04.351974 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d91c9e6-ae6d-4ea6-aa95-fe6db169ef38 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ebd7b7f2cc64d33871400762d1ebb95, user_id=2906d39c9939460a9ccca41addac7055, role_id=6ccaa8c11f29456fb4e4eeccb21616c7)` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:49:04.355245 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f66161-e939-4aa2-ba7a-b895da785081 None None] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:49:04.357125 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-70f66161-e939-4aa2-ba7a-b895da785081 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:49:04.362898 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d91c9e6-ae6d-4ea6-aa95-fe6db169ef38 admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:49:04.375236 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 793/1599] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 30 00:49:04 2022] PUT /identity/v3/projects/4ebd7b7f2cc64d33871400762d1ebb95/users/2906d39c9939460a9ccca41addac7055/roles/6ccaa8c11f29456fb4e4eeccb21616c7 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 00:49:04.387599 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc837ce6-3b33-4bc1-96c3-ee92b0525cc9 None None] REQUEST_METHOD: `POST` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:04.388218 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc837ce6-3b33-4bc1-96c3-ee92b0525cc9 None None] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:04.388586 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc837ce6-3b33-4bc1-96c3-ee92b0525cc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:04.435255 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.auth.core [None req-cc837ce6-3b33-4bc1-96c3-ee92b0525cc9 None None] MFA Rules not processed for user `2906d39c9939460a9ccca41addac7055`. Rule list: `[]` (Enabled: `True`). {{(pid=87955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:49:04.437809 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-cc837ce6-3b33-4bc1-96c3-ee92b0525cc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:49:04.487166 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f66161-e939-4aa2-ba7a-b895da785081 None None] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:49:04.530600 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:49:04.537943 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:49:04.569972 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419e2ad5-448b-4204-b029-ceb30fb9902f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5693f186c6ad4d9394f02ee3477cdcd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d2387fdf794d4eaef07bbcd7b39f2a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:49:04.570585 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419e2ad5-448b-4204-b029-ceb30fb9902f service neutron] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:04.570862 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419e2ad5-448b-4204-b029-ceb30fb9902f service neutron] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:04.571124 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419e2ad5-448b-4204-b029-ceb30fb9902f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:04.591005 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 794/1600] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 30 00:49:04 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 30 00:49:04.591922 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc837ce6-3b33-4bc1-96c3-ee92b0525cc9 None None] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:49:04.607624 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-cc837ce6-3b33-4bc1-96c3-ee92b0525cc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:49:04.673727 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419e2ad5-448b-4204-b029-ceb30fb9902f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:49:04.675175 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419e2ad5-448b-4204-b029-ceb30fb9902f service neutron] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:49:04.693625 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 807/1601] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 30 00:49:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 30 00:49:04.696840 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419e2ad5-448b-4204-b029-ceb30fb9902f service neutron] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:49:04.703766 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-419e2ad5-448b-4204-b029-ceb30fb9902f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:49:04.765109 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc837ce6-3b33-4bc1-96c3-ee92b0525cc9 None None] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:49:04.771517 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f942f07-e791-41f5-8d53-57996cc88267 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:49:04.772171 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f942f07-e791-41f5-8d53-57996cc88267 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:04.772453 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f942f07-e791-41f5-8d53-57996cc88267 admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:04.772727 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f942f07-e791-41f5-8d53-57996cc88267 admin admin] PATH_INFO: `/v3/projects/220fa9ac94e94c77b6d09bb8dc401eca` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:04.774330 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f942f07-e791-41f5-8d53-57996cc88267 admin admin] RBAC: Authorizing `identity:delete_project(project_id=220fa9ac94e94c77b6d09bb8dc401eca)` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:49:04.777078 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f942f07-e791-41f5-8d53-57996cc88267 admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:49:04.809441 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419e2ad5-448b-4204-b029-ceb30fb9902f service neutron] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:49:04.813649 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b79f768-8b52-4bfe-baad-18dac3161a3f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48d928ff7fe24348ac900f09c56acc20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d2387fdf794d4eaef07bbcd7b39f2a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:49:04.814299 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b79f768-8b52-4bfe-baad-18dac3161a3f service cinder] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:04.814912 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b79f768-8b52-4bfe-baad-18dac3161a3f service cinder] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:04.815131 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b79f768-8b52-4bfe-baad-18dac3161a3f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:04.827474 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b79f768-8b52-4bfe-baad-18dac3161a3f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:49:04.829369 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b79f768-8b52-4bfe-baad-18dac3161a3f service cinder] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:49:04.842491 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 808/1602] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 30 00:49:04 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 00:49:04.857805 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-1f942f07-e791-41f5-8d53-57996cc88267 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '220fa9ac94e94c77b6d09bb8dc401eca', 'request_id': 'req-1f942f07-e791-41f5-8d53-57996cc88267'} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:49:04.874523 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-1f942f07-e791-41f5-8d53-57996cc88267 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '220fa9ac94e94c77b6d09bb8dc401eca', 'request_id': 'req-1f942f07-e791-41f5-8d53-57996cc88267'} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:49:04.889171 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-1f942f07-e791-41f5-8d53-57996cc88267 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '220fa9ac94e94c77b6d09bb8dc401eca', 'request_id': 'req-1f942f07-e791-41f5-8d53-57996cc88267'} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:49:04.903844 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-1f942f07-e791-41f5-8d53-57996cc88267 admin admin] The token cache is being invalidate because project 220fa9ac94e94c77b6d09bb8dc401eca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87955) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 00:49:04.904128 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-1f942f07-e791-41f5-8d53-57996cc88267 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:49:04.905034 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-1f942f07-e791-41f5-8d53-57996cc88267 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:49:04.914199 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 795/1603] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 30 00:49:04 2022] DELETE /identity/v3/projects/220fa9ac94e94c77b6d09bb8dc401eca => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 00:49:04.916713 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56774906-fdcb-48be-9d5c-fc539fcb3ae6 None None] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:04.916713 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56774906-fdcb-48be-9d5c-fc539fcb3ae6 None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:04.916978 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56774906-fdcb-48be-9d5c-fc539fcb3ae6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:04.947575 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.auth.core [None req-56774906-fdcb-48be-9d5c-fc539fcb3ae6 None None] MFA Rules not processed for user `eb55b6cbca4945abb21b0e49eb745e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=87956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:49:04.949053 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-56774906-fdcb-48be-9d5c-fc539fcb3ae6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:49:04.988661 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f942f07-e791-41f5-8d53-57996cc88267 admin admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:49:04.990242 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-1f942f07-e791-41f5-8d53-57996cc88267 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:49:05.043771 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 809/1604] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 30 00:49:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:49:05.052213 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7b61ab-e810-4f5f-aa1b-184a0f0b8216 None None] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:05.053268 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7b61ab-e810-4f5f-aa1b-184a0f0b8216 None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:05.053268 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7b61ab-e810-4f5f-aa1b-184a0f0b8216 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:05.074269 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f942f07-e791-41f5-8d53-57996cc88267 admin admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:49:05.080224 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32681257-1124-403e-99af-ae43a6238836 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48d928ff7fe24348ac900f09c56acc20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d2387fdf794d4eaef07bbcd7b39f2a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:49:05.080867 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32681257-1124-403e-99af-ae43a6238836 service cinder] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:05.081148 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32681257-1124-403e-99af-ae43a6238836 service cinder] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:05.081422 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32681257-1124-403e-99af-ae43a6238836 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:05.083378 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-32681257-1124-403e-99af-ae43a6238836 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:49:05.094507 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.auth.core [None req-ed7b61ab-e810-4f5f-aa1b-184a0f0b8216 None None] MFA Rules not processed for user `eb55b6cbca4945abb21b0e49eb745e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=87956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:49:05.096267 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-ed7b61ab-e810-4f5f-aa1b-184a0f0b8216 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:49:05.107752 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 810/1605] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 30 00:49:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:49:05.108511 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7b61ab-e810-4f5f-aa1b-184a0f0b8216 None None] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:49:05.109876 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-ed7b61ab-e810-4f5f-aa1b-184a0f0b8216 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:49:05.115431 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:49:05.139377 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7b61ab-e810-4f5f-aa1b-184a0f0b8216 None None] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:49:05.145260 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9d2f6c-d5a0-415a-b0d4-8f33e3efaaf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:49:05.145901 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9d2f6c-d5a0-415a-b0d4-8f33e3efaaf0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:05.146195 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9d2f6c-d5a0-415a-b0d4-8f33e3efaaf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:05.146460 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9d2f6c-d5a0-415a-b0d4-8f33e3efaaf0 admin admin] PATH_INFO: `/v3/projects/4118dae625164319bf92c75a1415df8e` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:05.147646 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9d2f6c-d5a0-415a-b0d4-8f33e3efaaf0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4118dae625164319bf92c75a1415df8e)` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:49:05.149564 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9d2f6c-d5a0-415a-b0d4-8f33e3efaaf0 admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:49:05.158909 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=100 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:49:05.176467 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32681257-1124-403e-99af-ae43a6238836 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:49:05.178282 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32681257-1124-403e-99af-ae43a6238836 service cinder] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:49:05.191916 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 796/1606] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 30 00:49:04 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 30 00:49:05.193077 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32681257-1124-403e-99af-ae43a6238836 service cinder] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:49:05.207508 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32681257-1124-403e-99af-ae43a6238836 service cinder] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:49:05.235865 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-cd9d2f6c-d5a0-415a-b0d4-8f33e3efaaf0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4118dae625164319bf92c75a1415df8e', 'request_id': 'req-cd9d2f6c-d5a0-415a-b0d4-8f33e3efaaf0'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:49:05.253486 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-cd9d2f6c-d5a0-415a-b0d4-8f33e3efaaf0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4118dae625164319bf92c75a1415df8e', 'request_id': 'req-cd9d2f6c-d5a0-415a-b0d4-8f33e3efaaf0'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:49:05.261883 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-cd9d2f6c-d5a0-415a-b0d4-8f33e3efaaf0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4118dae625164319bf92c75a1415df8e', 'request_id': 'req-cd9d2f6c-d5a0-415a-b0d4-8f33e3efaaf0'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:49:05.275436 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-cd9d2f6c-d5a0-415a-b0d4-8f33e3efaaf0 admin admin] The token cache is being invalidate because project 4118dae625164319bf92c75a1415df8e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87956) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 00:49:05.275821 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-cd9d2f6c-d5a0-415a-b0d4-8f33e3efaaf0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:49:05.276710 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-cd9d2f6c-d5a0-415a-b0d4-8f33e3efaaf0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:49:05.279445 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 811/1607] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 30 00:49:05 2022] DELETE /identity/v3/projects/4118dae625164319bf92c75a1415df8e => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 00:49:05.283609 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9d2f6c-d5a0-415a-b0d4-8f33e3efaaf0 admin admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:49:05.285086 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-cd9d2f6c-d5a0-415a-b0d4-8f33e3efaaf0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:49:05.309697 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68a72f4-274c-48df-a0fa-7d8dc202f683 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:49:05.310347 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68a72f4-274c-48df-a0fa-7d8dc202f683 admin admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:05.310891 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68a72f4-274c-48df-a0fa-7d8dc202f683 admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:05.311115 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68a72f4-274c-48df-a0fa-7d8dc202f683 admin admin] PATH_INFO: `/v3/domains` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:05.321701 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68a72f4-274c-48df-a0fa-7d8dc202f683 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:49:05.322026 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68a72f4-274c-48df-a0fa-7d8dc202f683 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:49:05.323709 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68a72f4-274c-48df-a0fa-7d8dc202f683 admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:49:05.345933 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 797/1608] 10.222.0.42 () {58 vars in 1153 bytes} [Sun Oct 30 00:49:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:49:05.347677 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68a72f4-274c-48df-a0fa-7d8dc202f683 admin admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:49:05.352140 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-e68a72f4-274c-48df-a0fa-7d8dc202f683 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:49:05.365713 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68a72f4-274c-48df-a0fa-7d8dc202f683 admin admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:49:05.371971 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d67c125-c0ba-4af6-8084-e9d030746481 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:49:05.372585 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d67c125-c0ba-4af6-8084-e9d030746481 admin admin] REQUEST_METHOD: `POST` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:05.372863 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d67c125-c0ba-4af6-8084-e9d030746481 admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:05.373131 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d67c125-c0ba-4af6-8084-e9d030746481 admin admin] PATH_INFO: `/v3/projects` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:05.374374 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d67c125-c0ba-4af6-8084-e9d030746481 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:49:05.375901 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d67c125-c0ba-4af6-8084-e9d030746481 admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:49:05.398951 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9d2f6c-d5a0-415a-b0d4-8f33e3efaaf0 admin admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:49:05.408147 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3ed591-cdca-4d00-9b5b-0d9bd5a22d14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:49:05.408617 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3ed591-cdca-4d00-9b5b-0d9bd5a22d14 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:05.408963 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3ed591-cdca-4d00-9b5b-0d9bd5a22d14 admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:05.409523 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 798/1609] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 30 00:49:05 2022] POST /identity/v3/projects => generated 383 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 00:49:05.411400 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3ed591-cdca-4d00-9b5b-0d9bd5a22d14 admin admin] PATH_INFO: `/v3/users/382d65f623634804945b7c4eacb3f73f` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:05.413578 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d67c125-c0ba-4af6-8084-e9d030746481 admin admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:49:05.414585 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3ed591-cdca-4d00-9b5b-0d9bd5a22d14 admin admin] RBAC: Authorizing `identity:delete_user(user_id=382d65f623634804945b7c4eacb3f73f)` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:49:05.416574 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3ed591-cdca-4d00-9b5b-0d9bd5a22d14 admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:49:05.507015 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-ae3ed591-cdca-4d00-9b5b-0d9bd5a22d14 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '382d65f623634804945b7c4eacb3f73f'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:49:05.508601 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-ae3ed591-cdca-4d00-9b5b-0d9bd5a22d14 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '382d65f623634804945b7c4eacb3f73f'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:49:05.533352 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-ae3ed591-cdca-4d00-9b5b-0d9bd5a22d14 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '382d65f623634804945b7c4eacb3f73f'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:49:05.546800 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-ae3ed591-cdca-4d00-9b5b-0d9bd5a22d14 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '382d65f623634804945b7c4eacb3f73f'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:49:05.553208 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d67c125-c0ba-4af6-8084-e9d030746481 admin admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:49:05.558449 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-ae3ed591-cdca-4d00-9b5b-0d9bd5a22d14 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '382d65f623634804945b7c4eacb3f73f'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:49:05.561366 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9db154-94ac-46f0-98a9-01bf01af62cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:49:05.561743 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9db154-94ac-46f0-98a9-01bf01af62cb admin admin] REQUEST_METHOD: `POST` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:05.562018 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9db154-94ac-46f0-98a9-01bf01af62cb admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:05.562279 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9db154-94ac-46f0-98a9-01bf01af62cb admin admin] PATH_INFO: `/v3/users` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:05.562913 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9db154-94ac-46f0-98a9-01bf01af62cb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:49:05.564835 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9db154-94ac-46f0-98a9-01bf01af62cb admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:49:05.577451 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 812/1610] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 30 00:49:05 2022] DELETE /identity/v3/users/382d65f623634804945b7c4eacb3f73f => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 00:49:05.578459 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3ed591-cdca-4d00-9b5b-0d9bd5a22d14 admin admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:49:05.581963 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-ae3ed591-cdca-4d00-9b5b-0d9bd5a22d14 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:49:05.595243 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 799/1611] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 30 00:49:05 2022] POST /identity/v3/users => generated 292 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 00:49:05.599564 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9db154-94ac-46f0-98a9-01bf01af62cb admin admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:49:05.601782 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-7d9db154-94ac-46f0-98a9-01bf01af62cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:49:05.612593 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:49:05.617371 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9db154-94ac-46f0-98a9-01bf01af62cb admin admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:49:05.646058 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:49:05.688062 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3ed591-cdca-4d00-9b5b-0d9bd5a22d14 admin admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:49:05.697230 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e94109-6ad6-40ae-be51-8c2413ed77ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:49:05.697952 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e94109-6ad6-40ae-be51-8c2413ed77ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:05.702466 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e94109-6ad6-40ae-be51-8c2413ed77ea admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:05.702773 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e94109-6ad6-40ae-be51-8c2413ed77ea admin admin] PATH_INFO: `/v3/users/053417105dc34f25a8b59ef15e89afa7` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:05.704584 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e94109-6ad6-40ae-be51-8c2413ed77ea admin admin] RBAC: Authorizing `identity:delete_user(user_id=053417105dc34f25a8b59ef15e89afa7)` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:49:05.706548 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e94109-6ad6-40ae-be51-8c2413ed77ea admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:49:05.730078 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fff389-289e-44ac-afbf-bac8dc4ae8d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:49:05.730692 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fff389-289e-44ac-afbf-bac8dc4ae8d9 admin admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:05.730974 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fff389-289e-44ac-afbf-bac8dc4ae8d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:05.731271 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fff389-289e-44ac-afbf-bac8dc4ae8d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:05.731926 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00fff389-289e-44ac-afbf-bac8dc4ae8d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:49:05.733609 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00fff389-289e-44ac-afbf-bac8dc4ae8d9 admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:49:05.757641 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 800/1612] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 30 00:49:05 2022] GET /identity/v3/roles => generated 1420 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 00:49:05.761048 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fff389-289e-44ac-afbf-bac8dc4ae8d9 admin admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:49:05.785127 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fff389-289e-44ac-afbf-bac8dc4ae8d9 admin admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:49:05.798822 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a725db7a-42ac-44ed-96ce-d63c8a3dc647 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:49:05.799687 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a725db7a-42ac-44ed-96ce-d63c8a3dc647 admin admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:05.799807 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a725db7a-42ac-44ed-96ce-d63c8a3dc647 admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:05.800012 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a725db7a-42ac-44ed-96ce-d63c8a3dc647 admin admin] PATH_INFO: `/v3/roles` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:05.800666 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a725db7a-42ac-44ed-96ce-d63c8a3dc647 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:49:05.802540 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a725db7a-42ac-44ed-96ce-d63c8a3dc647 admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:49:05.823829 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-12e94109-6ad6-40ae-be51-8c2413ed77ea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '053417105dc34f25a8b59ef15e89afa7'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:49:05.826129 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-12e94109-6ad6-40ae-be51-8c2413ed77ea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '053417105dc34f25a8b59ef15e89afa7'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:49:05.827176 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 801/1613] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 30 00:49:05 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 00:49:05.831173 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a725db7a-42ac-44ed-96ce-d63c8a3dc647 admin admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:49:05.834603 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-a725db7a-42ac-44ed-96ce-d63c8a3dc647 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:49:05.858548 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-12e94109-6ad6-40ae-be51-8c2413ed77ea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '053417105dc34f25a8b59ef15e89afa7'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:49:05.864451 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a725db7a-42ac-44ed-96ce-d63c8a3dc647 admin admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:49:05.873180 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-12e94109-6ad6-40ae-be51-8c2413ed77ea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '053417105dc34f25a8b59ef15e89afa7'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:49:05.878259 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b4341b-1bb4-4236-a948-a1d611ec35b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:49:05.879017 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b4341b-1bb4-4236-a948-a1d611ec35b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:05.879419 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b4341b-1bb4-4236-a948-a1d611ec35b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:05.879843 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b4341b-1bb4-4236-a948-a1d611ec35b3 admin admin] PATH_INFO: `/v3/projects/aba861332bea486c993020af7d37cb47/users/2cb1cfdeaeb74da9bb9643c91ca00f0a/roles/1c93019874174c4b91118d9ce2347e47` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:05.900229 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-12e94109-6ad6-40ae-be51-8c2413ed77ea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '053417105dc34f25a8b59ef15e89afa7'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:49:05.907695 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b4341b-1bb4-4236-a948-a1d611ec35b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aba861332bea486c993020af7d37cb47, user_id=2cb1cfdeaeb74da9bb9643c91ca00f0a, role_id=1c93019874174c4b91118d9ce2347e47)` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:49:05.910736 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b4341b-1bb4-4236-a948-a1d611ec35b3 admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:49:05.912089 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 813/1614] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 30 00:49:05 2022] DELETE /identity/v3/users/053417105dc34f25a8b59ef15e89afa7 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 00:49:05.917096 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c38ab80-1f1a-45df-9ba0-4757ee84103c None None] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:05.917529 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c38ab80-1f1a-45df-9ba0-4757ee84103c None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:05.917893 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c38ab80-1f1a-45df-9ba0-4757ee84103c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:05.938390 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 802/1615] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 30 00:49:05 2022] PUT /identity/v3/projects/aba861332bea486c993020af7d37cb47/users/2cb1cfdeaeb74da9bb9643c91ca00f0a/roles/1c93019874174c4b91118d9ce2347e47 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 00:49:05.961354 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9e40ba-ee53-4dac-94cd-d65ed50b5825 None None] REQUEST_METHOD: `POST` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:05.961639 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9e40ba-ee53-4dac-94cd-d65ed50b5825 None None] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:05.961909 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9e40ba-ee53-4dac-94cd-d65ed50b5825 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:05.967625 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.auth.core [None req-3c38ab80-1f1a-45df-9ba0-4757ee84103c None None] MFA Rules not processed for user `eb55b6cbca4945abb21b0e49eb745e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=87956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:49:05.969063 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-3c38ab80-1f1a-45df-9ba0-4757ee84103c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:49:06.061748 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.auth.core [None req-1d9e40ba-ee53-4dac-94cd-d65ed50b5825 None None] MFA Rules not processed for user `2cb1cfdeaeb74da9bb9643c91ca00f0a`. Rule list: `[]` (Enabled: `True`). {{(pid=87955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:49:06.064700 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-1d9e40ba-ee53-4dac-94cd-d65ed50b5825 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:49:06.133110 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 814/1616] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 30 00:49:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 30 00:49:06.135276 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c38ab80-1f1a-45df-9ba0-4757ee84103c None None] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:49:06.138697 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-3c38ab80-1f1a-45df-9ba0-4757ee84103c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:49:06.169015 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c38ab80-1f1a-45df-9ba0-4757ee84103c None None] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:49:06.181056 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe19bd58-359b-4bd2-80e0-7cf11353b810 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:49:06.181834 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe19bd58-359b-4bd2-80e0-7cf11353b810 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:06.184649 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe19bd58-359b-4bd2-80e0-7cf11353b810 admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:06.184839 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe19bd58-359b-4bd2-80e0-7cf11353b810 admin admin] PATH_INFO: `/v3/projects/9d08bdfb2a954e3bbb4c190aa43647c9` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:06.186518 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe19bd58-359b-4bd2-80e0-7cf11353b810 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9d08bdfb2a954e3bbb4c190aa43647c9)` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:49:06.191517 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe19bd58-359b-4bd2-80e0-7cf11353b810 admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:49:06.249958 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 803/1617] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 30 00:49:05 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:49:06.249958 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9e40ba-ee53-4dac-94cd-d65ed50b5825 None None] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:49:06.251710 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:49:06.255460 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-1d9e40ba-ee53-4dac-94cd-d65ed50b5825 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:49:06.280223 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-fe19bd58-359b-4bd2-80e0-7cf11353b810 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9d08bdfb2a954e3bbb4c190aa43647c9', 'request_id': 'req-fe19bd58-359b-4bd2-80e0-7cf11353b810'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:49:06.303006 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-fe19bd58-359b-4bd2-80e0-7cf11353b810 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9d08bdfb2a954e3bbb4c190aa43647c9', 'request_id': 'req-fe19bd58-359b-4bd2-80e0-7cf11353b810'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:49:06.321753 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-fe19bd58-359b-4bd2-80e0-7cf11353b810 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9d08bdfb2a954e3bbb4c190aa43647c9', 'request_id': 'req-fe19bd58-359b-4bd2-80e0-7cf11353b810'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:49:06.336251 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-fe19bd58-359b-4bd2-80e0-7cf11353b810 admin admin] The token cache is being invalidate because project 9d08bdfb2a954e3bbb4c190aa43647c9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87956) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 00:49:06.336580 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-fe19bd58-359b-4bd2-80e0-7cf11353b810 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:49:06.337634 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-fe19bd58-359b-4bd2-80e0-7cf11353b810 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:49:06.340445 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 815/1618] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 30 00:49:06 2022] DELETE /identity/v3/projects/9d08bdfb2a954e3bbb4c190aa43647c9 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 00:49:06.344084 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe19bd58-359b-4bd2-80e0-7cf11353b810 admin admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:49:06.345596 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-fe19bd58-359b-4bd2-80e0-7cf11353b810 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:49:06.354234 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9e40ba-ee53-4dac-94cd-d65ed50b5825 None None] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:49:06.383644 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:49:06.419750 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe19bd58-359b-4bd2-80e0-7cf11353b810 admin admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:49:06.425081 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9dbe76-eb6e-443e-9f19-936c43d17107 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:49:06.425728 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9dbe76-eb6e-443e-9f19-936c43d17107 admin admin] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:06.426011 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9dbe76-eb6e-443e-9f19-936c43d17107 admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:06.426285 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9dbe76-eb6e-443e-9f19-936c43d17107 admin admin] PATH_INFO: `/v3/projects` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:06.426943 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9dbe76-eb6e-443e-9f19-936c43d17107 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:49:06.428260 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc65633-2c41-4bc1-abea-45a3ecd3b057 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5693f186c6ad4d9394f02ee3477cdcd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d2387fdf794d4eaef07bbcd7b39f2a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:49:06.428861 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc65633-2c41-4bc1-abea-45a3ecd3b057 service neutron] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:06.428969 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9dbe76-eb6e-443e-9f19-936c43d17107 admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:49:06.429127 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc65633-2c41-4bc1-abea-45a3ecd3b057 service neutron] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:06.429390 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc65633-2c41-4bc1-abea-45a3ecd3b057 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:06.431075 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-dbc65633-2c41-4bc1-abea-45a3ecd3b057 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:49:06.442975 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc65633-2c41-4bc1-abea-45a3ecd3b057 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:49:06.444432 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc65633-2c41-4bc1-abea-45a3ecd3b057 service neutron] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:49:06.455693 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 804/1619] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 30 00:49:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 00:49:06.456915 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb4e2b8-3c6c-4d73-98da-89dd0c1fe6d5 None None] REQUEST_METHOD: `POST` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:06.457192 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb4e2b8-3c6c-4d73-98da-89dd0c1fe6d5 None None] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:06.457456 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb4e2b8-3c6c-4d73-98da-89dd0c1fe6d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:06.460425 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 816/1620] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 30 00:49:06 2022] POST /identity/v3/projects => generated 387 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 00:49:06.464220 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9dbe76-eb6e-443e-9f19-936c43d17107 admin admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:49:06.481987 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.auth.core [None req-1cb4e2b8-3c6c-4d73-98da-89dd0c1fe6d5 None None] MFA Rules not processed for user `eb55b6cbca4945abb21b0e49eb745e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=87955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:49:06.483271 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-1cb4e2b8-3c6c-4d73-98da-89dd0c1fe6d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:49:06.536270 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9dbe76-eb6e-443e-9f19-936c43d17107 admin admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:49:06.542575 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e2f12b-2117-438b-ae06-dfd9791342a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:49:06.543457 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e2f12b-2117-438b-ae06-dfd9791342a9 admin admin] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:06.543813 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e2f12b-2117-438b-ae06-dfd9791342a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:06.544211 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e2f12b-2117-438b-ae06-dfd9791342a9 admin admin] PATH_INFO: `/v3/users` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:06.544807 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e2f12b-2117-438b-ae06-dfd9791342a9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:49:06.547058 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e2f12b-2117-438b-ae06-dfd9791342a9 admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:49:06.555722 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 805/1621] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 30 00:49:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:49:06.564017 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b99105-2b1a-4134-8224-7d78d9aaf26a None None] REQUEST_METHOD: `POST` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:06.564460 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b99105-2b1a-4134-8224-7d78d9aaf26a None None] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:06.564880 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b99105-2b1a-4134-8224-7d78d9aaf26a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:06.571516 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 817/1622] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 30 00:49:06 2022] POST /identity/v3/users => generated 300 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 30 00:49:06.576110 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e2f12b-2117-438b-ae06-dfd9791342a9 admin admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:49:06.586253 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e2f12b-2117-438b-ae06-dfd9791342a9 admin admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:49:06.589829 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.auth.core [None req-13b99105-2b1a-4134-8224-7d78d9aaf26a None None] MFA Rules not processed for user `eb55b6cbca4945abb21b0e49eb745e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=87955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:49:06.591193 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-13b99105-2b1a-4134-8224-7d78d9aaf26a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:49:06.592564 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afcdcf8-69a6-4d6f-b375-588067a5ca70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:49:06.593251 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afcdcf8-69a6-4d6f-b375-588067a5ca70 admin admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:06.593524 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afcdcf8-69a6-4d6f-b375-588067a5ca70 admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:06.593938 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afcdcf8-69a6-4d6f-b375-588067a5ca70 admin admin] PATH_INFO: `/v3/roles` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:06.594649 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afcdcf8-69a6-4d6f-b375-588067a5ca70 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:49:06.596329 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afcdcf8-69a6-4d6f-b375-588067a5ca70 admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:49:06.614291 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 818/1623] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 30 00:49:06 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 00:49:06.614291 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afcdcf8-69a6-4d6f-b375-588067a5ca70 admin admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:49:06.624700 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afcdcf8-69a6-4d6f-b375-588067a5ca70 admin admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:49:06.630739 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 806/1624] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 30 00:49:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:49:06.635459 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb86bda5-bb5f-4e73-a7d6-44359cd4bc4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:49:06.636593 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb86bda5-bb5f-4e73-a7d6-44359cd4bc4b admin admin] REQUEST_METHOD: `PUT` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:06.636805 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b99105-2b1a-4134-8224-7d78d9aaf26a None None] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:49:06.636915 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb86bda5-bb5f-4e73-a7d6-44359cd4bc4b admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:06.637228 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb86bda5-bb5f-4e73-a7d6-44359cd4bc4b admin admin] PATH_INFO: `/v3/projects/ebdae593eb1f406a8df32ac89361178f/users/37d9e20b3ec647a0bd16a02c2200e1a7/roles/6ccaa8c11f29456fb4e4eeccb21616c7` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:06.659253 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb86bda5-bb5f-4e73-a7d6-44359cd4bc4b admin admin] RBAC: Authorizing `identity:create_grant(project_id=ebdae593eb1f406a8df32ac89361178f, user_id=37d9e20b3ec647a0bd16a02c2200e1a7, role_id=6ccaa8c11f29456fb4e4eeccb21616c7)` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:49:06.660581 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b99105-2b1a-4134-8224-7d78d9aaf26a None None] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:49:06.663623 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb86bda5-bb5f-4e73-a7d6-44359cd4bc4b admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:49:06.673183 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235d341e-3a5a-4ac4-8107-bed0ba5abfde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:49:06.673822 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235d341e-3a5a-4ac4-8107-bed0ba5abfde admin admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:06.674100 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235d341e-3a5a-4ac4-8107-bed0ba5abfde admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:06.674476 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235d341e-3a5a-4ac4-8107-bed0ba5abfde admin admin] PATH_INFO: `/v3/domains` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:06.675603 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=89,keystone:DELETE=5,keystone:INSERT=6 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:49:06.677962 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235d341e-3a5a-4ac4-8107-bed0ba5abfde admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:49:06.678322 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235d341e-3a5a-4ac4-8107-bed0ba5abfde admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:49:06.680906 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235d341e-3a5a-4ac4-8107-bed0ba5abfde admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:49:06.684732 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 819/1625] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 30 00:49:06 2022] PUT /identity/v3/projects/ebdae593eb1f406a8df32ac89361178f/users/37d9e20b3ec647a0bd16a02c2200e1a7/roles/6ccaa8c11f29456fb4e4eeccb21616c7 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 00:49:06.689395 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb86bda5-bb5f-4e73-a7d6-44359cd4bc4b admin admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:49:06.708241 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 807/1626] 10.222.0.42 () {58 vars in 1153 bytes} [Sun Oct 30 00:49:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:49:06.712142 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235d341e-3a5a-4ac4-8107-bed0ba5abfde admin admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:49:06.727352 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235d341e-3a5a-4ac4-8107-bed0ba5abfde admin admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:49:06.771287 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb86bda5-bb5f-4e73-a7d6-44359cd4bc4b admin admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:49:06.776729 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e48610-84ae-4044-a2f8-8276be46ce9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:49:06.777359 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e48610-84ae-4044-a2f8-8276be46ce9e admin admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:06.777639 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e48610-84ae-4044-a2f8-8276be46ce9e admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:06.777918 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e48610-84ae-4044-a2f8-8276be46ce9e admin admin] PATH_INFO: `/v3/roles` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:06.778763 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e48610-84ae-4044-a2f8-8276be46ce9e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:49:06.780547 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e48610-84ae-4044-a2f8-8276be46ce9e admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:49:06.803843 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 820/1627] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 30 00:49:06 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 30 00:49:06.804830 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e48610-84ae-4044-a2f8-8276be46ce9e admin admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:49:06.807689 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-d1e48610-84ae-4044-a2f8-8276be46ce9e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:49:06.825091 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e48610-84ae-4044-a2f8-8276be46ce9e admin admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:49:06.830336 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50be8b2-fb5a-408b-99ca-bf2898153077 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:49:06.830636 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869c216d-2973-435a-a6cd-420ff2217cea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:49:06.831117 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50be8b2-fb5a-408b-99ca-bf2898153077 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:06.831268 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869c216d-2973-435a-a6cd-420ff2217cea admin admin] REQUEST_METHOD: `POST` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:06.831542 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869c216d-2973-435a-a6cd-420ff2217cea admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:06.831689 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50be8b2-fb5a-408b-99ca-bf2898153077 admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:06.831992 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869c216d-2973-435a-a6cd-420ff2217cea admin admin] PATH_INFO: `/v3/projects` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:06.832091 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50be8b2-fb5a-408b-99ca-bf2898153077 admin admin] PATH_INFO: `/v3/projects/d9ec9b5374d24b2f9c9d76492668b35e` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:06.832635 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869c216d-2973-435a-a6cd-420ff2217cea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:49:06.833549 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50be8b2-fb5a-408b-99ca-bf2898153077 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d9ec9b5374d24b2f9c9d76492668b35e)` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:49:06.834565 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869c216d-2973-435a-a6cd-420ff2217cea admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:49:06.835794 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50be8b2-fb5a-408b-99ca-bf2898153077 admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:49:06.873104 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 808/1628] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 30 00:49:06 2022] POST /identity/v3/projects => generated 381 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 00:49:06.873104 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869c216d-2973-435a-a6cd-420ff2217cea admin admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:49:06.901595 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-a50be8b2-fb5a-408b-99ca-bf2898153077 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd9ec9b5374d24b2f9c9d76492668b35e', 'request_id': 'req-a50be8b2-fb5a-408b-99ca-bf2898153077'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:49:06.912311 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-a50be8b2-fb5a-408b-99ca-bf2898153077 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd9ec9b5374d24b2f9c9d76492668b35e', 'request_id': 'req-a50be8b2-fb5a-408b-99ca-bf2898153077'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:49:06.922763 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-a50be8b2-fb5a-408b-99ca-bf2898153077 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd9ec9b5374d24b2f9c9d76492668b35e', 'request_id': 'req-a50be8b2-fb5a-408b-99ca-bf2898153077'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:49:06.932127 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:49:06.934766 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-a50be8b2-fb5a-408b-99ca-bf2898153077 admin admin] The token cache is being invalidate because project d9ec9b5374d24b2f9c9d76492668b35e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87956) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 00:49:06.935151 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-a50be8b2-fb5a-408b-99ca-bf2898153077 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:49:06.935999 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-a50be8b2-fb5a-408b-99ca-bf2898153077 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:49:06.938027 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 821/1629] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 30 00:49:06 2022] DELETE /identity/v3/projects/d9ec9b5374d24b2f9c9d76492668b35e => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 00:49:06.941839 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50be8b2-fb5a-408b-99ca-bf2898153077 admin admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:49:06.944088 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-a50be8b2-fb5a-408b-99ca-bf2898153077 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:49:06.967918 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869c216d-2973-435a-a6cd-420ff2217cea admin admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:49:07.033051 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50be8b2-fb5a-408b-99ca-bf2898153077 admin admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:49:07.039210 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24aa7d78-aa64-4c1a-9986-3cee58dfec65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:49:07.040502 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24aa7d78-aa64-4c1a-9986-3cee58dfec65 admin admin] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:07.040852 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24aa7d78-aa64-4c1a-9986-3cee58dfec65 admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:07.041284 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24aa7d78-aa64-4c1a-9986-3cee58dfec65 admin admin] PATH_INFO: `/v3/users` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:07.042189 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24aa7d78-aa64-4c1a-9986-3cee58dfec65 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:49:07.044187 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24aa7d78-aa64-4c1a-9986-3cee58dfec65 admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:49:07.048899 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f20030-da76-4900-ae27-b5055b04f4cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:49:07.049817 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f20030-da76-4900-ae27-b5055b04f4cd admin admin] REQUEST_METHOD: `PUT` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:07.050214 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f20030-da76-4900-ae27-b5055b04f4cd admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:07.050604 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f20030-da76-4900-ae27-b5055b04f4cd admin admin] PATH_INFO: `/v3/projects/ebdae593eb1f406a8df32ac89361178f/users/37d9e20b3ec647a0bd16a02c2200e1a7/roles/6ccaa8c11f29456fb4e4eeccb21616c7` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:07.053428 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f20030-da76-4900-ae27-b5055b04f4cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=ebdae593eb1f406a8df32ac89361178f, user_id=37d9e20b3ec647a0bd16a02c2200e1a7, role_id=6ccaa8c11f29456fb4e4eeccb21616c7)` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:49:07.056455 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f20030-da76-4900-ae27-b5055b04f4cd admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:49:07.072019 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 809/1630] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 30 00:49:06 2022] PUT /identity/v3/projects/ebdae593eb1f406a8df32ac89361178f/users/37d9e20b3ec647a0bd16a02c2200e1a7/roles/6ccaa8c11f29456fb4e4eeccb21616c7 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 00:49:07.081292 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 822/1631] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 30 00:49:06 2022] POST /identity/v3/users => generated 291 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 00:49:07.084037 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f20030-da76-4900-ae27-b5055b04f4cd admin admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:49:07.086210 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-22f20030-da76-4900-ae27-b5055b04f4cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:49:07.088054 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732a2bbc-2006-467d-95b6-5ad83a7ff833 None None] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:07.088500 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732a2bbc-2006-467d-95b6-5ad83a7ff833 None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:07.102202 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732a2bbc-2006-467d-95b6-5ad83a7ff833 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:07.122059 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:49:07.143240 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.auth.core [None req-732a2bbc-2006-467d-95b6-5ad83a7ff833 None None] MFA Rules not processed for user `37d9e20b3ec647a0bd16a02c2200e1a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:49:07.144668 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-732a2bbc-2006-467d-95b6-5ad83a7ff833 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:49:07.169139 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f20030-da76-4900-ae27-b5055b04f4cd admin admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:49:07.174504 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7083da42-40e6-40aa-9cad-32916a2ddd9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:49:07.175152 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7083da42-40e6-40aa-9cad-32916a2ddd9e admin admin] REQUEST_METHOD: `DELETE` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:07.175925 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7083da42-40e6-40aa-9cad-32916a2ddd9e admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:07.176211 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7083da42-40e6-40aa-9cad-32916a2ddd9e admin admin] PATH_INFO: `/v3/users/2906d39c9939460a9ccca41addac7055` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:07.177680 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7083da42-40e6-40aa-9cad-32916a2ddd9e admin admin] RBAC: Authorizing `identity:delete_user(user_id=2906d39c9939460a9ccca41addac7055)` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:49:07.179945 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7083da42-40e6-40aa-9cad-32916a2ddd9e admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:49:07.251028 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 823/1632] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 30 00:49:07 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:49:07.251774 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732a2bbc-2006-467d-95b6-5ad83a7ff833 None None] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:49:07.261238 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-7083da42-40e6-40aa-9cad-32916a2ddd9e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2906d39c9939460a9ccca41addac7055'} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:49:07.261927 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-7083da42-40e6-40aa-9cad-32916a2ddd9e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2906d39c9939460a9ccca41addac7055'} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:49:07.264659 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732a2bbc-2006-467d-95b6-5ad83a7ff833 None None] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:49:07.270149 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5150c1f4-508f-4d2a-9ea3-edbeb7780495 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:49:07.279248 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5150c1f4-508f-4d2a-9ea3-edbeb7780495 admin admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:07.279248 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5150c1f4-508f-4d2a-9ea3-edbeb7780495 admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:07.279248 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5150c1f4-508f-4d2a-9ea3-edbeb7780495 admin admin] PATH_INFO: `/v3/roles` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:07.279544 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-7083da42-40e6-40aa-9cad-32916a2ddd9e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2906d39c9939460a9ccca41addac7055'} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:49:07.279662 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5150c1f4-508f-4d2a-9ea3-edbeb7780495 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:49:07.280432 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-7083da42-40e6-40aa-9cad-32916a2ddd9e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2906d39c9939460a9ccca41addac7055'} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:49:07.280603 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5150c1f4-508f-4d2a-9ea3-edbeb7780495 admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:49:07.287322 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-7083da42-40e6-40aa-9cad-32916a2ddd9e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2906d39c9939460a9ccca41addac7055'} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:49:07.287494 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 824/1633] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 30 00:49:07 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 00:49:07.288709 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5150c1f4-508f-4d2a-9ea3-edbeb7780495 admin admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:49:07.292050 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-5150c1f4-508f-4d2a-9ea3-edbeb7780495 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:49:07.299571 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:49:07.306516 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 810/1634] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 30 00:49:07 2022] DELETE /identity/v3/users/2906d39c9939460a9ccca41addac7055 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 00:49:07.310987 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7083da42-40e6-40aa-9cad-32916a2ddd9e admin admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:49:07.314041 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-7083da42-40e6-40aa-9cad-32916a2ddd9e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:49:07.403516 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7083da42-40e6-40aa-9cad-32916a2ddd9e admin admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:49:07.408891 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c43c68c-f514-44d5-a484-4fb59b2fac6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:49:07.409863 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c43c68c-f514-44d5-a484-4fb59b2fac6f admin admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:07.410154 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c43c68c-f514-44d5-a484-4fb59b2fac6f admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:07.411186 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c43c68c-f514-44d5-a484-4fb59b2fac6f admin admin] PATH_INFO: `/v3/roles` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:07.412888 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c43c68c-f514-44d5-a484-4fb59b2fac6f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:49:07.414728 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c43c68c-f514-44d5-a484-4fb59b2fac6f admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:49:07.429138 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 811/1635] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 30 00:49:07 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 00:49:07.430888 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c43c68c-f514-44d5-a484-4fb59b2fac6f admin admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:49:07.446245 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c43c68c-f514-44d5-a484-4fb59b2fac6f admin admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:49:07.448006 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5150c1f4-508f-4d2a-9ea3-edbeb7780495 admin admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:49:07.472431 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8afb74-7caf-4db2-b299-0963ff019d57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:49:07.473136 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8afb74-7caf-4db2-b299-0963ff019d57 admin admin] REQUEST_METHOD: `PUT` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:07.473411 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8afb74-7caf-4db2-b299-0963ff019d57 admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:07.473684 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8afb74-7caf-4db2-b299-0963ff019d57 admin admin] PATH_INFO: `/v3/projects/3587b0af52014115a157628fd7e91d5d/users/3208bf93593f4cfa854a6c99c626df6b/roles/1c93019874174c4b91118d9ce2347e47` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:07.510998 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8afb74-7caf-4db2-b299-0963ff019d57 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3587b0af52014115a157628fd7e91d5d, user_id=3208bf93593f4cfa854a6c99c626df6b, role_id=1c93019874174c4b91118d9ce2347e47)` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:49:07.535099 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8afb74-7caf-4db2-b299-0963ff019d57 admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:49:07.555555 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a500da-2f84-45e4-8928-01a75c40e0af service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48d928ff7fe24348ac900f09c56acc20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d2387fdf794d4eaef07bbcd7b39f2a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:49:07.556306 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a500da-2f84-45e4-8928-01a75c40e0af service cinder] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:07.556591 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a500da-2f84-45e4-8928-01a75c40e0af service cinder] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:07.556859 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a500da-2f84-45e4-8928-01a75c40e0af service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:07.558606 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-69a500da-2f84-45e4-8928-01a75c40e0af service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:49:07.569472 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 812/1636] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 30 00:49:07 2022] PUT /identity/v3/projects/3587b0af52014115a157628fd7e91d5d/users/3208bf93593f4cfa854a6c99c626df6b/roles/1c93019874174c4b91118d9ce2347e47 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 00:49:07.580454 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ba01d2-1572-4d40-b774-7bce71f901f4 None None] REQUEST_METHOD: `POST` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:07.580907 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ba01d2-1572-4d40-b774-7bce71f901f4 None None] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:07.581076 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ba01d2-1572-4d40-b774-7bce71f901f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:07.632988 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.auth.core [None req-e8ba01d2-1572-4d40-b774-7bce71f901f4 None None] MFA Rules not processed for user `3208bf93593f4cfa854a6c99c626df6b`. Rule list: `[]` (Enabled: `True`). {{(pid=87955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:49:07.633956 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-e8ba01d2-1572-4d40-b774-7bce71f901f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:49:07.658326 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=100 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:49:07.701337 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a500da-2f84-45e4-8928-01a75c40e0af service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:49:07.708206 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a500da-2f84-45e4-8928-01a75c40e0af service cinder] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:49:07.746750 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 825/1637] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 30 00:49:07 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 459 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 00:49:07.785614 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 813/1638] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 30 00:49:07 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:49:07.790211 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a500da-2f84-45e4-8928-01a75c40e0af service cinder] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:49:07.805491 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a500da-2f84-45e4-8928-01a75c40e0af service cinder] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:49:07.866889 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ba01d2-1572-4d40-b774-7bce71f901f4 None None] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:49:07.868487 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-e8ba01d2-1572-4d40-b774-7bce71f901f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:49:07.924018 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087cd52b-42f5-45ac-af8c-7183ae8ed67c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:49:07.924655 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087cd52b-42f5-45ac-af8c-7183ae8ed67c admin admin] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:07.924932 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087cd52b-42f5-45ac-af8c-7183ae8ed67c admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:07.925199 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087cd52b-42f5-45ac-af8c-7183ae8ed67c admin admin] PATH_INFO: `/v3/projects` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:07.925856 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087cd52b-42f5-45ac-af8c-7183ae8ed67c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:49:07.927866 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087cd52b-42f5-45ac-af8c-7183ae8ed67c admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:49:07.977153 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 826/1639] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 30 00:49:07 2022] POST /identity/v3/projects => generated 381 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 30 00:49:07.981981 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087cd52b-42f5-45ac-af8c-7183ae8ed67c admin admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:49:08.005368 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ba01d2-1572-4d40-b774-7bce71f901f4 None None] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:49:08.009818 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:49:08.081689 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087cd52b-42f5-45ac-af8c-7183ae8ed67c admin admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:49:08.086831 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f8e376-a60c-408c-9b2f-aac574302cac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:49:08.087482 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f8e376-a60c-408c-9b2f-aac574302cac admin admin] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:08.087755 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f8e376-a60c-408c-9b2f-aac574302cac admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:08.088022 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f8e376-a60c-408c-9b2f-aac574302cac admin admin] PATH_INFO: `/v3/users` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:08.088664 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f8e376-a60c-408c-9b2f-aac574302cac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:49:08.090865 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f8e376-a60c-408c-9b2f-aac574302cac admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:49:08.094520 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d92a30-c8e6-4a38-b7fc-c5a0582bb43c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:49:08.094751 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d92a30-c8e6-4a38-b7fc-c5a0582bb43c admin admin] REQUEST_METHOD: `DELETE` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:08.095031 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d92a30-c8e6-4a38-b7fc-c5a0582bb43c admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:08.095330 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d92a30-c8e6-4a38-b7fc-c5a0582bb43c admin admin] PATH_INFO: `/v3/projects/4ebd7b7f2cc64d33871400762d1ebb95` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:08.096520 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d92a30-c8e6-4a38-b7fc-c5a0582bb43c admin admin] RBAC: Authorizing `identity:delete_project(project_id=4ebd7b7f2cc64d33871400762d1ebb95)` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:49:08.099068 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d92a30-c8e6-4a38-b7fc-c5a0582bb43c admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:49:08.123390 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 827/1640] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 30 00:49:07 2022] POST /identity/v3/users => generated 297 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 00:49:08.124340 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f8e376-a60c-408c-9b2f-aac574302cac admin admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:49:08.141667 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f8e376-a60c-408c-9b2f-aac574302cac admin admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:49:08.147385 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fcd0d6-401c-4d77-a5b3-a3d4353f96f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:49:08.148882 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fcd0d6-401c-4d77-a5b3-a3d4353f96f6 admin admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:08.149310 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fcd0d6-401c-4d77-a5b3-a3d4353f96f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:08.150087 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fcd0d6-401c-4d77-a5b3-a3d4353f96f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:08.151147 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fcd0d6-401c-4d77-a5b3-a3d4353f96f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:49:08.152873 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fcd0d6-401c-4d77-a5b3-a3d4353f96f6 admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:49:08.168590 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 828/1641] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 30 00:49:08 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 00:49:08.173002 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fcd0d6-401c-4d77-a5b3-a3d4353f96f6 admin admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:49:08.174013 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-97d92a30-c8e6-4a38-b7fc-c5a0582bb43c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4ebd7b7f2cc64d33871400762d1ebb95', 'request_id': 'req-97d92a30-c8e6-4a38-b7fc-c5a0582bb43c'} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:49:08.183857 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-97d92a30-c8e6-4a38-b7fc-c5a0582bb43c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4ebd7b7f2cc64d33871400762d1ebb95', 'request_id': 'req-97d92a30-c8e6-4a38-b7fc-c5a0582bb43c'} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:49:08.184084 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fcd0d6-401c-4d77-a5b3-a3d4353f96f6 admin admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:49:08.196300 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-97d92a30-c8e6-4a38-b7fc-c5a0582bb43c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4ebd7b7f2cc64d33871400762d1ebb95', 'request_id': 'req-97d92a30-c8e6-4a38-b7fc-c5a0582bb43c'} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:49:08.217778 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-97d92a30-c8e6-4a38-b7fc-c5a0582bb43c admin admin] The token cache is being invalidate because project 4ebd7b7f2cc64d33871400762d1ebb95 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87955) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 00:49:08.219558 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-97d92a30-c8e6-4a38-b7fc-c5a0582bb43c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:49:08.220381 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-97d92a30-c8e6-4a38-b7fc-c5a0582bb43c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:49:08.222309 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 814/1642] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 30 00:49:07 2022] DELETE /identity/v3/projects/4ebd7b7f2cc64d33871400762d1ebb95 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 00:49:08.230801 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03466cd9-0941-4c4c-9279-952f18f80f5a None None] REQUEST_METHOD: `POST` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:08.230801 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03466cd9-0941-4c4c-9279-952f18f80f5a None None] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:08.230801 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03466cd9-0941-4c4c-9279-952f18f80f5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:08.248024 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.auth.core [None req-03466cd9-0941-4c4c-9279-952f18f80f5a None None] MFA Rules not processed for user `eb55b6cbca4945abb21b0e49eb745e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=87955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:49:08.249383 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-03466cd9-0941-4c4c-9279-952f18f80f5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:49:08.257812 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:49:08.273836 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c2e067-749d-4543-852e-7a9f6ed7fa76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:49:08.274809 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c2e067-749d-4543-852e-7a9f6ed7fa76 admin admin] REQUEST_METHOD: `PUT` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:08.275355 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c2e067-749d-4543-852e-7a9f6ed7fa76 admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:08.275821 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c2e067-749d-4543-852e-7a9f6ed7fa76 admin admin] PATH_INFO: `/v3/projects/84ace7fb9de54f7ab51c8a59cfac4985/users/7c69560f374b40c3bf43d6dcbfc0fce9/roles/6ccaa8c11f29456fb4e4eeccb21616c7` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:08.304879 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c2e067-749d-4543-852e-7a9f6ed7fa76 admin admin] RBAC: Authorizing `identity:create_grant(project_id=84ace7fb9de54f7ab51c8a59cfac4985, user_id=7c69560f374b40c3bf43d6dcbfc0fce9, role_id=6ccaa8c11f29456fb4e4eeccb21616c7)` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:49:08.313782 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c2e067-749d-4543-852e-7a9f6ed7fa76 admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:49:08.344027 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 829/1643] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 30 00:49:08 2022] PUT /identity/v3/projects/84ace7fb9de54f7ab51c8a59cfac4985/users/7c69560f374b40c3bf43d6dcbfc0fce9/roles/6ccaa8c11f29456fb4e4eeccb21616c7 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 00:49:08.348441 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c2e067-749d-4543-852e-7a9f6ed7fa76 admin admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:49:08.356449 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 815/1644] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 30 00:49:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:49:08.358204 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-c6c2e067-749d-4543-852e-7a9f6ed7fa76 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:49:08.358476 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c08e16-bc72-4b65-a226-03d178a1a0b9 None None] REQUEST_METHOD: `POST` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:08.358853 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c08e16-bc72-4b65-a226-03d178a1a0b9 None None] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:08.359261 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c08e16-bc72-4b65-a226-03d178a1a0b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:08.386583 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.auth.core [None req-a9c08e16-bc72-4b65-a226-03d178a1a0b9 None None] MFA Rules not processed for user `eb55b6cbca4945abb21b0e49eb745e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=87955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:49:08.387994 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-a9c08e16-bc72-4b65-a226-03d178a1a0b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:49:08.472024 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c2e067-749d-4543-852e-7a9f6ed7fa76 admin admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:49:08.474079 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:49:08.494227 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5076eef5-a86a-4206-96d2-6819144beca6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:49:08.495308 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5076eef5-a86a-4206-96d2-6819144beca6 admin admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:08.495686 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5076eef5-a86a-4206-96d2-6819144beca6 admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:08.496243 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5076eef5-a86a-4206-96d2-6819144beca6 admin admin] PATH_INFO: `/v3/roles` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:08.497047 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5076eef5-a86a-4206-96d2-6819144beca6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:49:08.499365 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5076eef5-a86a-4206-96d2-6819144beca6 admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:49:08.517077 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 830/1645] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 30 00:49:08 2022] GET /identity/v3/roles => generated 1420 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 00:49:08.522863 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5076eef5-a86a-4206-96d2-6819144beca6 admin admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:49:08.525296 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-5076eef5-a86a-4206-96d2-6819144beca6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:49:08.550701 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 816/1646] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 30 00:49:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:49:08.558870 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c08e16-bc72-4b65-a226-03d178a1a0b9 None None] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:49:08.563100 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5076eef5-a86a-4206-96d2-6819144beca6 admin admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:49:08.576553 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c08e16-bc72-4b65-a226-03d178a1a0b9 None None] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:49:08.579651 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3717a9c1-ce99-4814-aad5-15c43f003c3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:49:08.580711 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3717a9c1-ce99-4814-aad5-15c43f003c3a admin admin] REQUEST_METHOD: `DELETE` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:08.580997 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3717a9c1-ce99-4814-aad5-15c43f003c3a admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:08.588869 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3717a9c1-ce99-4814-aad5-15c43f003c3a admin admin] PATH_INFO: `/v3/users/2cb1cfdeaeb74da9bb9643c91ca00f0a` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:08.592099 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3717a9c1-ce99-4814-aad5-15c43f003c3a admin admin] RBAC: Authorizing `identity:delete_user(user_id=2cb1cfdeaeb74da9bb9643c91ca00f0a)` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:49:08.596750 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053c9888-1bb8-40eb-aed1-383ee206d587 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:49:08.598186 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053c9888-1bb8-40eb-aed1-383ee206d587 admin admin] REQUEST_METHOD: `PUT` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:08.598186 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053c9888-1bb8-40eb-aed1-383ee206d587 admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:08.598186 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053c9888-1bb8-40eb-aed1-383ee206d587 admin admin] PATH_INFO: `/v3/projects/84ace7fb9de54f7ab51c8a59cfac4985/users/7c69560f374b40c3bf43d6dcbfc0fce9/roles/6ccaa8c11f29456fb4e4eeccb21616c7` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:08.599626 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3717a9c1-ce99-4814-aad5-15c43f003c3a admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:49:08.600686 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053c9888-1bb8-40eb-aed1-383ee206d587 admin admin] RBAC: Authorizing `identity:create_grant(project_id=84ace7fb9de54f7ab51c8a59cfac4985, user_id=7c69560f374b40c3bf43d6dcbfc0fce9, role_id=6ccaa8c11f29456fb4e4eeccb21616c7)` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:49:08.605442 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053c9888-1bb8-40eb-aed1-383ee206d587 admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:49:08.623397 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 817/1647] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 30 00:49:08 2022] PUT /identity/v3/projects/84ace7fb9de54f7ab51c8a59cfac4985/users/7c69560f374b40c3bf43d6dcbfc0fce9/roles/6ccaa8c11f29456fb4e4eeccb21616c7 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 00:49:08.624318 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053c9888-1bb8-40eb-aed1-383ee206d587 admin admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:49:08.705484 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-3717a9c1-ce99-4814-aad5-15c43f003c3a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2cb1cfdeaeb74da9bb9643c91ca00f0a'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:49:08.706354 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-3717a9c1-ce99-4814-aad5-15c43f003c3a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2cb1cfdeaeb74da9bb9643c91ca00f0a'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:49:08.721254 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-3717a9c1-ce99-4814-aad5-15c43f003c3a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2cb1cfdeaeb74da9bb9643c91ca00f0a'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:49:08.732575 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-3717a9c1-ce99-4814-aad5-15c43f003c3a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2cb1cfdeaeb74da9bb9643c91ca00f0a'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:49:08.752434 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-3717a9c1-ce99-4814-aad5-15c43f003c3a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2cb1cfdeaeb74da9bb9643c91ca00f0a'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:49:08.763991 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 831/1648] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 30 00:49:08 2022] DELETE /identity/v3/users/2cb1cfdeaeb74da9bb9643c91ca00f0a => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 00:49:08.765571 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002dbabf-e718-4d60-b436-2192e61ff3ee None None] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:08.765814 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002dbabf-e718-4d60-b436-2192e61ff3ee None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:08.766025 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002dbabf-e718-4d60-b436-2192e61ff3ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:08.769690 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053c9888-1bb8-40eb-aed1-383ee206d587 admin admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:49:08.814805 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.auth.core [None req-002dbabf-e718-4d60-b436-2192e61ff3ee None None] MFA Rules not processed for user `7c69560f374b40c3bf43d6dcbfc0fce9`. Rule list: `[]` (Enabled: `True`). {{(pid=87956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:49:08.816128 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-002dbabf-e718-4d60-b436-2192e61ff3ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:49:08.866170 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:49:08.886772 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec46727-ec6e-4947-bad1-8997ba62224b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:49:08.888250 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec46727-ec6e-4947-bad1-8997ba62224b admin admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:08.888928 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec46727-ec6e-4947-bad1-8997ba62224b admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:08.889712 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec46727-ec6e-4947-bad1-8997ba62224b admin admin] PATH_INFO: `/v3/domains` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:08.890679 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec46727-ec6e-4947-bad1-8997ba62224b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:49:08.891383 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec46727-ec6e-4947-bad1-8997ba62224b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:49:08.896514 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec46727-ec6e-4947-bad1-8997ba62224b admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:49:08.918316 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 818/1649] 10.222.0.42 () {58 vars in 1153 bytes} [Sun Oct 30 00:49:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:49:08.919823 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48c8f39-c358-4855-87c4-1c905a889f20 None None] REQUEST_METHOD: `POST` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:08.920106 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48c8f39-c358-4855-87c4-1c905a889f20 None None] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:08.920495 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48c8f39-c358-4855-87c4-1c905a889f20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:08.945980 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.auth.core [None req-d48c8f39-c358-4855-87c4-1c905a889f20 None None] MFA Rules not processed for user `eb55b6cbca4945abb21b0e49eb745e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=87955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:49:08.947134 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-d48c8f39-c358-4855-87c4-1c905a889f20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:49:08.961020 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 819/1650] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 30 00:49:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:49:08.961989 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48c8f39-c358-4855-87c4-1c905a889f20 None None] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:49:08.962261 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 832/1651] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 30 00:49:08 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:49:08.963611 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-d48c8f39-c358-4855-87c4-1c905a889f20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:49:08.971615 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002dbabf-e718-4d60-b436-2192e61ff3ee None None] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:49:08.973209 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-002dbabf-e718-4d60-b436-2192e61ff3ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:49:08.976474 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48c8f39-c358-4855-87c4-1c905a889f20 None None] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:49:08.981529 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8dda2b-d373-4d72-b580-405e1136d5a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:49:08.982138 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8dda2b-d373-4d72-b580-405e1136d5a7 admin admin] REQUEST_METHOD: `POST` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:08.982410 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8dda2b-d373-4d72-b580-405e1136d5a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:08.982951 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8dda2b-d373-4d72-b580-405e1136d5a7 admin admin] PATH_INFO: `/v3/projects` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:08.983639 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8dda2b-d373-4d72-b580-405e1136d5a7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:49:08.985806 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8dda2b-d373-4d72-b580-405e1136d5a7 admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:49:09.031571 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 820/1652] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 30 00:49:08 2022] POST /identity/v3/projects => generated 373 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 00:49:09.034059 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8dda2b-d373-4d72-b580-405e1136d5a7 admin admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:49:09.036496 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-6e8dda2b-d373-4d72-b580-405e1136d5a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:49:09.071394 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002dbabf-e718-4d60-b436-2192e61ff3ee None None] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:49:09.171728 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:49:09.181763 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37429a7-a0f9-474c-9a5e-39513e3abbf6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5693f186c6ad4d9394f02ee3477cdcd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d2387fdf794d4eaef07bbcd7b39f2a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:49:09.182389 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37429a7-a0f9-474c-9a5e-39513e3abbf6 service neutron] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:09.182670 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37429a7-a0f9-474c-9a5e-39513e3abbf6 service neutron] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:09.182940 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37429a7-a0f9-474c-9a5e-39513e3abbf6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:09.190312 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8dda2b-d373-4d72-b580-405e1136d5a7 admin admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:49:09.195741 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3baf7cd3-335a-41ef-857f-6b12f0cd0131 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48d928ff7fe24348ac900f09c56acc20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d2387fdf794d4eaef07bbcd7b39f2a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:49:09.196580 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baf7cd3-335a-41ef-857f-6b12f0cd0131 service cinder] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:09.197033 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baf7cd3-335a-41ef-857f-6b12f0cd0131 service cinder] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:09.199007 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baf7cd3-335a-41ef-857f-6b12f0cd0131 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:09.291465 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3baf7cd3-335a-41ef-857f-6b12f0cd0131 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:49:09.293727 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3baf7cd3-335a-41ef-857f-6b12f0cd0131 service cinder] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:49:09.296479 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37429a7-a0f9-474c-9a5e-39513e3abbf6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:49:09.300053 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37429a7-a0f9-474c-9a5e-39513e3abbf6 service neutron] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:49:09.310777 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 821/1653] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 30 00:49:09 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 279 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 00:49:09.311788 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3baf7cd3-335a-41ef-857f-6b12f0cd0131 service cinder] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:49:09.323590 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3baf7cd3-335a-41ef-857f-6b12f0cd0131 service cinder] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:49:09.329167 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babf7e91-40c9-4533-806a-a9ffb076d7fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:49:09.329774 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babf7e91-40c9-4533-806a-a9ffb076d7fa admin admin] REQUEST_METHOD: `POST` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:09.330046 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babf7e91-40c9-4533-806a-a9ffb076d7fa admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:09.330316 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babf7e91-40c9-4533-806a-a9ffb076d7fa admin admin] PATH_INFO: `/v3/users` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:09.331000 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babf7e91-40c9-4533-806a-a9ffb076d7fa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:49:09.333328 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babf7e91-40c9-4533-806a-a9ffb076d7fa admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:49:09.341131 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 833/1654] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 30 00:49:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 00:49:09.360251 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 822/1655] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 30 00:49:09 2022] POST /identity/v3/users => generated 287 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 00:49:09.364361 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37429a7-a0f9-474c-9a5e-39513e3abbf6 service neutron] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:49:09.376224 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37429a7-a0f9-474c-9a5e-39513e3abbf6 service neutron] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:49:09.397838 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3338cb8c-a65a-4ee6-b54d-93b22323a7d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:49:09.398478 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3338cb8c-a65a-4ee6-b54d-93b22323a7d5 admin admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:09.398758 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3338cb8c-a65a-4ee6-b54d-93b22323a7d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:09.399031 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3338cb8c-a65a-4ee6-b54d-93b22323a7d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:09.399744 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3338cb8c-a65a-4ee6-b54d-93b22323a7d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:49:09.401439 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3338cb8c-a65a-4ee6-b54d-93b22323a7d5 admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:49:09.420998 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 834/1656] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 30 00:49:09 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 00:49:09.425108 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babf7e91-40c9-4533-806a-a9ffb076d7fa admin admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:49:09.438914 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babf7e91-40c9-4533-806a-a9ffb076d7fa admin admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:49:09.462907 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3338cb8c-a65a-4ee6-b54d-93b22323a7d5 admin admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:49:09.466082 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-3338cb8c-a65a-4ee6-b54d-93b22323a7d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:49:09.466873 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057467c3-c63e-4f7a-833f-1d9bf53deb97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:49:09.468945 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057467c3-c63e-4f7a-833f-1d9bf53deb97 admin admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:09.470018 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057467c3-c63e-4f7a-833f-1d9bf53deb97 admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:09.470610 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057467c3-c63e-4f7a-833f-1d9bf53deb97 admin admin] PATH_INFO: `/v3/roles` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:09.473494 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057467c3-c63e-4f7a-833f-1d9bf53deb97 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:49:09.478509 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057467c3-c63e-4f7a-833f-1d9bf53deb97 admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:49:09.488161 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3338cb8c-a65a-4ee6-b54d-93b22323a7d5 admin admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:49:09.494175 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda6c620-dec5-48cd-96d5-8a0bca916f08 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48d928ff7fe24348ac900f09c56acc20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d2387fdf794d4eaef07bbcd7b39f2a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:49:09.495917 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda6c620-dec5-48cd-96d5-8a0bca916f08 service cinder] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:09.496304 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda6c620-dec5-48cd-96d5-8a0bca916f08 service cinder] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:09.496643 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda6c620-dec5-48cd-96d5-8a0bca916f08 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:09.498567 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-eda6c620-dec5-48cd-96d5-8a0bca916f08 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:49:09.503529 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 823/1657] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 30 00:49:09 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 00:49:09.504715 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057467c3-c63e-4f7a-833f-1d9bf53deb97 admin admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:49:09.516739 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057467c3-c63e-4f7a-833f-1d9bf53deb97 admin admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:49:09.522920 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f908a6fd-9c47-4cca-9c39-35d74c2cb6bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:49:09.523558 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f908a6fd-9c47-4cca-9c39-35d74c2cb6bc admin admin] REQUEST_METHOD: `PUT` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:09.523835 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f908a6fd-9c47-4cca-9c39-35d74c2cb6bc admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:09.524107 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f908a6fd-9c47-4cca-9c39-35d74c2cb6bc admin admin] PATH_INFO: `/v3/projects/b9ab16bd90854f32b73ecdee7a180bbd/users/d31f818b8e1e46739a0c81af4904ebfa/roles/1c93019874174c4b91118d9ce2347e47` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:09.531876 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=100 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:49:09.545274 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f908a6fd-9c47-4cca-9c39-35d74c2cb6bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=b9ab16bd90854f32b73ecdee7a180bbd, user_id=d31f818b8e1e46739a0c81af4904ebfa, role_id=1c93019874174c4b91118d9ce2347e47)` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:49:09.550051 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f908a6fd-9c47-4cca-9c39-35d74c2cb6bc admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:49:09.574208 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 824/1658] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 30 00:49:09 2022] PUT /identity/v3/projects/b9ab16bd90854f32b73ecdee7a180bbd/users/d31f818b8e1e46739a0c81af4904ebfa/roles/1c93019874174c4b91118d9ce2347e47 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 00:49:09.586810 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0296e8e-c8a1-431a-9963-69f727d21c2b None None] REQUEST_METHOD: `POST` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:09.587353 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0296e8e-c8a1-431a-9963-69f727d21c2b None None] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:09.587775 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0296e8e-c8a1-431a-9963-69f727d21c2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:09.601552 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda6c620-dec5-48cd-96d5-8a0bca916f08 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:49:09.602873 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda6c620-dec5-48cd-96d5-8a0bca916f08 service cinder] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:49:09.619778 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 835/1659] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 30 00:49:09 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 30 00:49:09.633928 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.auth.core [None req-f0296e8e-c8a1-431a-9963-69f727d21c2b None None] MFA Rules not processed for user `d31f818b8e1e46739a0c81af4904ebfa`. Rule list: `[]` (Enabled: `True`). {{(pid=87955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:49:09.636794 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-f0296e8e-c8a1-431a-9963-69f727d21c2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:49:09.752033 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 825/1660] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 30 00:49:09 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 30 00:49:09.767460 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda6c620-dec5-48cd-96d5-8a0bca916f08 service cinder] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:49:09.789778 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda6c620-dec5-48cd-96d5-8a0bca916f08 service cinder] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:49:09.813061 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0296e8e-c8a1-431a-9963-69f727d21c2b None None] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:49:09.814664 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-f0296e8e-c8a1-431a-9963-69f727d21c2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:49:09.867227 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:49:09.918273 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f05203-2f6a-4922-ad93-98c4711010f5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48d928ff7fe24348ac900f09c56acc20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d2387fdf794d4eaef07bbcd7b39f2a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:49:09.919046 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f05203-2f6a-4922-ad93-98c4711010f5 service cinder] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:09.919428 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f05203-2f6a-4922-ad93-98c4711010f5 service cinder] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:09.919898 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f05203-2f6a-4922-ad93-98c4711010f5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:09.936711 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f05203-2f6a-4922-ad93-98c4711010f5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:49:09.937666 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0296e8e-c8a1-431a-9963-69f727d21c2b None None] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:49:09.938670 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f05203-2f6a-4922-ad93-98c4711010f5 service cinder] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:49:09.943585 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd73a98c-db28-406b-91ac-37bfee84b79a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:49:09.944415 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd73a98c-db28-406b-91ac-37bfee84b79a admin admin] REQUEST_METHOD: `DELETE` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:09.944826 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd73a98c-db28-406b-91ac-37bfee84b79a admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:09.945107 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd73a98c-db28-406b-91ac-37bfee84b79a admin admin] PATH_INFO: `/v3/projects/aba861332bea486c993020af7d37cb47` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:09.946398 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd73a98c-db28-406b-91ac-37bfee84b79a admin admin] RBAC: Authorizing `identity:delete_project(project_id=aba861332bea486c993020af7d37cb47)` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:49:09.948495 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd73a98c-db28-406b-91ac-37bfee84b79a admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:49:09.955046 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 836/1661] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 30 00:49:09 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 00:49:09.978729 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f05203-2f6a-4922-ad93-98c4711010f5 service cinder] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:49:10.012295 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f05203-2f6a-4922-ad93-98c4711010f5 service cinder] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:49:10.023546 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226ec67b-ea71-4b50-9623-4bfe6d130823 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:49:10.024462 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226ec67b-ea71-4b50-9623-4bfe6d130823 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:10.025586 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226ec67b-ea71-4b50-9623-4bfe6d130823 admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:10.026529 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226ec67b-ea71-4b50-9623-4bfe6d130823 admin admin] PATH_INFO: `/v3/users/d31f818b8e1e46739a0c81af4904ebfa` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:10.029987 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226ec67b-ea71-4b50-9623-4bfe6d130823 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d31f818b8e1e46739a0c81af4904ebfa)` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:49:10.033437 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226ec67b-ea71-4b50-9623-4bfe6d130823 admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:49:10.050529 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-fd73a98c-db28-406b-91ac-37bfee84b79a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aba861332bea486c993020af7d37cb47', 'request_id': 'req-fd73a98c-db28-406b-91ac-37bfee84b79a'} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:49:10.063961 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-fd73a98c-db28-406b-91ac-37bfee84b79a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aba861332bea486c993020af7d37cb47', 'request_id': 'req-fd73a98c-db28-406b-91ac-37bfee84b79a'} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:49:10.079387 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-fd73a98c-db28-406b-91ac-37bfee84b79a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aba861332bea486c993020af7d37cb47', 'request_id': 'req-fd73a98c-db28-406b-91ac-37bfee84b79a'} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:49:10.094952 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-fd73a98c-db28-406b-91ac-37bfee84b79a admin admin] The token cache is being invalidate because project aba861332bea486c993020af7d37cb47 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87955) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 00:49:10.095226 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-fd73a98c-db28-406b-91ac-37bfee84b79a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:49:10.096188 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-fd73a98c-db28-406b-91ac-37bfee84b79a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:49:10.098468 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 826/1662] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 30 00:49:09 2022] DELETE /identity/v3/projects/aba861332bea486c993020af7d37cb47 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 00:49:10.102600 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd73a98c-db28-406b-91ac-37bfee84b79a admin admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:49:10.104148 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-fd73a98c-db28-406b-91ac-37bfee84b79a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:49:10.127597 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-226ec67b-ea71-4b50-9623-4bfe6d130823 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd31f818b8e1e46739a0c81af4904ebfa'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:49:10.128762 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-226ec67b-ea71-4b50-9623-4bfe6d130823 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd31f818b8e1e46739a0c81af4904ebfa'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:49:10.156412 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-226ec67b-ea71-4b50-9623-4bfe6d130823 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd31f818b8e1e46739a0c81af4904ebfa'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:49:10.179828 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-226ec67b-ea71-4b50-9623-4bfe6d130823 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd31f818b8e1e46739a0c81af4904ebfa'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:49:10.206748 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-226ec67b-ea71-4b50-9623-4bfe6d130823 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd31f818b8e1e46739a0c81af4904ebfa'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:49:10.222345 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 837/1663] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 30 00:49:09 2022] DELETE /identity/v3/users/d31f818b8e1e46739a0c81af4904ebfa => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 00:49:10.227240 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c18fee-8958-4a0e-885d-83f4034cdbef None None] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:10.227586 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c18fee-8958-4a0e-885d-83f4034cdbef None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:10.227945 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c18fee-8958-4a0e-885d-83f4034cdbef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:10.228121 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd73a98c-db28-406b-91ac-37bfee84b79a admin admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:49:10.271280 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.auth.core [None req-30c18fee-8958-4a0e-885d-83f4034cdbef None None] MFA Rules not processed for user `eb55b6cbca4945abb21b0e49eb745e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=87956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:49:10.273155 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-30c18fee-8958-4a0e-885d-83f4034cdbef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:49:10.329273 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a791a7bf-e6de-4b38-a737-4ab75fe9d13a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:49:10.329885 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a791a7bf-e6de-4b38-a737-4ab75fe9d13a admin admin] REQUEST_METHOD: `DELETE` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:10.330849 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a791a7bf-e6de-4b38-a737-4ab75fe9d13a admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:10.331126 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a791a7bf-e6de-4b38-a737-4ab75fe9d13a admin admin] PATH_INFO: `/v3/users/37d9e20b3ec647a0bd16a02c2200e1a7` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:10.336382 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a791a7bf-e6de-4b38-a737-4ab75fe9d13a admin admin] RBAC: Authorizing `identity:delete_user(user_id=37d9e20b3ec647a0bd16a02c2200e1a7)` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:49:10.338473 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a791a7bf-e6de-4b38-a737-4ab75fe9d13a admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:49:10.346929 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:49:10.352041 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:49:10.415851 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 838/1664] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 30 00:49:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 30 00:49:10.427653 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c18fee-8958-4a0e-885d-83f4034cdbef None None] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:49:10.429388 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-30c18fee-8958-4a0e-885d-83f4034cdbef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:49:10.430458 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-a791a7bf-e6de-4b38-a737-4ab75fe9d13a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '37d9e20b3ec647a0bd16a02c2200e1a7'} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:49:10.432278 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-a791a7bf-e6de-4b38-a737-4ab75fe9d13a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '37d9e20b3ec647a0bd16a02c2200e1a7'} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:49:10.446685 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-a791a7bf-e6de-4b38-a737-4ab75fe9d13a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '37d9e20b3ec647a0bd16a02c2200e1a7'} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:49:10.451227 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-a791a7bf-e6de-4b38-a737-4ab75fe9d13a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '37d9e20b3ec647a0bd16a02c2200e1a7'} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:49:10.462636 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-a791a7bf-e6de-4b38-a737-4ab75fe9d13a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '37d9e20b3ec647a0bd16a02c2200e1a7'} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:49:10.480672 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 827/1665] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 30 00:49:10 2022] DELETE /identity/v3/users/37d9e20b3ec647a0bd16a02c2200e1a7 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 00:49:10.537190 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c18fee-8958-4a0e-885d-83f4034cdbef None None] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:49:10.617760 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6869aad-0141-4850-a101-7a9562e08bca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5693f186c6ad4d9394f02ee3477cdcd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d2387fdf794d4eaef07bbcd7b39f2a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:49:10.618725 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6869aad-0141-4850-a101-7a9562e08bca service neutron] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:10.619014 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6869aad-0141-4850-a101-7a9562e08bca service neutron] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:10.619321 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6869aad-0141-4850-a101-7a9562e08bca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:10.621966 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-c6869aad-0141-4850-a101-7a9562e08bca service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:49:10.693473 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6869aad-0141-4850-a101-7a9562e08bca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:49:10.694864 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6869aad-0141-4850-a101-7a9562e08bca service neutron] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:49:10.705094 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 839/1666] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 30 00:49:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 279 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 00:49:10.851325 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a791a7bf-e6de-4b38-a737-4ab75fe9d13a admin admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:49:10.852879 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-a791a7bf-e6de-4b38-a737-4ab75fe9d13a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:49:10.894968 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a791a7bf-e6de-4b38-a737-4ab75fe9d13a admin admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:49:10.899870 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91ab395-f4ed-49f7-a1dc-a663872c44db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:49:10.900521 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91ab395-f4ed-49f7-a1dc-a663872c44db admin admin] REQUEST_METHOD: `DELETE` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:10.900795 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91ab395-f4ed-49f7-a1dc-a663872c44db admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:10.901095 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91ab395-f4ed-49f7-a1dc-a663872c44db admin admin] PATH_INFO: `/v3/projects/ebdae593eb1f406a8df32ac89361178f` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:10.902300 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91ab395-f4ed-49f7-a1dc-a663872c44db admin admin] RBAC: Authorizing `identity:delete_project(project_id=ebdae593eb1f406a8df32ac89361178f)` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:49:10.904567 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91ab395-f4ed-49f7-a1dc-a663872c44db admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:49:10.980789 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-a91ab395-f4ed-49f7-a1dc-a663872c44db admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ebdae593eb1f406a8df32ac89361178f', 'request_id': 'req-a91ab395-f4ed-49f7-a1dc-a663872c44db'} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:49:10.987640 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-a91ab395-f4ed-49f7-a1dc-a663872c44db admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ebdae593eb1f406a8df32ac89361178f', 'request_id': 'req-a91ab395-f4ed-49f7-a1dc-a663872c44db'} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:49:10.998213 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-a91ab395-f4ed-49f7-a1dc-a663872c44db admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ebdae593eb1f406a8df32ac89361178f', 'request_id': 'req-a91ab395-f4ed-49f7-a1dc-a663872c44db'} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:49:11.028212 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-a91ab395-f4ed-49f7-a1dc-a663872c44db admin admin] The token cache is being invalidate because project ebdae593eb1f406a8df32ac89361178f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87955) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 00:49:11.029773 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-a91ab395-f4ed-49f7-a1dc-a663872c44db admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:49:11.030562 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-a91ab395-f4ed-49f7-a1dc-a663872c44db admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:49:11.033005 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 828/1667] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 30 00:49:10 2022] DELETE /identity/v3/projects/ebdae593eb1f406a8df32ac89361178f => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 00:49:11.037861 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6303463-a104-4b7b-80b4-97ddef7f4583 None None] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:11.038226 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6303463-a104-4b7b-80b4-97ddef7f4583 None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:11.038591 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6303463-a104-4b7b-80b4-97ddef7f4583 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:11.074774 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.auth.core [None req-b6303463-a104-4b7b-80b4-97ddef7f4583 None None] MFA Rules not processed for user `eb55b6cbca4945abb21b0e49eb745e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=87956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:49:11.076466 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-b6303463-a104-4b7b-80b4-97ddef7f4583 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:49:11.088476 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91ab395-f4ed-49f7-a1dc-a663872c44db admin admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:49:11.091607 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-a91ab395-f4ed-49f7-a1dc-a663872c44db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:49:11.152714 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=100 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:49:11.183470 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 840/1668] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 30 00:49:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:49:11.192470 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b86a762-fd20-4a99-9744-76561ac73a18 None None] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:11.192827 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b86a762-fd20-4a99-9744-76561ac73a18 None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:11.193168 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b86a762-fd20-4a99-9744-76561ac73a18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:11.205291 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91ab395-f4ed-49f7-a1dc-a663872c44db admin admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:49:11.211353 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96765aa0-8166-4c8d-a702-ab7adbbfb12f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:49:11.212063 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96765aa0-8166-4c8d-a702-ab7adbbfb12f admin admin] REQUEST_METHOD: `DELETE` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:11.212454 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96765aa0-8166-4c8d-a702-ab7adbbfb12f admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:11.212793 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96765aa0-8166-4c8d-a702-ab7adbbfb12f admin admin] PATH_INFO: `/v3/projects/b9ab16bd90854f32b73ecdee7a180bbd` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:11.214666 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96765aa0-8166-4c8d-a702-ab7adbbfb12f admin admin] RBAC: Authorizing `identity:delete_project(project_id=b9ab16bd90854f32b73ecdee7a180bbd)` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:49:11.216980 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96765aa0-8166-4c8d-a702-ab7adbbfb12f admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:49:11.226188 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:49:11.227828 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.auth.core [None req-2b86a762-fd20-4a99-9744-76561ac73a18 None None] MFA Rules not processed for user `eb55b6cbca4945abb21b0e49eb745e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=87956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:49:11.230246 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-2b86a762-fd20-4a99-9744-76561ac73a18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:49:11.243420 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 841/1669] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 30 00:49:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 30 00:49:11.244604 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b86a762-fd20-4a99-9744-76561ac73a18 None None] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:49:11.257045 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b86a762-fd20-4a99-9744-76561ac73a18 None None] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:49:11.276394 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-96765aa0-8166-4c8d-a702-ab7adbbfb12f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b9ab16bd90854f32b73ecdee7a180bbd', 'request_id': 'req-96765aa0-8166-4c8d-a702-ab7adbbfb12f'} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:49:11.287041 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-96765aa0-8166-4c8d-a702-ab7adbbfb12f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b9ab16bd90854f32b73ecdee7a180bbd', 'request_id': 'req-96765aa0-8166-4c8d-a702-ab7adbbfb12f'} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:49:11.296820 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-96765aa0-8166-4c8d-a702-ab7adbbfb12f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b9ab16bd90854f32b73ecdee7a180bbd', 'request_id': 'req-96765aa0-8166-4c8d-a702-ab7adbbfb12f'} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:49:11.311972 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-96765aa0-8166-4c8d-a702-ab7adbbfb12f admin admin] The token cache is being invalidate because project b9ab16bd90854f32b73ecdee7a180bbd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87955) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 00:49:11.312255 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-96765aa0-8166-4c8d-a702-ab7adbbfb12f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:49:11.312989 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-96765aa0-8166-4c8d-a702-ab7adbbfb12f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:49:11.314618 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 829/1670] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 30 00:49:11 2022] DELETE /identity/v3/projects/b9ab16bd90854f32b73ecdee7a180bbd => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 00:49:11.319895 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1ba181-49b2-4ae3-a44b-86b385f72b56 None None] REQUEST_METHOD: `POST` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:11.320444 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1ba181-49b2-4ae3-a44b-86b385f72b56 None None] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:11.321600 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1ba181-49b2-4ae3-a44b-86b385f72b56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:11.324032 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ac9f88-5edb-4ffc-8d0f-22ef994ced67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:49:11.324549 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ac9f88-5edb-4ffc-8d0f-22ef994ced67 admin admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:11.325135 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ac9f88-5edb-4ffc-8d0f-22ef994ced67 admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:11.325406 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ac9f88-5edb-4ffc-8d0f-22ef994ced67 admin admin] PATH_INFO: `/v3/domains` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:11.326051 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ac9f88-5edb-4ffc-8d0f-22ef994ced67 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87956) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:49:11.326395 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ac9f88-5edb-4ffc-8d0f-22ef994ced67 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:49:11.328030 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ac9f88-5edb-4ffc-8d0f-22ef994ced67 admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:49:11.340472 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 842/1671] 10.222.0.42 () {58 vars in 1153 bytes} [Sun Oct 30 00:49:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:49:11.344734 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ac9f88-5edb-4ffc-8d0f-22ef994ced67 admin admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:49:11.346841 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-72ac9f88-5edb-4ffc-8d0f-22ef994ced67 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:49:11.347149 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.auth.core [None req-cd1ba181-49b2-4ae3-a44b-86b385f72b56 None None] MFA Rules not processed for user `eb55b6cbca4945abb21b0e49eb745e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=87955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:49:11.348350 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-cd1ba181-49b2-4ae3-a44b-86b385f72b56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:49:11.359151 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 830/1672] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 30 00:49:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 30 00:49:11.365599 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ac9f88-5edb-4ffc-8d0f-22ef994ced67 admin admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:49:11.367412 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d001e6-c503-41c3-912b-c3a2e46a3554 None None] REQUEST_METHOD: `POST` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:11.367697 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d001e6-c503-41c3-912b-c3a2e46a3554 None None] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:11.367965 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d001e6-c503-41c3-912b-c3a2e46a3554 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:11.375883 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d244012c-42f8-4906-ba87-b32733dbf779 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:49:11.376641 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d244012c-42f8-4906-ba87-b32733dbf779 admin admin] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:11.376971 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d244012c-42f8-4906-ba87-b32733dbf779 admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:11.377251 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d244012c-42f8-4906-ba87-b32733dbf779 admin admin] PATH_INFO: `/v3/projects` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:11.377890 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d244012c-42f8-4906-ba87-b32733dbf779 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:49:11.379952 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d244012c-42f8-4906-ba87-b32733dbf779 admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:49:11.390980 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.auth.core [None req-a9d001e6-c503-41c3-912b-c3a2e46a3554 None None] MFA Rules not processed for user `eb55b6cbca4945abb21b0e49eb745e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=87955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:49:11.392140 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-a9d001e6-c503-41c3-912b-c3a2e46a3554 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:49:11.403101 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 831/1673] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 30 00:49:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 30 00:49:11.406323 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d001e6-c503-41c3-912b-c3a2e46a3554 None None] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:49:11.417012 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d001e6-c503-41c3-912b-c3a2e46a3554 None None] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:49:11.422159 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 843/1674] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 30 00:49:11 2022] POST /identity/v3/projects => generated 369 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 00:49:11.423584 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d244012c-42f8-4906-ba87-b32733dbf779 admin admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:49:11.493606 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b43277-8b68-4367-ab33-f323f3550f15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:49:11.494211 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b43277-8b68-4367-ab33-f323f3550f15 admin admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:11.494491 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b43277-8b68-4367-ab33-f323f3550f15 admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:11.494765 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b43277-8b68-4367-ab33-f323f3550f15 admin admin] PATH_INFO: `/v3/domains` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:11.495450 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b43277-8b68-4367-ab33-f323f3550f15 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:49:11.495867 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b43277-8b68-4367-ab33-f323f3550f15 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:49:11.497352 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b43277-8b68-4367-ab33-f323f3550f15 admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:49:11.500134 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d244012c-42f8-4906-ba87-b32733dbf779 admin admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:49:11.506068 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f051c8-5ef2-4ce5-8b23-8ef8bcbdccf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:49:11.506804 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f051c8-5ef2-4ce5-8b23-8ef8bcbdccf4 admin admin] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:11.507129 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f051c8-5ef2-4ce5-8b23-8ef8bcbdccf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:11.507408 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f051c8-5ef2-4ce5-8b23-8ef8bcbdccf4 admin admin] PATH_INFO: `/v3/users` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:11.508040 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f051c8-5ef2-4ce5-8b23-8ef8bcbdccf4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:49:11.510193 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f051c8-5ef2-4ce5-8b23-8ef8bcbdccf4 admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:49:11.511035 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 832/1675] 10.222.0.42 () {58 vars in 1153 bytes} [Sun Oct 30 00:49:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 30 00:49:11.515157 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b43277-8b68-4367-ab33-f323f3550f15 admin admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:49:11.528581 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b43277-8b68-4367-ab33-f323f3550f15 admin admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:49:11.542498 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc2e81c-fa38-40e3-9ad0-e832c5fd2f63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:49:11.542498 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc2e81c-fa38-40e3-9ad0-e832c5fd2f63 admin admin] REQUEST_METHOD: `POST` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:11.542498 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc2e81c-fa38-40e3-9ad0-e832c5fd2f63 admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:11.542498 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc2e81c-fa38-40e3-9ad0-e832c5fd2f63 admin admin] PATH_INFO: `/v3/projects` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:11.542850 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc2e81c-fa38-40e3-9ad0-e832c5fd2f63 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:49:11.542850 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc2e81c-fa38-40e3-9ad0-e832c5fd2f63 admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:49:11.542999 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 844/1676] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 30 00:49:11 2022] POST /identity/v3/users => generated 285 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 00:49:11.543671 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f051c8-5ef2-4ce5-8b23-8ef8bcbdccf4 admin admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:49:11.554969 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f051c8-5ef2-4ce5-8b23-8ef8bcbdccf4 admin admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:49:11.560407 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1544fd-8a5b-41cf-b74a-2b2badc29c6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:49:11.561024 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1544fd-8a5b-41cf-b74a-2b2badc29c6b admin admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:11.561213 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1544fd-8a5b-41cf-b74a-2b2badc29c6b admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:11.561607 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1544fd-8a5b-41cf-b74a-2b2badc29c6b admin admin] PATH_INFO: `/v3/roles` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:11.562265 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1544fd-8a5b-41cf-b74a-2b2badc29c6b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:49:11.564007 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1544fd-8a5b-41cf-b74a-2b2badc29c6b admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:49:11.571007 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 833/1677] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 30 00:49:11 2022] POST /identity/v3/projects => generated 377 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 30 00:49:11.575774 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc2e81c-fa38-40e3-9ad0-e832c5fd2f63 admin admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:49:11.581459 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 845/1678] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 30 00:49:11 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 30 00:49:11.582700 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1544fd-8a5b-41cf-b74a-2b2badc29c6b admin admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:49:11.592795 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1544fd-8a5b-41cf-b74a-2b2badc29c6b admin admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:49:11.620841 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:49:11.657998 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:49:11.668330 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248a62d3-4960-4797-b97f-aa57bdbe73d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:49:11.668955 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248a62d3-4960-4797-b97f-aa57bdbe73d4 admin admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:11.669229 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248a62d3-4960-4797-b97f-aa57bdbe73d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:11.669501 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248a62d3-4960-4797-b97f-aa57bdbe73d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:11.670553 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248a62d3-4960-4797-b97f-aa57bdbe73d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:49:11.675657 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc2e81c-fa38-40e3-9ad0-e832c5fd2f63 admin admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:49:11.676128 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248a62d3-4960-4797-b97f-aa57bdbe73d4 admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:49:11.683056 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de45ae56-eb0f-4b8e-b694-b4750228b3df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:49:11.684284 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de45ae56-eb0f-4b8e-b694-b4750228b3df admin admin] REQUEST_METHOD: `POST` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:11.684748 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de45ae56-eb0f-4b8e-b694-b4750228b3df admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:11.685045 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de45ae56-eb0f-4b8e-b694-b4750228b3df admin admin] PATH_INFO: `/v3/users` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:11.686225 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de45ae56-eb0f-4b8e-b694-b4750228b3df admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:49:11.688396 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 846/1679] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 30 00:49:11 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 00:49:11.688640 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de45ae56-eb0f-4b8e-b694-b4750228b3df admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:49:11.692922 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248a62d3-4960-4797-b97f-aa57bdbe73d4 admin admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:49:11.708619 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248a62d3-4960-4797-b97f-aa57bdbe73d4 admin admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:49:11.715739 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95967081-080e-48d5-93d0-96251ba3e10e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:49:11.716528 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95967081-080e-48d5-93d0-96251ba3e10e admin admin] REQUEST_METHOD: `PUT` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:11.717134 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95967081-080e-48d5-93d0-96251ba3e10e admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:11.717824 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95967081-080e-48d5-93d0-96251ba3e10e admin admin] PATH_INFO: `/v3/projects/b774cebc78ea4f66b9adf5937194f980/users/06fbfffaa46d45fe90aebd02ae82c604/roles/1c93019874174c4b91118d9ce2347e47` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:11.746096 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 834/1680] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 30 00:49:11 2022] POST /identity/v3/users => generated 289 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 00:49:11.750551 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de45ae56-eb0f-4b8e-b694-b4750228b3df admin admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:49:11.758159 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95967081-080e-48d5-93d0-96251ba3e10e admin admin] RBAC: Authorizing `identity:create_grant(project_id=b774cebc78ea4f66b9adf5937194f980, user_id=06fbfffaa46d45fe90aebd02ae82c604, role_id=1c93019874174c4b91118d9ce2347e47)` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:49:11.761109 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95967081-080e-48d5-93d0-96251ba3e10e admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:49:11.782091 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de45ae56-eb0f-4b8e-b694-b4750228b3df admin admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:49:11.792813 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 847/1681] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 30 00:49:11 2022] PUT /identity/v3/projects/b774cebc78ea4f66b9adf5937194f980/users/06fbfffaa46d45fe90aebd02ae82c604/roles/1c93019874174c4b91118d9ce2347e47 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 00:49:11.794734 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf099997-53c3-437d-ab67-310031e814e6 None None] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:11.795084 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf099997-53c3-437d-ab67-310031e814e6 None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:11.795778 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf099997-53c3-437d-ab67-310031e814e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:11.859510 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.auth.core [None req-cf099997-53c3-437d-ab67-310031e814e6 None None] MFA Rules not processed for user `06fbfffaa46d45fe90aebd02ae82c604`. Rule list: `[]` (Enabled: `True`). {{(pid=87956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:49:11.861203 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-cf099997-53c3-437d-ab67-310031e814e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:49:11.910699 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc6d364-d1db-409b-968a-0eb62ac748ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:49:11.911423 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc6d364-d1db-409b-968a-0eb62ac748ae admin admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:11.911697 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc6d364-d1db-409b-968a-0eb62ac748ae admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:11.911974 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc6d364-d1db-409b-968a-0eb62ac748ae admin admin] PATH_INFO: `/v3/roles` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:11.912635 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc6d364-d1db-409b-968a-0eb62ac748ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:49:11.914749 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc6d364-d1db-409b-968a-0eb62ac748ae admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:49:11.933873 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 835/1682] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 30 00:49:11 2022] GET /identity/v3/roles => generated 1420 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 00:49:11.934998 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc6d364-d1db-409b-968a-0eb62ac748ae admin admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:49:11.947146 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc6d364-d1db-409b-968a-0eb62ac748ae admin admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:49:11.968175 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a7b589-7f6a-43ca-84fb-05fe33b2998d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:49:11.969772 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a7b589-7f6a-43ca-84fb-05fe33b2998d admin admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:11.969772 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a7b589-7f6a-43ca-84fb-05fe33b2998d admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:11.969979 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a7b589-7f6a-43ca-84fb-05fe33b2998d admin admin] PATH_INFO: `/v3/roles` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:11.971025 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a7b589-7f6a-43ca-84fb-05fe33b2998d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:49:11.976304 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a7b589-7f6a-43ca-84fb-05fe33b2998d admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:49:12.012435 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 836/1683] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 30 00:49:11 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 00:49:12.013932 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a7b589-7f6a-43ca-84fb-05fe33b2998d admin admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:49:12.026304 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a7b589-7f6a-43ca-84fb-05fe33b2998d admin admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:49:12.031800 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 848/1684] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 30 00:49:11 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:49:12.051982 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee85e68b-8a7f-4c20-8e3b-70ec0798f60a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:49:12.052815 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee85e68b-8a7f-4c20-8e3b-70ec0798f60a admin admin] REQUEST_METHOD: `PUT` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:12.053066 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee85e68b-8a7f-4c20-8e3b-70ec0798f60a admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:12.053310 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee85e68b-8a7f-4c20-8e3b-70ec0798f60a admin admin] PATH_INFO: `/v3/projects/2737205fcad4476d8d0b712267b02455/users/4327088631654f3e8c3f1dc5ca373504/roles/1c93019874174c4b91118d9ce2347e47` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:12.061606 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf099997-53c3-437d-ab67-310031e814e6 None None] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:49:12.063179 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-cf099997-53c3-437d-ab67-310031e814e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:49:12.102901 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee85e68b-8a7f-4c20-8e3b-70ec0798f60a admin admin] RBAC: Authorizing `identity:create_grant(project_id=2737205fcad4476d8d0b712267b02455, user_id=4327088631654f3e8c3f1dc5ca373504, role_id=1c93019874174c4b91118d9ce2347e47)` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:49:12.107652 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee85e68b-8a7f-4c20-8e3b-70ec0798f60a admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:49:12.127665 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 837/1685] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 30 00:49:12 2022] PUT /identity/v3/projects/2737205fcad4476d8d0b712267b02455/users/4327088631654f3e8c3f1dc5ca373504/roles/1c93019874174c4b91118d9ce2347e47 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 00:49:12.146341 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1938b1f4-8177-46a7-b0db-fb65f881fe4a None None] REQUEST_METHOD: `POST` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:12.146742 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1938b1f4-8177-46a7-b0db-fb65f881fe4a None None] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:12.147188 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1938b1f4-8177-46a7-b0db-fb65f881fe4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:12.179669 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf099997-53c3-437d-ab67-310031e814e6 None None] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:49:12.180694 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.auth.core [None req-1938b1f4-8177-46a7-b0db-fb65f881fe4a None None] MFA Rules not processed for user `4327088631654f3e8c3f1dc5ca373504`. Rule list: `[]` (Enabled: `True`). {{(pid=87955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:49:12.182214 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-1938b1f4-8177-46a7-b0db-fb65f881fe4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:49:12.213375 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:49:12.258676 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0aae4f2-22d5-489a-871c-8b498f3b2fbf service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36a86cf3eaf24b369737b65046142593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d2387fdf794d4eaef07bbcd7b39f2a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:49:12.259334 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0aae4f2-22d5-489a-871c-8b498f3b2fbf service glance] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:12.259495 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0aae4f2-22d5-489a-871c-8b498f3b2fbf service glance] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:12.259787 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0aae4f2-22d5-489a-871c-8b498f3b2fbf service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:12.261288 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 838/1686] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 30 00:49:12 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:49:12.266644 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1938b1f4-8177-46a7-b0db-fb65f881fe4a None None] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:49:12.308077 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:49:12.327367 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0aae4f2-22d5-489a-871c-8b498f3b2fbf service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:49:12.328891 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0aae4f2-22d5-489a-871c-8b498f3b2fbf service glance] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:49:12.338510 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 849/1687] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 30 00:49:12 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 278 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 30 00:49:12.343395 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1938b1f4-8177-46a7-b0db-fb65f881fe4a None None] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:49:12.349648 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68b5abd-7954-4376-a9e2-119cf00b2190 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:49:12.350041 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68b5abd-7954-4376-a9e2-119cf00b2190 admin admin] REQUEST_METHOD: `POST` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:12.350407 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68b5abd-7954-4376-a9e2-119cf00b2190 admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:12.350796 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68b5abd-7954-4376-a9e2-119cf00b2190 admin admin] PATH_INFO: `/v3/projects` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:12.351557 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68b5abd-7954-4376-a9e2-119cf00b2190 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:49:12.353611 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68b5abd-7954-4376-a9e2-119cf00b2190 admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:49:12.389854 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 839/1688] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 30 00:49:12 2022] POST /identity/v3/projects => generated 377 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 00:49:12.393699 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0aae4f2-22d5-489a-871c-8b498f3b2fbf service glance] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:49:12.412609 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0aae4f2-22d5-489a-871c-8b498f3b2fbf service glance] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:49:12.499397 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68b5abd-7954-4376-a9e2-119cf00b2190 admin admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:49:12.501349 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-c68b5abd-7954-4376-a9e2-119cf00b2190 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:49:12.514700 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d3363e-bc34-4f87-b809-7be4aa0bf431 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:49:12.515618 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d3363e-bc34-4f87-b809-7be4aa0bf431 admin admin] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:12.515899 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d3363e-bc34-4f87-b809-7be4aa0bf431 admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:12.516164 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d3363e-bc34-4f87-b809-7be4aa0bf431 admin admin] PATH_INFO: `/v3/users` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:12.516812 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d3363e-bc34-4f87-b809-7be4aa0bf431 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:49:12.518855 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d3363e-bc34-4f87-b809-7be4aa0bf431 admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:49:12.555112 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 850/1689] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 30 00:49:12 2022] POST /identity/v3/users => generated 289 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 00:49:12.556018 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d3363e-bc34-4f87-b809-7be4aa0bf431 admin admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:49:12.580081 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d3363e-bc34-4f87-b809-7be4aa0bf431 admin admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:49:12.591562 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e839514-d4a0-41a5-8559-b0dacaeec541 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:49:12.592401 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e839514-d4a0-41a5-8559-b0dacaeec541 admin admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:12.592671 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e839514-d4a0-41a5-8559-b0dacaeec541 admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:12.592942 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e839514-d4a0-41a5-8559-b0dacaeec541 admin admin] PATH_INFO: `/v3/roles` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:12.594520 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e839514-d4a0-41a5-8559-b0dacaeec541 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:49:12.599783 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e839514-d4a0-41a5-8559-b0dacaeec541 admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:49:12.602757 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68b5abd-7954-4376-a9e2-119cf00b2190 admin admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:49:12.614277 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c58f60a-01c8-495c-8177-3d044d42cd46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:49:12.614930 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c58f60a-01c8-495c-8177-3d044d42cd46 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:12.615227 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c58f60a-01c8-495c-8177-3d044d42cd46 admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:12.615653 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c58f60a-01c8-495c-8177-3d044d42cd46 admin admin] PATH_INFO: `/v3/users/3208bf93593f4cfa854a6c99c626df6b` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:12.616804 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c58f60a-01c8-495c-8177-3d044d42cd46 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3208bf93593f4cfa854a6c99c626df6b)` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:49:12.618805 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c58f60a-01c8-495c-8177-3d044d42cd46 admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:49:12.619298 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 851/1690] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 30 00:49:12 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 00:49:12.623241 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e839514-d4a0-41a5-8559-b0dacaeec541 admin admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:49:12.635412 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e839514-d4a0-41a5-8559-b0dacaeec541 admin admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:49:12.642576 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2865e1-5aa1-4c7d-aeba-4b9f8b944fbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:49:12.643401 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2865e1-5aa1-4c7d-aeba-4b9f8b944fbd admin admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:12.644355 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2865e1-5aa1-4c7d-aeba-4b9f8b944fbd admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:12.644598 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2865e1-5aa1-4c7d-aeba-4b9f8b944fbd admin admin] PATH_INFO: `/v3/roles` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:12.645585 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2865e1-5aa1-4c7d-aeba-4b9f8b944fbd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:49:12.647974 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2865e1-5aa1-4c7d-aeba-4b9f8b944fbd admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:49:12.675409 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 852/1691] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 30 00:49:12 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 00:49:12.678712 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2865e1-5aa1-4c7d-aeba-4b9f8b944fbd admin admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:49:12.704213 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2865e1-5aa1-4c7d-aeba-4b9f8b944fbd admin admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:49:12.705037 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-1c58f60a-01c8-495c-8177-3d044d42cd46 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3208bf93593f4cfa854a6c99c626df6b'} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:49:12.705820 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-1c58f60a-01c8-495c-8177-3d044d42cd46 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3208bf93593f4cfa854a6c99c626df6b'} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:49:12.715912 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-1c58f60a-01c8-495c-8177-3d044d42cd46 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3208bf93593f4cfa854a6c99c626df6b'} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:49:12.717078 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-1c58f60a-01c8-495c-8177-3d044d42cd46 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3208bf93593f4cfa854a6c99c626df6b'} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:49:12.719480 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346bf115-078b-4338-9b93-d908ab2a917f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:49:12.720584 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346bf115-078b-4338-9b93-d908ab2a917f admin admin] REQUEST_METHOD: `PUT` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:12.721817 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346bf115-078b-4338-9b93-d908ab2a917f admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:12.721927 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346bf115-078b-4338-9b93-d908ab2a917f admin admin] PATH_INFO: `/v3/projects/a022fcb916f74305811851efd5ed57cb/users/d59bae5e606c41409d44a930b12e1538/roles/1c93019874174c4b91118d9ce2347e47` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:12.742489 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-1c58f60a-01c8-495c-8177-3d044d42cd46 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3208bf93593f4cfa854a6c99c626df6b'} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:49:12.760124 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346bf115-078b-4338-9b93-d908ab2a917f admin admin] RBAC: Authorizing `identity:create_grant(project_id=a022fcb916f74305811851efd5ed57cb, user_id=d59bae5e606c41409d44a930b12e1538, role_id=1c93019874174c4b91118d9ce2347e47)` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:49:12.768003 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346bf115-078b-4338-9b93-d908ab2a917f admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:49:12.768651 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 840/1692] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 30 00:49:12 2022] DELETE /identity/v3/users/3208bf93593f4cfa854a6c99c626df6b => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 00:49:12.774101 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2148ffc4-f914-4833-887b-eeda0ea76fcc None None] REQUEST_METHOD: `POST` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:12.774440 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2148ffc4-f914-4833-887b-eeda0ea76fcc None None] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:12.774833 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2148ffc4-f914-4833-887b-eeda0ea76fcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:12.803062 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 853/1693] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 30 00:49:12 2022] PUT /identity/v3/projects/a022fcb916f74305811851efd5ed57cb/users/d59bae5e606c41409d44a930b12e1538/roles/1c93019874174c4b91118d9ce2347e47 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 00:49:12.815079 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03060f15-0a08-442c-a41a-c634e7fda019 None None] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:12.815545 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03060f15-0a08-442c-a41a-c634e7fda019 None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:12.815946 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03060f15-0a08-442c-a41a-c634e7fda019 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:12.820227 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.auth.core [None req-2148ffc4-f914-4833-887b-eeda0ea76fcc None None] MFA Rules not processed for user `eb55b6cbca4945abb21b0e49eb745e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=87955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:49:12.821480 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-2148ffc4-f914-4833-887b-eeda0ea76fcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:49:12.847780 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.auth.core [None req-03060f15-0a08-442c-a41a-c634e7fda019 None None] MFA Rules not processed for user `d59bae5e606c41409d44a930b12e1538`. Rule list: `[]` (Enabled: `True`). {{(pid=87956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:49:12.849243 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-03060f15-0a08-442c-a41a-c634e7fda019 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:49:12.861529 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:49:12.867022 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:49:12.911368 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 841/1694] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 30 00:49:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 30 00:49:12.922977 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2148ffc4-f914-4833-887b-eeda0ea76fcc None None] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:49:12.926004 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-2148ffc4-f914-4833-887b-eeda0ea76fcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:49:12.937370 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 854/1695] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 30 00:49:12 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 30 00:49:12.941581 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03060f15-0a08-442c-a41a-c634e7fda019 None None] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:49:12.943243 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-03060f15-0a08-442c-a41a-c634e7fda019 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:49:12.957981 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03060f15-0a08-442c-a41a-c634e7fda019 None None] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:49:12.963146 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340755b9-173f-4590-a366-2cd750ef62c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:49:12.964063 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340755b9-173f-4590-a366-2cd750ef62c0 admin admin] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:12.964744 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340755b9-173f-4590-a366-2cd750ef62c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:12.965226 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340755b9-173f-4590-a366-2cd750ef62c0 admin admin] PATH_INFO: `/v3/projects` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:12.966184 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340755b9-173f-4590-a366-2cd750ef62c0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:49:12.968748 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340755b9-173f-4590-a366-2cd750ef62c0 admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:49:13.003004 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 855/1696] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 30 00:49:12 2022] POST /identity/v3/projects => generated 375 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 00:49:13.006405 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340755b9-173f-4590-a366-2cd750ef62c0 admin admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:49:13.031409 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2148ffc4-f914-4833-887b-eeda0ea76fcc None None] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:49:13.100484 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340755b9-173f-4590-a366-2cd750ef62c0 admin admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:49:13.107817 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d32077-dc14-4918-9088-0df89b74b003 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:49:13.107817 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d32077-dc14-4918-9088-0df89b74b003 admin admin] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:13.107817 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d32077-dc14-4918-9088-0df89b74b003 admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:13.108440 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d32077-dc14-4918-9088-0df89b74b003 admin admin] PATH_INFO: `/v3/users` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:13.109175 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d32077-dc14-4918-9088-0df89b74b003 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:49:13.111698 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d32077-dc14-4918-9088-0df89b74b003 admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:49:13.128989 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65561886-e329-474e-b464-1e9ce1c3215f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5693f186c6ad4d9394f02ee3477cdcd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d2387fdf794d4eaef07bbcd7b39f2a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:49:13.131286 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65561886-e329-474e-b464-1e9ce1c3215f service neutron] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:13.131689 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65561886-e329-474e-b464-1e9ce1c3215f service neutron] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:13.132474 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65561886-e329-474e-b464-1e9ce1c3215f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:13.146674 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 856/1697] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 30 00:49:13 2022] POST /identity/v3/users => generated 294 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 30 00:49:13.152740 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d32077-dc14-4918-9088-0df89b74b003 admin admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:49:13.166783 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65561886-e329-474e-b464-1e9ce1c3215f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:49:13.170195 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65561886-e329-474e-b464-1e9ce1c3215f service neutron] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:49:13.178970 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d32077-dc14-4918-9088-0df89b74b003 admin admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:49:13.191589 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd85d20-8356-492f-a2f8-3d8f6a0f3b9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:49:13.191744 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd85d20-8356-492f-a2f8-3d8f6a0f3b9b admin admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:13.194312 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd85d20-8356-492f-a2f8-3d8f6a0f3b9b admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:13.194709 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd85d20-8356-492f-a2f8-3d8f6a0f3b9b admin admin] PATH_INFO: `/v3/roles` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:13.195401 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd85d20-8356-492f-a2f8-3d8f6a0f3b9b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:49:13.197013 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd85d20-8356-492f-a2f8-3d8f6a0f3b9b admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:49:13.197581 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 842/1698] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 30 00:49:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 276 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 00:49:13.210681 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 857/1699] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 30 00:49:13 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 00:49:13.216534 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65561886-e329-474e-b464-1e9ce1c3215f service neutron] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:49:13.229793 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65561886-e329-474e-b464-1e9ce1c3215f service neutron] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:49:13.236542 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6553e544-21eb-4f37-b146-06574a13fd76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:49:13.237327 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6553e544-21eb-4f37-b146-06574a13fd76 admin admin] REQUEST_METHOD: `PUT` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:13.237629 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6553e544-21eb-4f37-b146-06574a13fd76 admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:13.237904 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6553e544-21eb-4f37-b146-06574a13fd76 admin admin] PATH_INFO: `/v3/projects/936b7cbde8bb4ffa9259ab65891f6584/users/b92e737978fc4273a2aa88204f65872b/roles/6ccaa8c11f29456fb4e4eeccb21616c7` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:13.255599 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6553e544-21eb-4f37-b146-06574a13fd76 admin admin] RBAC: Authorizing `identity:create_grant(project_id=936b7cbde8bb4ffa9259ab65891f6584, user_id=b92e737978fc4273a2aa88204f65872b, role_id=6ccaa8c11f29456fb4e4eeccb21616c7)` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:49:13.258471 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6553e544-21eb-4f37-b146-06574a13fd76 admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:49:13.275324 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 843/1700] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 30 00:49:13 2022] PUT /identity/v3/projects/936b7cbde8bb4ffa9259ab65891f6584/users/b92e737978fc4273a2aa88204f65872b/roles/6ccaa8c11f29456fb4e4eeccb21616c7 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 00:49:13.279539 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd85d20-8356-492f-a2f8-3d8f6a0f3b9b admin admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:49:13.293427 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd85d20-8356-492f-a2f8-3d8f6a0f3b9b admin admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:49:13.385794 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d3aa5d-807f-41ec-990d-6bd63932752b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:49:13.386778 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d3aa5d-807f-41ec-990d-6bd63932752b admin admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:13.387862 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d3aa5d-807f-41ec-990d-6bd63932752b admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:13.388673 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d3aa5d-807f-41ec-990d-6bd63932752b admin admin] PATH_INFO: `/v3/roles` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:13.389431 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d3aa5d-807f-41ec-990d-6bd63932752b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:49:13.391280 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d3aa5d-807f-41ec-990d-6bd63932752b admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:49:13.407731 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 858/1701] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 30 00:49:13 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 00:49:13.411941 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6553e544-21eb-4f37-b146-06574a13fd76 admin admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:49:13.428770 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6553e544-21eb-4f37-b146-06574a13fd76 admin admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:49:13.436126 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528179c7-8412-4b2a-8ec4-4abdd7c8422f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:49:13.437187 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528179c7-8412-4b2a-8ec4-4abdd7c8422f admin admin] REQUEST_METHOD: `PUT` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:13.437530 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528179c7-8412-4b2a-8ec4-4abdd7c8422f admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:13.437865 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528179c7-8412-4b2a-8ec4-4abdd7c8422f admin admin] PATH_INFO: `/v3/projects/936b7cbde8bb4ffa9259ab65891f6584/users/b92e737978fc4273a2aa88204f65872b/roles/6ccaa8c11f29456fb4e4eeccb21616c7` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:13.441732 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528179c7-8412-4b2a-8ec4-4abdd7c8422f admin admin] RBAC: Authorizing `identity:create_grant(project_id=936b7cbde8bb4ffa9259ab65891f6584, user_id=b92e737978fc4273a2aa88204f65872b, role_id=6ccaa8c11f29456fb4e4eeccb21616c7)` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:49:13.447408 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528179c7-8412-4b2a-8ec4-4abdd7c8422f admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:49:13.471108 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 844/1702] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 30 00:49:13 2022] PUT /identity/v3/projects/936b7cbde8bb4ffa9259ab65891f6584/users/b92e737978fc4273a2aa88204f65872b/roles/6ccaa8c11f29456fb4e4eeccb21616c7 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 00:49:13.481268 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a29341-44de-4ff3-a201-e392df625d30 None None] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:13.481552 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a29341-44de-4ff3-a201-e392df625d30 None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:13.481825 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a29341-44de-4ff3-a201-e392df625d30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:13.491635 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:49:13.514782 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.auth.core [None req-70a29341-44de-4ff3-a201-e392df625d30 None None] MFA Rules not processed for user `b92e737978fc4273a2aa88204f65872b`. Rule list: `[]` (Enabled: `True`). {{(pid=87956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:49:13.516287 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-70a29341-44de-4ff3-a201-e392df625d30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:49:13.596198 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 859/1703] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 30 00:49:13 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 30 00:49:13.608044 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528179c7-8412-4b2a-8ec4-4abdd7c8422f admin admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:49:13.609905 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-528179c7-8412-4b2a-8ec4-4abdd7c8422f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:49:13.677783 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528179c7-8412-4b2a-8ec4-4abdd7c8422f admin admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:49:13.681510 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb40d299-aa70-472f-9245-23b837cd1d1e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48d928ff7fe24348ac900f09c56acc20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d2387fdf794d4eaef07bbcd7b39f2a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:49:13.682397 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb40d299-aa70-472f-9245-23b837cd1d1e service cinder] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:13.682805 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb40d299-aa70-472f-9245-23b837cd1d1e service cinder] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:13.682978 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb40d299-aa70-472f-9245-23b837cd1d1e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:13.685573 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-fb40d299-aa70-472f-9245-23b837cd1d1e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:49:13.701141 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:49:13.790243 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb40d299-aa70-472f-9245-23b837cd1d1e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:49:13.798354 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb40d299-aa70-472f-9245-23b837cd1d1e service cinder] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:49:13.805875 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 845/1704] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 30 00:49:13 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 00:49:13.975512 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a29341-44de-4ff3-a201-e392df625d30 None None] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:49:13.984878 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-70a29341-44de-4ff3-a201-e392df625d30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:49:14.168795 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a29341-44de-4ff3-a201-e392df625d30 None None] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:49:14.195612 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078033b7-8d9a-428a-9734-1970fce06cbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:49:14.196186 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078033b7-8d9a-428a-9734-1970fce06cbd admin admin] REQUEST_METHOD: `DELETE` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:14.196462 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078033b7-8d9a-428a-9734-1970fce06cbd admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:14.196781 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078033b7-8d9a-428a-9734-1970fce06cbd admin admin] PATH_INFO: `/v3/projects/3587b0af52014115a157628fd7e91d5d` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:14.197940 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078033b7-8d9a-428a-9734-1970fce06cbd admin admin] RBAC: Authorizing `identity:delete_project(project_id=3587b0af52014115a157628fd7e91d5d)` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:49:14.201371 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078033b7-8d9a-428a-9734-1970fce06cbd admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:49:14.288546 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-078033b7-8d9a-428a-9734-1970fce06cbd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3587b0af52014115a157628fd7e91d5d', 'request_id': 'req-078033b7-8d9a-428a-9734-1970fce06cbd'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:49:14.297322 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-078033b7-8d9a-428a-9734-1970fce06cbd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3587b0af52014115a157628fd7e91d5d', 'request_id': 'req-078033b7-8d9a-428a-9734-1970fce06cbd'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:49:14.305966 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-078033b7-8d9a-428a-9734-1970fce06cbd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3587b0af52014115a157628fd7e91d5d', 'request_id': 'req-078033b7-8d9a-428a-9734-1970fce06cbd'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:49:14.317794 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-078033b7-8d9a-428a-9734-1970fce06cbd admin admin] The token cache is being invalidate because project 3587b0af52014115a157628fd7e91d5d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87956) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 00:49:14.318086 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-078033b7-8d9a-428a-9734-1970fce06cbd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:49:14.318733 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-078033b7-8d9a-428a-9734-1970fce06cbd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:49:14.320265 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 860/1705] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 30 00:49:13 2022] DELETE /identity/v3/projects/3587b0af52014115a157628fd7e91d5d => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 00:49:14.324203 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb40d299-aa70-472f-9245-23b837cd1d1e service cinder] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:49:14.337544 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb40d299-aa70-472f-9245-23b837cd1d1e service cinder] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:49:14.410277 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4ace7a-e155-4b7f-ac3d-3b28a5974d48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:49:14.410923 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4ace7a-e155-4b7f-ac3d-3b28a5974d48 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:14.411367 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4ace7a-e155-4b7f-ac3d-3b28a5974d48 admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:14.411642 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4ace7a-e155-4b7f-ac3d-3b28a5974d48 admin admin] PATH_INFO: `/v3/users/7c69560f374b40c3bf43d6dcbfc0fce9` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:14.413224 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4ace7a-e155-4b7f-ac3d-3b28a5974d48 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7c69560f374b40c3bf43d6dcbfc0fce9)` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:49:14.415171 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4ace7a-e155-4b7f-ac3d-3b28a5974d48 admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:49:14.466670 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-eb4ace7a-e155-4b7f-ac3d-3b28a5974d48 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7c69560f374b40c3bf43d6dcbfc0fce9'} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:49:14.467455 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-eb4ace7a-e155-4b7f-ac3d-3b28a5974d48 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7c69560f374b40c3bf43d6dcbfc0fce9'} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:49:14.474752 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-eb4ace7a-e155-4b7f-ac3d-3b28a5974d48 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7c69560f374b40c3bf43d6dcbfc0fce9'} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:49:14.475509 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-eb4ace7a-e155-4b7f-ac3d-3b28a5974d48 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7c69560f374b40c3bf43d6dcbfc0fce9'} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:49:14.489281 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-eb4ace7a-e155-4b7f-ac3d-3b28a5974d48 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7c69560f374b40c3bf43d6dcbfc0fce9'} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:49:14.504376 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 846/1706] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 30 00:49:14 2022] DELETE /identity/v3/users/7c69560f374b40c3bf43d6dcbfc0fce9 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 00:49:14.830302 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078033b7-8d9a-428a-9734-1970fce06cbd admin admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:49:14.831984 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-078033b7-8d9a-428a-9734-1970fce06cbd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:49:14.879513 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078033b7-8d9a-428a-9734-1970fce06cbd admin admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:49:14.901783 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:49:14.979368 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5355a655-d066-4561-b7bb-bb10cd7dfc29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:49:14.980012 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5355a655-d066-4561-b7bb-bb10cd7dfc29 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:14.980285 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5355a655-d066-4561-b7bb-bb10cd7dfc29 admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:14.980598 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5355a655-d066-4561-b7bb-bb10cd7dfc29 admin admin] PATH_INFO: `/v3/projects/84ace7fb9de54f7ab51c8a59cfac4985` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:14.981700 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5355a655-d066-4561-b7bb-bb10cd7dfc29 admin admin] RBAC: Authorizing `identity:delete_project(project_id=84ace7fb9de54f7ab51c8a59cfac4985)` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:49:14.983711 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5355a655-d066-4561-b7bb-bb10cd7dfc29 admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:49:15.043994 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-5355a655-d066-4561-b7bb-bb10cd7dfc29 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '84ace7fb9de54f7ab51c8a59cfac4985', 'request_id': 'req-5355a655-d066-4561-b7bb-bb10cd7dfc29'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:49:15.063028 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-5355a655-d066-4561-b7bb-bb10cd7dfc29 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '84ace7fb9de54f7ab51c8a59cfac4985', 'request_id': 'req-5355a655-d066-4561-b7bb-bb10cd7dfc29'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:49:15.070477 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-5355a655-d066-4561-b7bb-bb10cd7dfc29 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '84ace7fb9de54f7ab51c8a59cfac4985', 'request_id': 'req-5355a655-d066-4561-b7bb-bb10cd7dfc29'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:49:15.084678 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-5355a655-d066-4561-b7bb-bb10cd7dfc29 admin admin] The token cache is being invalidate because project 84ace7fb9de54f7ab51c8a59cfac4985 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87956) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 00:49:15.084993 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-5355a655-d066-4561-b7bb-bb10cd7dfc29 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:49:15.085654 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-5355a655-d066-4561-b7bb-bb10cd7dfc29 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:49:15.090695 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 861/1707] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 30 00:49:14 2022] DELETE /identity/v3/projects/84ace7fb9de54f7ab51c8a59cfac4985 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 00:49:15.092537 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427805a3-e02f-4828-91c8-7c27728e8b7e None None] REQUEST_METHOD: `POST` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:15.093038 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427805a3-e02f-4828-91c8-7c27728e8b7e None None] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:15.093182 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427805a3-e02f-4828-91c8-7c27728e8b7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:15.113837 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.auth.core [None req-427805a3-e02f-4828-91c8-7c27728e8b7e None None] MFA Rules not processed for user `eb55b6cbca4945abb21b0e49eb745e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=87955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:49:15.115118 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-427805a3-e02f-4828-91c8-7c27728e8b7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:49:15.152567 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:49:15.225526 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 847/1708] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 30 00:49:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 30 00:49:15.234028 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd6ef0c-5d0f-4462-8a8b-499593dd636b None None] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:15.234541 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd6ef0c-5d0f-4462-8a8b-499593dd636b None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:15.234881 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd6ef0c-5d0f-4462-8a8b-499593dd636b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:15.268262 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.auth.core [None req-0cd6ef0c-5d0f-4462-8a8b-499593dd636b None None] MFA Rules not processed for user `eb55b6cbca4945abb21b0e49eb745e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=87956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:49:15.269343 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-0cd6ef0c-5d0f-4462-8a8b-499593dd636b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:49:15.303425 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 862/1709] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 30 00:49:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:49:15.307613 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427805a3-e02f-4828-91c8-7c27728e8b7e None None] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:49:15.320164 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427805a3-e02f-4828-91c8-7c27728e8b7e None None] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:49:15.335887 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fed8867-65c8-49de-94d5-ab2fb3cb17af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:49:15.336815 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fed8867-65c8-49de-94d5-ab2fb3cb17af admin admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:15.337473 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fed8867-65c8-49de-94d5-ab2fb3cb17af admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:15.337834 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fed8867-65c8-49de-94d5-ab2fb3cb17af admin admin] PATH_INFO: `/v3/domains` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:15.339680 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fed8867-65c8-49de-94d5-ab2fb3cb17af admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:49:15.340203 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fed8867-65c8-49de-94d5-ab2fb3cb17af admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:49:15.342590 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fed8867-65c8-49de-94d5-ab2fb3cb17af admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:49:15.358692 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 848/1710] 10.222.0.42 () {58 vars in 1153 bytes} [Sun Oct 30 00:49:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:49:15.369888 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd6ef0c-5d0f-4462-8a8b-499593dd636b None None] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:49:15.382682 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd6ef0c-5d0f-4462-8a8b-499593dd636b None None] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:49:15.390966 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b5c958-a426-4d63-bb34-09cfe61356ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:49:15.391755 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b5c958-a426-4d63-bb34-09cfe61356ef admin admin] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:15.392167 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b5c958-a426-4d63-bb34-09cfe61356ef admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:15.392555 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b5c958-a426-4d63-bb34-09cfe61356ef admin admin] PATH_INFO: `/v3/projects` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:15.393298 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b5c958-a426-4d63-bb34-09cfe61356ef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:49:15.395323 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b5c958-a426-4d63-bb34-09cfe61356ef admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:49:15.454742 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 863/1711] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 30 00:49:15 2022] POST /identity/v3/projects => generated 385 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 00:49:15.455665 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fed8867-65c8-49de-94d5-ab2fb3cb17af admin admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:49:15.466455 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fed8867-65c8-49de-94d5-ab2fb3cb17af admin admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:49:15.567157 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2dd1cdb-0b03-4ad3-93a9-30210e69b376 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:49:15.568926 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dd1cdb-0b03-4ad3-93a9-30210e69b376 admin admin] REQUEST_METHOD: `POST` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:15.569308 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dd1cdb-0b03-4ad3-93a9-30210e69b376 admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:15.569778 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dd1cdb-0b03-4ad3-93a9-30210e69b376 admin admin] PATH_INFO: `/v3/users` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:15.570521 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2dd1cdb-0b03-4ad3-93a9-30210e69b376 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:49:15.581077 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2dd1cdb-0b03-4ad3-93a9-30210e69b376 admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:49:15.622894 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 849/1712] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 30 00:49:15 2022] POST /identity/v3/users => generated 293 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 30 00:49:15.624195 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b5c958-a426-4d63-bb34-09cfe61356ef admin admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:49:15.639448 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b5c958-a426-4d63-bb34-09cfe61356ef admin admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:49:15.645597 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5274f468-b6fc-4509-9bed-39d1d14417fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:49:15.646507 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5274f468-b6fc-4509-9bed-39d1d14417fb admin admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:15.646982 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5274f468-b6fc-4509-9bed-39d1d14417fb admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:15.647483 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5274f468-b6fc-4509-9bed-39d1d14417fb admin admin] PATH_INFO: `/v3/roles` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:15.649112 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2dd1cdb-0b03-4ad3-93a9-30210e69b376 admin admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:49:15.651143 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-e2dd1cdb-0b03-4ad3-93a9-30210e69b376 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:49:15.655558 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5274f468-b6fc-4509-9bed-39d1d14417fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:49:15.657677 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5274f468-b6fc-4509-9bed-39d1d14417fb admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:49:15.673192 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 864/1713] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 30 00:49:15 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 30 00:49:15.677326 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5274f468-b6fc-4509-9bed-39d1d14417fb admin admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:49:15.691466 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5274f468-b6fc-4509-9bed-39d1d14417fb admin admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:49:15.697355 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2360a9ce-31b5-44fa-b276-488e0ee011a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:49:15.698585 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2360a9ce-31b5-44fa-b276-488e0ee011a1 admin admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:15.698861 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2360a9ce-31b5-44fa-b276-488e0ee011a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:15.699128 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2360a9ce-31b5-44fa-b276-488e0ee011a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:15.700171 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2360a9ce-31b5-44fa-b276-488e0ee011a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:49:15.702012 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2360a9ce-31b5-44fa-b276-488e0ee011a1 admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:49:15.715642 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 865/1714] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 30 00:49:15 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 30 00:49:15.720390 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2360a9ce-31b5-44fa-b276-488e0ee011a1 admin admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:49:15.725423 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2dd1cdb-0b03-4ad3-93a9-30210e69b376 admin admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:49:15.729971 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304cfde0-ffa5-428f-b718-005841439803 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48d928ff7fe24348ac900f09c56acc20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d2387fdf794d4eaef07bbcd7b39f2a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:49:15.730717 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304cfde0-ffa5-428f-b718-005841439803 service cinder] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:15.731966 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304cfde0-ffa5-428f-b718-005841439803 service cinder] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:15.732670 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304cfde0-ffa5-428f-b718-005841439803 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:15.734147 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2360a9ce-31b5-44fa-b276-488e0ee011a1 admin admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:49:15.734555 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-304cfde0-ffa5-428f-b718-005841439803 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:49:15.741497 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db7d73c-caf2-4f3a-af02-82f791d81b68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:49:15.741497 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db7d73c-caf2-4f3a-af02-82f791d81b68 admin admin] REQUEST_METHOD: `PUT` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:15.741897 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db7d73c-caf2-4f3a-af02-82f791d81b68 admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:15.741897 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db7d73c-caf2-4f3a-af02-82f791d81b68 admin admin] PATH_INFO: `/v3/projects/d25d9cc9e7b241999dafc66a7a43f478/users/15961986f86d457291a0db7fa343d9c7/roles/1c93019874174c4b91118d9ce2347e47` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:15.761685 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db7d73c-caf2-4f3a-af02-82f791d81b68 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d25d9cc9e7b241999dafc66a7a43f478, user_id=15961986f86d457291a0db7fa343d9c7, role_id=1c93019874174c4b91118d9ce2347e47)` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:49:15.764895 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db7d73c-caf2-4f3a-af02-82f791d81b68 admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:49:15.802597 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 866/1715] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 30 00:49:15 2022] PUT /identity/v3/projects/d25d9cc9e7b241999dafc66a7a43f478/users/15961986f86d457291a0db7fa343d9c7/roles/1c93019874174c4b91118d9ce2347e47 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 00:49:15.804329 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3699a86-91b8-44c1-960b-b0e704d93ef8 None None] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:15.804688 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3699a86-91b8-44c1-960b-b0e704d93ef8 None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:15.805024 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3699a86-91b8-44c1-960b-b0e704d93ef8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:15.845375 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304cfde0-ffa5-428f-b718-005841439803 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:49:15.847333 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304cfde0-ffa5-428f-b718-005841439803 service cinder] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:49:15.858881 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.auth.core [None req-a3699a86-91b8-44c1-960b-b0e704d93ef8 None None] MFA Rules not processed for user `15961986f86d457291a0db7fa343d9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=87956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:49:15.865507 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-a3699a86-91b8-44c1-960b-b0e704d93ef8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:49:15.869141 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 850/1716] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 30 00:49:15 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 30 00:49:15.905450 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:49:16.002845 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 867/1717] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 30 00:49:15 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:49:16.337093 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304cfde0-ffa5-428f-b718-005841439803 service cinder] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:49:16.338717 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-304cfde0-ffa5-428f-b718-005841439803 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:49:16.346709 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:49:16.351525 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304cfde0-ffa5-428f-b718-005841439803 service cinder] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:49:16.421454 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202460f4-f628-4c15-bfaf-54e9c945cdf7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48d928ff7fe24348ac900f09c56acc20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d2387fdf794d4eaef07bbcd7b39f2a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:49:16.422534 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202460f4-f628-4c15-bfaf-54e9c945cdf7 service cinder] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:16.423087 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202460f4-f628-4c15-bfaf-54e9c945cdf7 service cinder] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:16.423528 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202460f4-f628-4c15-bfaf-54e9c945cdf7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:16.433964 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202460f4-f628-4c15-bfaf-54e9c945cdf7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:49:16.436861 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202460f4-f628-4c15-bfaf-54e9c945cdf7 service cinder] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:49:16.461466 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 851/1718] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 30 00:49:16 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 00:49:16.472600 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3699a86-91b8-44c1-960b-b0e704d93ef8 None None] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:49:16.574991 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3699a86-91b8-44c1-960b-b0e704d93ef8 None None] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:49:16.579431 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efd5697-d79c-422e-84bd-05b4ae599497 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:49:16.580441 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efd5697-d79c-422e-84bd-05b4ae599497 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:16.580714 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efd5697-d79c-422e-84bd-05b4ae599497 admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:16.580980 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efd5697-d79c-422e-84bd-05b4ae599497 admin admin] PATH_INFO: `/v3/users/15961986f86d457291a0db7fa343d9c7` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:16.583734 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efd5697-d79c-422e-84bd-05b4ae599497 admin admin] RBAC: Authorizing `identity:delete_user(user_id=15961986f86d457291a0db7fa343d9c7)` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:49:16.586468 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efd5697-d79c-422e-84bd-05b4ae599497 admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:49:16.674652 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-9efd5697-d79c-422e-84bd-05b4ae599497 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '15961986f86d457291a0db7fa343d9c7'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:49:16.679836 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-9efd5697-d79c-422e-84bd-05b4ae599497 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '15961986f86d457291a0db7fa343d9c7'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:49:16.712444 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-9efd5697-d79c-422e-84bd-05b4ae599497 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '15961986f86d457291a0db7fa343d9c7'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:49:16.722039 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-9efd5697-d79c-422e-84bd-05b4ae599497 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '15961986f86d457291a0db7fa343d9c7'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:49:16.729807 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-9efd5697-d79c-422e-84bd-05b4ae599497 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '15961986f86d457291a0db7fa343d9c7'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:49:16.739184 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 868/1719] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 30 00:49:16 2022] DELETE /identity/v3/users/15961986f86d457291a0db7fa343d9c7 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 00:49:16.742705 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0164f83-5268-436f-adea-364085f18fc5 None None] REQUEST_METHOD: `POST` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:16.743391 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0164f83-5268-436f-adea-364085f18fc5 None None] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:16.744016 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0164f83-5268-436f-adea-364085f18fc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:16.788677 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.auth.core [None req-f0164f83-5268-436f-adea-364085f18fc5 None None] MFA Rules not processed for user `eb55b6cbca4945abb21b0e49eb745e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=87955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:49:16.790013 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-f0164f83-5268-436f-adea-364085f18fc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:49:16.869710 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 852/1720] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 30 00:49:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:49:16.879695 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efd5697-d79c-422e-84bd-05b4ae599497 admin admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:49:16.881163 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-9efd5697-d79c-422e-84bd-05b4ae599497 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:49:16.964247 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:49:16.989257 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efd5697-d79c-422e-84bd-05b4ae599497 admin admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:49:16.994889 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23d75e5-a4f3-4d73-820f-20d0dc5f7f27 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5693f186c6ad4d9394f02ee3477cdcd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d2387fdf794d4eaef07bbcd7b39f2a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:49:16.995552 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23d75e5-a4f3-4d73-820f-20d0dc5f7f27 service neutron] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:16.995830 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23d75e5-a4f3-4d73-820f-20d0dc5f7f27 service neutron] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:16.996098 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23d75e5-a4f3-4d73-820f-20d0dc5f7f27 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:17.013861 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23d75e5-a4f3-4d73-820f-20d0dc5f7f27 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:49:17.015928 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23d75e5-a4f3-4d73-820f-20d0dc5f7f27 service neutron] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:49:17.031829 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 869/1721] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 30 00:49:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 00:49:17.095633 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0164f83-5268-436f-adea-364085f18fc5 None None] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:49:17.099083 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-f0164f83-5268-436f-adea-364085f18fc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:49:17.201147 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0164f83-5268-436f-adea-364085f18fc5 None None] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:49:17.205633 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31c6a00-c549-423d-9c6f-f34405c7ecff service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48d928ff7fe24348ac900f09c56acc20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d2387fdf794d4eaef07bbcd7b39f2a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:49:17.206375 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31c6a00-c549-423d-9c6f-f34405c7ecff service cinder] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:17.206801 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31c6a00-c549-423d-9c6f-f34405c7ecff service cinder] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:17.207100 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31c6a00-c549-423d-9c6f-f34405c7ecff service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:17.209302 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-d31c6a00-c549-423d-9c6f-f34405c7ecff service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:49:17.291474 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31c6a00-c549-423d-9c6f-f34405c7ecff service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:49:17.293217 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31c6a00-c549-423d-9c6f-f34405c7ecff service cinder] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:49:17.298397 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=100 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:49:17.306418 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 853/1722] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 30 00:49:17 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 00:49:17.430839 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23d75e5-a4f3-4d73-820f-20d0dc5f7f27 service neutron] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:49:17.438403 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-e23d75e5-a4f3-4d73-820f-20d0dc5f7f27 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:49:17.467390 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23d75e5-a4f3-4d73-820f-20d0dc5f7f27 service neutron] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:49:17.472966 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878b7cd8-de7b-4338-9ffc-7f3457b612f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:49:17.473660 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878b7cd8-de7b-4338-9ffc-7f3457b612f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:17.473993 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878b7cd8-de7b-4338-9ffc-7f3457b612f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:17.474353 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878b7cd8-de7b-4338-9ffc-7f3457b612f6 admin admin] PATH_INFO: `/v3/projects/d25d9cc9e7b241999dafc66a7a43f478` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:17.475546 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878b7cd8-de7b-4338-9ffc-7f3457b612f6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d25d9cc9e7b241999dafc66a7a43f478)` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:49:17.477491 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878b7cd8-de7b-4338-9ffc-7f3457b612f6 admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:49:17.526617 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-878b7cd8-de7b-4338-9ffc-7f3457b612f6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd25d9cc9e7b241999dafc66a7a43f478', 'request_id': 'req-878b7cd8-de7b-4338-9ffc-7f3457b612f6'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:49:17.539437 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-878b7cd8-de7b-4338-9ffc-7f3457b612f6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd25d9cc9e7b241999dafc66a7a43f478', 'request_id': 'req-878b7cd8-de7b-4338-9ffc-7f3457b612f6'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:49:17.551717 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-878b7cd8-de7b-4338-9ffc-7f3457b612f6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd25d9cc9e7b241999dafc66a7a43f478', 'request_id': 'req-878b7cd8-de7b-4338-9ffc-7f3457b612f6'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:49:17.564776 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-878b7cd8-de7b-4338-9ffc-7f3457b612f6 admin admin] The token cache is being invalidate because project d25d9cc9e7b241999dafc66a7a43f478 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87956) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 00:49:17.565063 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-878b7cd8-de7b-4338-9ffc-7f3457b612f6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:49:17.565728 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-878b7cd8-de7b-4338-9ffc-7f3457b612f6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:49:17.570942 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 870/1723] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 30 00:49:17 2022] DELETE /identity/v3/projects/d25d9cc9e7b241999dafc66a7a43f478 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 00:49:17.572657 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d8e06f-297e-49e4-9371-e9974e4b3d68 None None] REQUEST_METHOD: `POST` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:17.573113 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d8e06f-297e-49e4-9371-e9974e4b3d68 None None] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:17.573224 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d8e06f-297e-49e4-9371-e9974e4b3d68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:17.608777 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.auth.core [None req-59d8e06f-297e-49e4-9371-e9974e4b3d68 None None] MFA Rules not processed for user `eb55b6cbca4945abb21b0e49eb745e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=87955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:49:17.610010 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-59d8e06f-297e-49e4-9371-e9974e4b3d68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:49:17.688723 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 854/1724] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 30 00:49:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:49:17.697780 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c431402a-ced3-4a67-a444-6ebc3913f6bf None None] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:17.698060 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c431402a-ced3-4a67-a444-6ebc3913f6bf None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:17.698334 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c431402a-ced3-4a67-a444-6ebc3913f6bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:17.743017 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.auth.core [None req-c431402a-ced3-4a67-a444-6ebc3913f6bf None None] MFA Rules not processed for user `eb55b6cbca4945abb21b0e49eb745e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=87956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:49:17.744553 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-c431402a-ced3-4a67-a444-6ebc3913f6bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:49:17.757132 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 871/1725] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 30 00:49:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:49:17.762215 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d8e06f-297e-49e4-9371-e9974e4b3d68 None None] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:49:17.773124 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d8e06f-297e-49e4-9371-e9974e4b3d68 None None] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:49:17.778221 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34be5a0-41f7-4dce-83d1-60f182e757e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:49:17.778892 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34be5a0-41f7-4dce-83d1-60f182e757e8 admin admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:17.779165 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34be5a0-41f7-4dce-83d1-60f182e757e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:17.779468 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34be5a0-41f7-4dce-83d1-60f182e757e8 admin admin] PATH_INFO: `/v3/domains` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:17.780124 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34be5a0-41f7-4dce-83d1-60f182e757e8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:49:17.780422 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34be5a0-41f7-4dce-83d1-60f182e757e8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:49:17.782184 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34be5a0-41f7-4dce-83d1-60f182e757e8 admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:49:17.800545 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c431402a-ced3-4a67-a444-6ebc3913f6bf None None] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:49:17.805400 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 855/1726] 10.222.0.42 () {58 vars in 1153 bytes} [Sun Oct 30 00:49:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:49:17.811316 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c431402a-ced3-4a67-a444-6ebc3913f6bf None None] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:49:17.816385 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9554c9f-91ce-45ae-a34c-f86f70b6d4ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:49:17.817009 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9554c9f-91ce-45ae-a34c-f86f70b6d4ee admin admin] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:17.817279 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9554c9f-91ce-45ae-a34c-f86f70b6d4ee admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:17.817546 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9554c9f-91ce-45ae-a34c-f86f70b6d4ee admin admin] PATH_INFO: `/v3/projects` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:17.818251 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9554c9f-91ce-45ae-a34c-f86f70b6d4ee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:49:17.820387 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9554c9f-91ce-45ae-a34c-f86f70b6d4ee admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:49:17.863413 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 872/1727] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 30 00:49:17 2022] POST /identity/v3/projects => generated 375 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 00:49:17.865806 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34be5a0-41f7-4dce-83d1-60f182e757e8 admin admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:49:17.880260 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34be5a0-41f7-4dce-83d1-60f182e757e8 admin admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:49:17.957827 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0a61e5-15c6-48aa-afbb-ca0a07bfd011 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:49:17.958699 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0a61e5-15c6-48aa-afbb-ca0a07bfd011 admin admin] REQUEST_METHOD: `POST` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:17.958957 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0a61e5-15c6-48aa-afbb-ca0a07bfd011 admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:17.959478 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0a61e5-15c6-48aa-afbb-ca0a07bfd011 admin admin] PATH_INFO: `/v3/users` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:17.960379 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0a61e5-15c6-48aa-afbb-ca0a07bfd011 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:49:17.962564 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0a61e5-15c6-48aa-afbb-ca0a07bfd011 admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:49:17.992831 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 856/1728] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 30 00:49:17 2022] POST /identity/v3/users => generated 288 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 30 00:49:17.993502 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9554c9f-91ce-45ae-a34c-f86f70b6d4ee admin admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:49:18.005322 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9554c9f-91ce-45ae-a34c-f86f70b6d4ee admin admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:49:18.010681 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf1b4c5-96aa-4df7-a585-86ae17cc5f3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:49:18.011361 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf1b4c5-96aa-4df7-a585-86ae17cc5f3d admin admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:18.011664 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf1b4c5-96aa-4df7-a585-86ae17cc5f3d admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:18.011977 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf1b4c5-96aa-4df7-a585-86ae17cc5f3d admin admin] PATH_INFO: `/v3/roles` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:18.012655 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf1b4c5-96aa-4df7-a585-86ae17cc5f3d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:49:18.014902 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf1b4c5-96aa-4df7-a585-86ae17cc5f3d admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:49:18.026654 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 873/1729] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 30 00:49:17 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 00:49:18.030761 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0a61e5-15c6-48aa-afbb-ca0a07bfd011 admin admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:49:18.041441 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0a61e5-15c6-48aa-afbb-ca0a07bfd011 admin admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:49:18.056126 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cbf02b-2316-4a07-9b2a-7b3d9fb7d5ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:49:18.056753 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cbf02b-2316-4a07-9b2a-7b3d9fb7d5ed admin admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:18.057032 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cbf02b-2316-4a07-9b2a-7b3d9fb7d5ed admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:18.057301 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cbf02b-2316-4a07-9b2a-7b3d9fb7d5ed admin admin] PATH_INFO: `/v3/roles` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:18.057966 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21cbf02b-2316-4a07-9b2a-7b3d9fb7d5ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:49:18.059602 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21cbf02b-2316-4a07-9b2a-7b3d9fb7d5ed admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:49:18.072458 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 857/1730] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 30 00:49:18 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 00:49:18.077115 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf1b4c5-96aa-4df7-a585-86ae17cc5f3d admin admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:49:18.091323 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf1b4c5-96aa-4df7-a585-86ae17cc5f3d admin admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:49:18.105716 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916f3409-15ba-4ad0-aca0-76de82403bfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:49:18.105716 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916f3409-15ba-4ad0-aca0-76de82403bfa admin admin] REQUEST_METHOD: `PUT` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:18.105716 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916f3409-15ba-4ad0-aca0-76de82403bfa admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:18.105716 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916f3409-15ba-4ad0-aca0-76de82403bfa admin admin] PATH_INFO: `/v3/projects/802fe1a427254bccba0eba0055667b70/users/5afcd71a50c7425fb01b364d4b97cdbd/roles/1c93019874174c4b91118d9ce2347e47` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:18.125978 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916f3409-15ba-4ad0-aca0-76de82403bfa admin admin] RBAC: Authorizing `identity:create_grant(project_id=802fe1a427254bccba0eba0055667b70, user_id=5afcd71a50c7425fb01b364d4b97cdbd, role_id=1c93019874174c4b91118d9ce2347e47)` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:49:18.129054 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916f3409-15ba-4ad0-aca0-76de82403bfa admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:49:18.151239 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 874/1731] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 30 00:49:18 2022] PUT /identity/v3/projects/802fe1a427254bccba0eba0055667b70/users/5afcd71a50c7425fb01b364d4b97cdbd/roles/1c93019874174c4b91118d9ce2347e47 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 00:49:18.158811 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6234a6-5d42-4831-83f3-b022635365fd None None] REQUEST_METHOD: `POST` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:18.159086 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6234a6-5d42-4831-83f3-b022635365fd None None] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:18.159440 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6234a6-5d42-4831-83f3-b022635365fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:18.194135 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.auth.core [None req-bb6234a6-5d42-4831-83f3-b022635365fd None None] MFA Rules not processed for user `5afcd71a50c7425fb01b364d4b97cdbd`. Rule list: `[]` (Enabled: `True`). {{(pid=87955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:49:18.195379 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-bb6234a6-5d42-4831-83f3-b022635365fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:49:18.271871 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:49:18.285326 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 858/1732] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 30 00:49:18 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:49:18.296014 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916f3409-15ba-4ad0-aca0-76de82403bfa admin admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:49:18.297864 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-916f3409-15ba-4ad0-aca0-76de82403bfa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:49:18.362180 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916f3409-15ba-4ad0-aca0-76de82403bfa admin admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:49:18.366873 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9de5d6-8c22-4648-bc1e-6f6d8ad3850f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48d928ff7fe24348ac900f09c56acc20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d2387fdf794d4eaef07bbcd7b39f2a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:49:18.367082 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9de5d6-8c22-4648-bc1e-6f6d8ad3850f service cinder] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:18.367395 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9de5d6-8c22-4648-bc1e-6f6d8ad3850f service cinder] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:18.367709 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9de5d6-8c22-4648-bc1e-6f6d8ad3850f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:18.378508 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9de5d6-8c22-4648-bc1e-6f6d8ad3850f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:49:18.380132 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9de5d6-8c22-4648-bc1e-6f6d8ad3850f service cinder] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:49:18.391104 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 875/1733] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 30 00:49:18 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 00:49:21.501854 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6234a6-5d42-4831-83f3-b022635365fd None None] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:49:21.504176 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-bb6234a6-5d42-4831-83f3-b022635365fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:49:21.581318 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6234a6-5d42-4831-83f3-b022635365fd None None] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:49:21.586688 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8fc208-fdc0-4926-8591-96e267b8a002 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:49:21.587370 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8fc208-fdc0-4926-8591-96e267b8a002 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:21.587663 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8fc208-fdc0-4926-8591-96e267b8a002 admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:21.587993 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8fc208-fdc0-4926-8591-96e267b8a002 admin admin] PATH_INFO: `/v3/users/4327088631654f3e8c3f1dc5ca373504` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:21.589249 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8fc208-fdc0-4926-8591-96e267b8a002 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4327088631654f3e8c3f1dc5ca373504)` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:49:21.591903 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8fc208-fdc0-4926-8591-96e267b8a002 admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:49:21.649215 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-bd8fc208-fdc0-4926-8591-96e267b8a002 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4327088631654f3e8c3f1dc5ca373504'} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:49:21.649915 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-bd8fc208-fdc0-4926-8591-96e267b8a002 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4327088631654f3e8c3f1dc5ca373504'} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:49:21.657298 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-bd8fc208-fdc0-4926-8591-96e267b8a002 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4327088631654f3e8c3f1dc5ca373504'} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:49:21.657947 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-bd8fc208-fdc0-4926-8591-96e267b8a002 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4327088631654f3e8c3f1dc5ca373504'} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:49:21.670033 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-bd8fc208-fdc0-4926-8591-96e267b8a002 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4327088631654f3e8c3f1dc5ca373504'} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:49:21.687809 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 859/1734] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 30 00:49:21 2022] DELETE /identity/v3/users/4327088631654f3e8c3f1dc5ca373504 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 00:49:21.692268 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2252ac70-976b-4864-a2bd-21ff6e1374ad None None] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:21.692744 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2252ac70-976b-4864-a2bd-21ff6e1374ad None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:21.692864 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2252ac70-976b-4864-a2bd-21ff6e1374ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:21.714564 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.auth.core [None req-2252ac70-976b-4864-a2bd-21ff6e1374ad None None] MFA Rules not processed for user `eb55b6cbca4945abb21b0e49eb745e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=87956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:49:21.715850 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-2252ac70-976b-4864-a2bd-21ff6e1374ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:49:21.719992 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:49:21.807462 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 876/1735] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 30 00:49:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 30 00:49:21.819154 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8fc208-fdc0-4926-8591-96e267b8a002 admin admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:49:21.824546 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-bd8fc208-fdc0-4926-8591-96e267b8a002 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:49:21.895332 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2252ac70-976b-4864-a2bd-21ff6e1374ad None None] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:49:21.897454 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-2252ac70-976b-4864-a2bd-21ff6e1374ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:49:21.912204 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2252ac70-976b-4864-a2bd-21ff6e1374ad None None] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:49:21.929195 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1fd231-650e-491a-8277-851a208b2d22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:49:21.929195 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1fd231-650e-491a-8277-851a208b2d22 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:21.929195 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1fd231-650e-491a-8277-851a208b2d22 admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:21.929195 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1fd231-650e-491a-8277-851a208b2d22 admin admin] PATH_INFO: `/v3/users/5afcd71a50c7425fb01b364d4b97cdbd` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:21.929532 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8fc208-fdc0-4926-8591-96e267b8a002 admin admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:49:21.929623 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1fd231-650e-491a-8277-851a208b2d22 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5afcd71a50c7425fb01b364d4b97cdbd)` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:49:21.929623 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1fd231-650e-491a-8277-851a208b2d22 admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:49:21.929783 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c822b55-1955-4209-8c00-9d5222d541e7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5693f186c6ad4d9394f02ee3477cdcd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d2387fdf794d4eaef07bbcd7b39f2a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:49:21.929783 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c822b55-1955-4209-8c00-9d5222d541e7 service neutron] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:21.929783 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c822b55-1955-4209-8c00-9d5222d541e7 service neutron] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:21.929783 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c822b55-1955-4209-8c00-9d5222d541e7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:21.942488 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c822b55-1955-4209-8c00-9d5222d541e7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:49:21.943890 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c822b55-1955-4209-8c00-9d5222d541e7 service neutron] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:49:21.959065 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 860/1736] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 30 00:49:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 00:49:21.999645 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-1b1fd231-650e-491a-8277-851a208b2d22 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5afcd71a50c7425fb01b364d4b97cdbd'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:49:22.000708 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-1b1fd231-650e-491a-8277-851a208b2d22 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5afcd71a50c7425fb01b364d4b97cdbd'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:49:22.016529 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-1b1fd231-650e-491a-8277-851a208b2d22 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5afcd71a50c7425fb01b364d4b97cdbd'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:49:22.025059 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-1b1fd231-650e-491a-8277-851a208b2d22 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5afcd71a50c7425fb01b364d4b97cdbd'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:49:22.032232 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-1b1fd231-650e-491a-8277-851a208b2d22 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5afcd71a50c7425fb01b364d4b97cdbd'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:49:22.038651 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 877/1737] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 30 00:49:21 2022] DELETE /identity/v3/users/5afcd71a50c7425fb01b364d4b97cdbd => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 00:49:22.043433 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bac15a-4660-4b4c-bbf6-91da22fbd488 None None] REQUEST_METHOD: `POST` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:22.043723 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bac15a-4660-4b4c-bbf6-91da22fbd488 None None] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:22.044075 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bac15a-4660-4b4c-bbf6-91da22fbd488 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:22.066383 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.auth.core [None req-26bac15a-4660-4b4c-bbf6-91da22fbd488 None None] MFA Rules not processed for user `eb55b6cbca4945abb21b0e49eb745e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=87955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:49:22.067682 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-26bac15a-4660-4b4c-bbf6-91da22fbd488 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:49:22.078548 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:49:22.146488 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 861/1738] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 30 00:49:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 30 00:49:22.158356 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1fd231-650e-491a-8277-851a208b2d22 admin admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:49:22.160321 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-1b1fd231-650e-491a-8277-851a208b2d22 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:49:22.226770 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1fd231-650e-491a-8277-851a208b2d22 admin admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:49:22.235173 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38ad580-0a7f-451c-95db-eadd165e4028 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5693f186c6ad4d9394f02ee3477cdcd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d2387fdf794d4eaef07bbcd7b39f2a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:49:22.235173 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38ad580-0a7f-451c-95db-eadd165e4028 service neutron] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:22.235173 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38ad580-0a7f-451c-95db-eadd165e4028 service neutron] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:22.235173 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38ad580-0a7f-451c-95db-eadd165e4028 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:22.244582 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38ad580-0a7f-451c-95db-eadd165e4028 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:49:22.246147 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38ad580-0a7f-451c-95db-eadd165e4028 service neutron] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:49:22.256814 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 878/1739] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 30 00:49:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 00:49:22.292078 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bac15a-4660-4b4c-bbf6-91da22fbd488 None None] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:49:22.293716 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-26bac15a-4660-4b4c-bbf6-91da22fbd488 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:49:22.308355 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bac15a-4660-4b4c-bbf6-91da22fbd488 None None] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:49:22.314507 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39327885-1324-4ad9-9b57-d4ee02c4e90b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:49:22.315878 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39327885-1324-4ad9-9b57-d4ee02c4e90b admin admin] REQUEST_METHOD: `DELETE` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:22.316477 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39327885-1324-4ad9-9b57-d4ee02c4e90b admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:22.317029 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39327885-1324-4ad9-9b57-d4ee02c4e90b admin admin] PATH_INFO: `/v3/projects/2737205fcad4476d8d0b712267b02455` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:22.331021 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39327885-1324-4ad9-9b57-d4ee02c4e90b admin admin] RBAC: Authorizing `identity:delete_project(project_id=2737205fcad4476d8d0b712267b02455)` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:49:22.333312 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39327885-1324-4ad9-9b57-d4ee02c4e90b admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:49:22.388188 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-39327885-1324-4ad9-9b57-d4ee02c4e90b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2737205fcad4476d8d0b712267b02455', 'request_id': 'req-39327885-1324-4ad9-9b57-d4ee02c4e90b'} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:49:22.393841 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-39327885-1324-4ad9-9b57-d4ee02c4e90b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2737205fcad4476d8d0b712267b02455', 'request_id': 'req-39327885-1324-4ad9-9b57-d4ee02c4e90b'} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:49:22.401916 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-39327885-1324-4ad9-9b57-d4ee02c4e90b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2737205fcad4476d8d0b712267b02455', 'request_id': 'req-39327885-1324-4ad9-9b57-d4ee02c4e90b'} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:49:22.413265 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-39327885-1324-4ad9-9b57-d4ee02c4e90b admin admin] The token cache is being invalidate because project 2737205fcad4476d8d0b712267b02455 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87955) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 00:49:22.413551 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-39327885-1324-4ad9-9b57-d4ee02c4e90b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:49:22.414213 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-39327885-1324-4ad9-9b57-d4ee02c4e90b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:49:22.415784 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 862/1740] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 30 00:49:22 2022] DELETE /identity/v3/projects/2737205fcad4476d8d0b712267b02455 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 00:49:22.420052 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38ad580-0a7f-451c-95db-eadd165e4028 service neutron] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:49:22.435155 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38ad580-0a7f-451c-95db-eadd165e4028 service neutron] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:49:22.461468 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:49:22.505740 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30c1d2d-63b5-4314-b866-9903f32431aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:49:22.506386 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30c1d2d-63b5-4314-b866-9903f32431aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:22.506662 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30c1d2d-63b5-4314-b866-9903f32431aa admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:22.506969 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30c1d2d-63b5-4314-b866-9903f32431aa admin admin] PATH_INFO: `/v3/users/d59bae5e606c41409d44a930b12e1538` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:22.508115 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30c1d2d-63b5-4314-b866-9903f32431aa admin admin] RBAC: Authorizing `identity:delete_user(user_id=d59bae5e606c41409d44a930b12e1538)` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:49:22.510161 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30c1d2d-63b5-4314-b866-9903f32431aa admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:49:22.560088 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39327885-1324-4ad9-9b57-d4ee02c4e90b admin admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:49:22.561785 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-39327885-1324-4ad9-9b57-d4ee02c4e90b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:49:22.565046 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-a30c1d2d-63b5-4314-b866-9903f32431aa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd59bae5e606c41409d44a930b12e1538'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:49:22.565979 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-a30c1d2d-63b5-4314-b866-9903f32431aa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd59bae5e606c41409d44a930b12e1538'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:49:22.576222 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39327885-1324-4ad9-9b57-d4ee02c4e90b admin admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:49:22.581207 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4a657e-ef2b-4f05-9d61-dba9e6b0e849 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:49:22.581845 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4a657e-ef2b-4f05-9d61-dba9e6b0e849 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:22.582121 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4a657e-ef2b-4f05-9d61-dba9e6b0e849 admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:22.582417 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4a657e-ef2b-4f05-9d61-dba9e6b0e849 admin admin] PATH_INFO: `/v3/projects/802fe1a427254bccba0eba0055667b70` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:22.582948 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-a30c1d2d-63b5-4314-b866-9903f32431aa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd59bae5e606c41409d44a930b12e1538'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:49:22.583790 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4a657e-ef2b-4f05-9d61-dba9e6b0e849 admin admin] RBAC: Authorizing `identity:delete_project(project_id=802fe1a427254bccba0eba0055667b70)` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:49:22.585681 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4a657e-ef2b-4f05-9d61-dba9e6b0e849 admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:49:22.593269 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-a30c1d2d-63b5-4314-b866-9903f32431aa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd59bae5e606c41409d44a930b12e1538'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:49:22.603427 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-a30c1d2d-63b5-4314-b866-9903f32431aa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd59bae5e606c41409d44a930b12e1538'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:49:22.609879 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 879/1741] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 30 00:49:22 2022] DELETE /identity/v3/users/d59bae5e606c41409d44a930b12e1538 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 00:49:22.642140 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-9f4a657e-ef2b-4f05-9d61-dba9e6b0e849 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '802fe1a427254bccba0eba0055667b70', 'request_id': 'req-9f4a657e-ef2b-4f05-9d61-dba9e6b0e849'} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:49:22.650276 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-9f4a657e-ef2b-4f05-9d61-dba9e6b0e849 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '802fe1a427254bccba0eba0055667b70', 'request_id': 'req-9f4a657e-ef2b-4f05-9d61-dba9e6b0e849'} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:49:22.659846 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-9f4a657e-ef2b-4f05-9d61-dba9e6b0e849 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '802fe1a427254bccba0eba0055667b70', 'request_id': 'req-9f4a657e-ef2b-4f05-9d61-dba9e6b0e849'} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:49:22.676170 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-9f4a657e-ef2b-4f05-9d61-dba9e6b0e849 admin admin] The token cache is being invalidate because project 802fe1a427254bccba0eba0055667b70 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87955) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 00:49:22.676483 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-9f4a657e-ef2b-4f05-9d61-dba9e6b0e849 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:49:22.677198 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-9f4a657e-ef2b-4f05-9d61-dba9e6b0e849 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:49:22.679884 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 863/1742] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 30 00:49:22 2022] DELETE /identity/v3/projects/802fe1a427254bccba0eba0055667b70 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 00:49:22.684729 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3778af24-75b6-49e8-8652-362d01591a4c None None] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:22.685015 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3778af24-75b6-49e8-8652-362d01591a4c None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:22.685690 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3778af24-75b6-49e8-8652-362d01591a4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:22.712012 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.auth.core [None req-3778af24-75b6-49e8-8652-362d01591a4c None None] MFA Rules not processed for user `eb55b6cbca4945abb21b0e49eb745e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=87956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:49:22.713210 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-3778af24-75b6-49e8-8652-362d01591a4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:49:22.789976 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 880/1743] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 30 00:49:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:49:22.797997 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c369b20e-86b7-40de-8f5b-cad8274a4771 None None] REQUEST_METHOD: `POST` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:22.798285 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c369b20e-86b7-40de-8f5b-cad8274a4771 None None] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:22.798559 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c369b20e-86b7-40de-8f5b-cad8274a4771 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:22.822804 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.auth.core [None req-c369b20e-86b7-40de-8f5b-cad8274a4771 None None] MFA Rules not processed for user `eb55b6cbca4945abb21b0e49eb745e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=87955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:49:22.824460 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-c369b20e-86b7-40de-8f5b-cad8274a4771 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:49:22.835807 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 864/1744] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 30 00:49:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:49:22.840193 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3778af24-75b6-49e8-8652-362d01591a4c None None] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:49:22.859437 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3778af24-75b6-49e8-8652-362d01591a4c None None] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:49:22.878985 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd642e79-8c3a-4e49-883a-4f09013268bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:49:22.879641 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd642e79-8c3a-4e49-883a-4f09013268bc admin admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:22.879915 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd642e79-8c3a-4e49-883a-4f09013268bc admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:22.880181 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd642e79-8c3a-4e49-883a-4f09013268bc admin admin] PATH_INFO: `/v3/domains` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:22.880835 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd642e79-8c3a-4e49-883a-4f09013268bc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87956) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:49:22.881128 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd642e79-8c3a-4e49-883a-4f09013268bc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:49:22.882708 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd642e79-8c3a-4e49-883a-4f09013268bc admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:49:22.901157 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 881/1745] 10.222.0.42 () {58 vars in 1153 bytes} [Sun Oct 30 00:49:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:49:22.907152 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c369b20e-86b7-40de-8f5b-cad8274a4771 None None] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:49:22.912813 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd642e79-8c3a-4e49-883a-4f09013268bc admin admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:49:22.917845 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c369b20e-86b7-40de-8f5b-cad8274a4771 None None] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:49:22.923060 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-cd642e79-8c3a-4e49-883a-4f09013268bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:49:22.934564 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471513da-edf8-4871-8c98-4ad1bee5a2f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:49:22.946164 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471513da-edf8-4871-8c98-4ad1bee5a2f2 admin admin] REQUEST_METHOD: `POST` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:22.946443 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471513da-edf8-4871-8c98-4ad1bee5a2f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:22.946718 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471513da-edf8-4871-8c98-4ad1bee5a2f2 admin admin] PATH_INFO: `/v3/projects` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:22.950763 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471513da-edf8-4871-8c98-4ad1bee5a2f2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:49:22.953801 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471513da-edf8-4871-8c98-4ad1bee5a2f2 admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:49:22.979855 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd642e79-8c3a-4e49-883a-4f09013268bc admin admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:49:22.984831 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcbabdd-5c77-40f0-9780-d7c70ea741e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:49:22.985417 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:49:22.985527 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcbabdd-5c77-40f0-9780-d7c70ea741e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:22.985733 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcbabdd-5c77-40f0-9780-d7c70ea741e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:22.985993 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcbabdd-5c77-40f0-9780-d7c70ea741e3 admin admin] PATH_INFO: `/v3/projects/a022fcb916f74305811851efd5ed57cb` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:22.987699 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fcbabdd-5c77-40f0-9780-d7c70ea741e3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a022fcb916f74305811851efd5ed57cb)` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:49:22.995436 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fcbabdd-5c77-40f0-9780-d7c70ea741e3 admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:49:23.005760 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 865/1746] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 30 00:49:22 2022] POST /identity/v3/projects => generated 373 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 00:49:23.015402 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471513da-edf8-4871-8c98-4ad1bee5a2f2 admin admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:49:23.072588 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:49:23.125998 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-1fcbabdd-5c77-40f0-9780-d7c70ea741e3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a022fcb916f74305811851efd5ed57cb', 'request_id': 'req-1fcbabdd-5c77-40f0-9780-d7c70ea741e3'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:49:23.139399 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-1fcbabdd-5c77-40f0-9780-d7c70ea741e3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a022fcb916f74305811851efd5ed57cb', 'request_id': 'req-1fcbabdd-5c77-40f0-9780-d7c70ea741e3'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:49:23.150532 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-1fcbabdd-5c77-40f0-9780-d7c70ea741e3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a022fcb916f74305811851efd5ed57cb', 'request_id': 'req-1fcbabdd-5c77-40f0-9780-d7c70ea741e3'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:49:23.167549 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-1fcbabdd-5c77-40f0-9780-d7c70ea741e3 admin admin] The token cache is being invalidate because project a022fcb916f74305811851efd5ed57cb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87956) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 00:49:23.168008 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-1fcbabdd-5c77-40f0-9780-d7c70ea741e3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:49:23.170319 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-1fcbabdd-5c77-40f0-9780-d7c70ea741e3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:49:23.175452 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 882/1747] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 30 00:49:22 2022] DELETE /identity/v3/projects/a022fcb916f74305811851efd5ed57cb => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 00:49:23.176373 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcbabdd-5c77-40f0-9780-d7c70ea741e3 admin admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:49:23.177797 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-1fcbabdd-5c77-40f0-9780-d7c70ea741e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:49:23.180992 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471513da-edf8-4871-8c98-4ad1bee5a2f2 admin admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:49:23.263467 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcbabdd-5c77-40f0-9780-d7c70ea741e3 admin admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:49:23.269775 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07719629-1409-4fbf-a4e5-1df760401019 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:49:23.270171 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22457b1-edda-464d-921f-aad1f54fa39a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:49:23.271136 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22457b1-edda-464d-921f-aad1f54fa39a admin admin] REQUEST_METHOD: `DELETE` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:23.271260 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07719629-1409-4fbf-a4e5-1df760401019 admin admin] REQUEST_METHOD: `POST` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:23.271529 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22457b1-edda-464d-921f-aad1f54fa39a admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:23.271857 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22457b1-edda-464d-921f-aad1f54fa39a admin admin] PATH_INFO: `/v3/users/b92e737978fc4273a2aa88204f65872b` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:23.272093 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07719629-1409-4fbf-a4e5-1df760401019 admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:23.273092 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22457b1-edda-464d-921f-aad1f54fa39a admin admin] RBAC: Authorizing `identity:delete_user(user_id=b92e737978fc4273a2aa88204f65872b)` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:49:23.273367 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07719629-1409-4fbf-a4e5-1df760401019 admin admin] PATH_INFO: `/v3/users` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:23.274025 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07719629-1409-4fbf-a4e5-1df760401019 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:49:23.275122 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22457b1-edda-464d-921f-aad1f54fa39a admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:49:23.276275 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07719629-1409-4fbf-a4e5-1df760401019 admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:49:23.304441 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 866/1748] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 30 00:49:23 2022] POST /identity/v3/users => generated 287 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 30 00:49:23.308872 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07719629-1409-4fbf-a4e5-1df760401019 admin admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:49:23.310784 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-07719629-1409-4fbf-a4e5-1df760401019 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:49:23.323905 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07719629-1409-4fbf-a4e5-1df760401019 admin admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:49:23.329276 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c1e451-2184-411f-b1ab-de1fa6402a12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:49:23.329953 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c1e451-2184-411f-b1ab-de1fa6402a12 admin admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:23.330309 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c1e451-2184-411f-b1ab-de1fa6402a12 admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:23.330627 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c1e451-2184-411f-b1ab-de1fa6402a12 admin admin] PATH_INFO: `/v3/roles` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:23.331394 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c1e451-2184-411f-b1ab-de1fa6402a12 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:49:23.333065 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c1e451-2184-411f-b1ab-de1fa6402a12 admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:49:23.337154 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-e22457b1-edda-464d-921f-aad1f54fa39a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b92e737978fc4273a2aa88204f65872b'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:49:23.337993 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-e22457b1-edda-464d-921f-aad1f54fa39a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b92e737978fc4273a2aa88204f65872b'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:49:23.343742 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 867/1749] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 30 00:49:23 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 30 00:49:23.347670 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c1e451-2184-411f-b1ab-de1fa6402a12 admin admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:49:23.349625 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-43c1e451-2184-411f-b1ab-de1fa6402a12 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:49:23.356259 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-e22457b1-edda-464d-921f-aad1f54fa39a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b92e737978fc4273a2aa88204f65872b'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:49:23.362665 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c1e451-2184-411f-b1ab-de1fa6402a12 admin admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:49:23.366716 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-e22457b1-edda-464d-921f-aad1f54fa39a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b92e737978fc4273a2aa88204f65872b'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:49:23.369432 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1fb6ac-4ed9-49cf-a104-8154741490b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:49:23.370186 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1fb6ac-4ed9-49cf-a104-8154741490b5 admin admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:23.370428 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1fb6ac-4ed9-49cf-a104-8154741490b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:23.370647 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1fb6ac-4ed9-49cf-a104-8154741490b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:23.371505 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1fb6ac-4ed9-49cf-a104-8154741490b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:49:23.373330 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1fb6ac-4ed9-49cf-a104-8154741490b5 admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:49:23.384090 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-e22457b1-edda-464d-921f-aad1f54fa39a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b92e737978fc4273a2aa88204f65872b'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:49:23.386437 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 868/1750] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 30 00:49:23 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 30 00:49:23.390602 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1fb6ac-4ed9-49cf-a104-8154741490b5 admin admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:49:23.391310 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 883/1751] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 30 00:49:23 2022] DELETE /identity/v3/users/b92e737978fc4273a2aa88204f65872b => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 00:49:23.400929 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1fb6ac-4ed9-49cf-a104-8154741490b5 admin admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:49:23.460789 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f6535d-be49-44d5-9072-9930f27d7ae9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:49:23.461679 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f6535d-be49-44d5-9072-9930f27d7ae9 admin admin] REQUEST_METHOD: `PUT` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:23.461808 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f6535d-be49-44d5-9072-9930f27d7ae9 admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:23.462023 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f6535d-be49-44d5-9072-9930f27d7ae9 admin admin] PATH_INFO: `/v3/projects/260a4b066fb44053804caffae552fe2a/users/451debb39f774b1e8bb1e1dba61cc5fe/roles/1c93019874174c4b91118d9ce2347e47` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:23.476114 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:49:23.480125 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f6535d-be49-44d5-9072-9930f27d7ae9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=260a4b066fb44053804caffae552fe2a, user_id=451debb39f774b1e8bb1e1dba61cc5fe, role_id=1c93019874174c4b91118d9ce2347e47)` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:49:23.484112 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f6535d-be49-44d5-9072-9930f27d7ae9 admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:49:23.499108 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 869/1752] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 30 00:49:23 2022] PUT /identity/v3/projects/260a4b066fb44053804caffae552fe2a/users/451debb39f774b1e8bb1e1dba61cc5fe/roles/1c93019874174c4b91118d9ce2347e47 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 00:49:23.510594 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0290f80-1b1c-4c51-baa9-e1684fadc812 None None] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:23.511054 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0290f80-1b1c-4c51-baa9-e1684fadc812 None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:23.511464 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0290f80-1b1c-4c51-baa9-e1684fadc812 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:23.544191 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.auth.core [None req-a0290f80-1b1c-4c51-baa9-e1684fadc812 None None] MFA Rules not processed for user `451debb39f774b1e8bb1e1dba61cc5fe`. Rule list: `[]` (Enabled: `True`). {{(pid=87956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:49:23.545476 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-a0290f80-1b1c-4c51-baa9-e1684fadc812 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:49:23.569205 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:DELETE=16,keystone:SELECT=82,keystone:INSERT=2 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:49:23.621191 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 884/1753] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 30 00:49:23 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 30 00:49:23.632071 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f6535d-be49-44d5-9072-9930f27d7ae9 admin admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:49:23.633820 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-13f6535d-be49-44d5-9072-9930f27d7ae9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:49:23.679340 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0290f80-1b1c-4c51-baa9-e1684fadc812 None None] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:49:23.681144 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-a0290f80-1b1c-4c51-baa9-e1684fadc812 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:49:23.699390 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f6535d-be49-44d5-9072-9930f27d7ae9 admin admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:49:23.703681 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b59f6fa-3e84-4888-a07e-50c71f0ea7ec service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48d928ff7fe24348ac900f09c56acc20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d2387fdf794d4eaef07bbcd7b39f2a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:49:23.704252 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b59f6fa-3e84-4888-a07e-50c71f0ea7ec service cinder] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:23.705151 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b59f6fa-3e84-4888-a07e-50c71f0ea7ec service cinder] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:23.705425 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b59f6fa-3e84-4888-a07e-50c71f0ea7ec service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:23.714382 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b59f6fa-3e84-4888-a07e-50c71f0ea7ec service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:49:23.715902 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b59f6fa-3e84-4888-a07e-50c71f0ea7ec service cinder] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:49:23.725727 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 870/1754] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 30 00:49:23 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 00:49:23.757433 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0290f80-1b1c-4c51-baa9-e1684fadc812 None None] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:49:23.762804 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8796ee3-7ebb-4fc1-9089-5d68b197b527 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:49:23.763472 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8796ee3-7ebb-4fc1-9089-5d68b197b527 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:23.763752 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8796ee3-7ebb-4fc1-9089-5d68b197b527 admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:23.764023 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8796ee3-7ebb-4fc1-9089-5d68b197b527 admin admin] PATH_INFO: `/v3/projects/936b7cbde8bb4ffa9259ab65891f6584` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:23.765462 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8796ee3-7ebb-4fc1-9089-5d68b197b527 admin admin] RBAC: Authorizing `identity:delete_project(project_id=936b7cbde8bb4ffa9259ab65891f6584)` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:49:23.767560 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8796ee3-7ebb-4fc1-9089-5d68b197b527 admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:49:23.825484 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-e8796ee3-7ebb-4fc1-9089-5d68b197b527 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '936b7cbde8bb4ffa9259ab65891f6584', 'request_id': 'req-e8796ee3-7ebb-4fc1-9089-5d68b197b527'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:49:23.834521 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-e8796ee3-7ebb-4fc1-9089-5d68b197b527 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '936b7cbde8bb4ffa9259ab65891f6584', 'request_id': 'req-e8796ee3-7ebb-4fc1-9089-5d68b197b527'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:49:23.841534 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-e8796ee3-7ebb-4fc1-9089-5d68b197b527 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '936b7cbde8bb4ffa9259ab65891f6584', 'request_id': 'req-e8796ee3-7ebb-4fc1-9089-5d68b197b527'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:49:23.859688 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-e8796ee3-7ebb-4fc1-9089-5d68b197b527 admin admin] The token cache is being invalidate because project 936b7cbde8bb4ffa9259ab65891f6584 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87956) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 00:49:23.859688 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-e8796ee3-7ebb-4fc1-9089-5d68b197b527 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:49:23.860181 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-e8796ee3-7ebb-4fc1-9089-5d68b197b527 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:49:23.862567 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 885/1755] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 30 00:49:23 2022] DELETE /identity/v3/projects/936b7cbde8bb4ffa9259ab65891f6584 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 00:49:23.867430 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e64b32-ecaa-44e5-b277-7e9b0d690961 None None] REQUEST_METHOD: `POST` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:23.867889 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e64b32-ecaa-44e5-b277-7e9b0d690961 None None] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:23.868373 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e64b32-ecaa-44e5-b277-7e9b0d690961 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:23.890245 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.auth.core [None req-b3e64b32-ecaa-44e5-b277-7e9b0d690961 None None] MFA Rules not processed for user `eb55b6cbca4945abb21b0e49eb745e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=87955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:49:23.891719 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-b3e64b32-ecaa-44e5-b277-7e9b0d690961 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:49:23.954716 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 871/1756] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 30 00:49:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:49:23.967269 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8968a666-a476-4d8d-bc72-5bdb84b9278d None None] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:23.967269 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8968a666-a476-4d8d-bc72-5bdb84b9278d None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:23.967269 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8968a666-a476-4d8d-bc72-5bdb84b9278d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:23.987890 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.auth.core [None req-8968a666-a476-4d8d-bc72-5bdb84b9278d None None] MFA Rules not processed for user `eb55b6cbca4945abb21b0e49eb745e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=87956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:49:23.989144 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-8968a666-a476-4d8d-bc72-5bdb84b9278d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:49:23.998424 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 886/1757] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 30 00:49:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:49:24.003153 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e64b32-ecaa-44e5-b277-7e9b0d690961 None None] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:49:24.015640 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e64b32-ecaa-44e5-b277-7e9b0d690961 None None] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:49:24.028162 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1465e7-0127-4fb0-a50d-27e6b6448c86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:49:24.029033 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1465e7-0127-4fb0-a50d-27e6b6448c86 admin admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:24.029382 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1465e7-0127-4fb0-a50d-27e6b6448c86 admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:24.029713 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1465e7-0127-4fb0-a50d-27e6b6448c86 admin admin] PATH_INFO: `/v3/domains` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:24.030488 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1465e7-0127-4fb0-a50d-27e6b6448c86 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:49:24.030889 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1465e7-0127-4fb0-a50d-27e6b6448c86 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:49:24.032815 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1465e7-0127-4fb0-a50d-27e6b6448c86 admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:49:24.053407 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 872/1758] 10.222.0.42 () {58 vars in 1153 bytes} [Sun Oct 30 00:49:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 30 00:49:24.057858 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8968a666-a476-4d8d-bc72-5bdb84b9278d None None] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:49:24.070702 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8968a666-a476-4d8d-bc72-5bdb84b9278d None None] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:49:24.076510 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef028a86-0be5-42fe-97c5-672f3641d6d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:49:24.077337 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef028a86-0be5-42fe-97c5-672f3641d6d2 admin admin] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:24.077769 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef028a86-0be5-42fe-97c5-672f3641d6d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:24.078087 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef028a86-0be5-42fe-97c5-672f3641d6d2 admin admin] PATH_INFO: `/v3/projects` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:24.078731 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef028a86-0be5-42fe-97c5-672f3641d6d2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:49:24.080725 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef028a86-0be5-42fe-97c5-672f3641d6d2 admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:49:24.131755 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 887/1759] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 30 00:49:24 2022] POST /identity/v3/projects => generated 373 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 00:49:24.133187 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1465e7-0127-4fb0-a50d-27e6b6448c86 admin admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:49:24.144510 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1465e7-0127-4fb0-a50d-27e6b6448c86 admin admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:49:24.215149 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d987a95c-fe0e-4aa1-9a99-8dab5cfdc152 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:49:24.215899 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d987a95c-fe0e-4aa1-9a99-8dab5cfdc152 admin admin] REQUEST_METHOD: `POST` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:24.216176 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d987a95c-fe0e-4aa1-9a99-8dab5cfdc152 admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:24.216466 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d987a95c-fe0e-4aa1-9a99-8dab5cfdc152 admin admin] PATH_INFO: `/v3/users` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:24.217105 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d987a95c-fe0e-4aa1-9a99-8dab5cfdc152 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:49:24.219002 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d987a95c-fe0e-4aa1-9a99-8dab5cfdc152 admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:49:24.242568 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 873/1760] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 30 00:49:24 2022] POST /identity/v3/users => generated 287 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 00:49:24.247106 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef028a86-0be5-42fe-97c5-672f3641d6d2 admin admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:49:24.257786 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef028a86-0be5-42fe-97c5-672f3641d6d2 admin admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:49:24.262768 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba16226-e21f-4b10-8baa-bb1a8d9c130d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:49:24.263499 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba16226-e21f-4b10-8baa-bb1a8d9c130d admin admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:24.263761 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba16226-e21f-4b10-8baa-bb1a8d9c130d admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:24.264123 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba16226-e21f-4b10-8baa-bb1a8d9c130d admin admin] PATH_INFO: `/v3/roles` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:24.264966 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba16226-e21f-4b10-8baa-bb1a8d9c130d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:49:24.266589 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba16226-e21f-4b10-8baa-bb1a8d9c130d admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:49:24.277668 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 888/1761] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 30 00:49:24 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 00:49:24.281938 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d987a95c-fe0e-4aa1-9a99-8dab5cfdc152 admin admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:49:24.292115 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d987a95c-fe0e-4aa1-9a99-8dab5cfdc152 admin admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:49:24.297094 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b81700-8e7a-4250-bee6-522c3991fe17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:49:24.297762 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b81700-8e7a-4250-bee6-522c3991fe17 admin admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:24.298035 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b81700-8e7a-4250-bee6-522c3991fe17 admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:24.298306 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b81700-8e7a-4250-bee6-522c3991fe17 admin admin] PATH_INFO: `/v3/roles` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:24.298965 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b81700-8e7a-4250-bee6-522c3991fe17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:49:24.300651 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b81700-8e7a-4250-bee6-522c3991fe17 admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:49:24.306213 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:49:24.313816 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 874/1762] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 30 00:49:24 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 00:49:24.317910 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba16226-e21f-4b10-8baa-bb1a8d9c130d admin admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:49:24.331334 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba16226-e21f-4b10-8baa-bb1a8d9c130d admin admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:49:24.336510 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559dd8ac-8534-4b87-a7e1-c27cf2c67187 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:49:24.337226 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559dd8ac-8534-4b87-a7e1-c27cf2c67187 admin admin] REQUEST_METHOD: `PUT` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:24.337502 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559dd8ac-8534-4b87-a7e1-c27cf2c67187 admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:24.337770 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559dd8ac-8534-4b87-a7e1-c27cf2c67187 admin admin] PATH_INFO: `/v3/projects/3ce53dad1c5e4fba830856fb4309fd97/users/2416589d10c549f4bd6af71806ff9778/roles/1c93019874174c4b91118d9ce2347e47` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:24.350679 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:49:24.355683 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559dd8ac-8534-4b87-a7e1-c27cf2c67187 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3ce53dad1c5e4fba830856fb4309fd97, user_id=2416589d10c549f4bd6af71806ff9778, role_id=1c93019874174c4b91118d9ce2347e47)` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:49:24.358759 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559dd8ac-8534-4b87-a7e1-c27cf2c67187 admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:49:24.373818 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 889/1763] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 30 00:49:24 2022] PUT /identity/v3/projects/3ce53dad1c5e4fba830856fb4309fd97/users/2416589d10c549f4bd6af71806ff9778/roles/1c93019874174c4b91118d9ce2347e47 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 00:49:24.385029 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a675a141-cf2f-49bc-a57a-a2a9170bb7ce None None] REQUEST_METHOD: `POST` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:24.385311 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a675a141-cf2f-49bc-a57a-a2a9170bb7ce None None] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:24.385581 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a675a141-cf2f-49bc-a57a-a2a9170bb7ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:24.414732 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.auth.core [None req-a675a141-cf2f-49bc-a57a-a2a9170bb7ce None None] MFA Rules not processed for user `2416589d10c549f4bd6af71806ff9778`. Rule list: `[]` (Enabled: `True`). {{(pid=87955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:49:24.415985 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-a675a141-cf2f-49bc-a57a-a2a9170bb7ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:49:24.521797 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 875/1764] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 30 00:49:24 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:49:24.536548 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559dd8ac-8534-4b87-a7e1-c27cf2c67187 admin admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:49:24.539463 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-559dd8ac-8534-4b87-a7e1-c27cf2c67187 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:49:24.611125 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559dd8ac-8534-4b87-a7e1-c27cf2c67187 admin admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:49:24.615773 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6946e866-6924-46ee-ae5e-7c9a33cedb4f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48d928ff7fe24348ac900f09c56acc20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d2387fdf794d4eaef07bbcd7b39f2a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:49:24.616413 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6946e866-6924-46ee-ae5e-7c9a33cedb4f service cinder] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:24.616689 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6946e866-6924-46ee-ae5e-7c9a33cedb4f service cinder] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:24.616959 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6946e866-6924-46ee-ae5e-7c9a33cedb4f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:24.626944 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6946e866-6924-46ee-ae5e-7c9a33cedb4f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:49:24.628469 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6946e866-6924-46ee-ae5e-7c9a33cedb4f service cinder] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:49:24.638962 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 890/1765] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 30 00:49:24 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 00:49:25.113854 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031b303b-00ae-4fc1-9ebb-dc33dd48ac7a None None] REQUEST_METHOD: `POST` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:25.114434 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031b303b-00ae-4fc1-9ebb-dc33dd48ac7a None None] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:25.114434 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031b303b-00ae-4fc1-9ebb-dc33dd48ac7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:25.134699 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.auth.core [None req-031b303b-00ae-4fc1-9ebb-dc33dd48ac7a None None] MFA Rules not processed for user `451debb39f774b1e8bb1e1dba61cc5fe`. Rule list: `[]` (Enabled: `True`). {{(pid=87955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:49:25.136064 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-031b303b-00ae-4fc1-9ebb-dc33dd48ac7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:49:25.199639 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 876/1766] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 30 00:49:25 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:49:29.584440 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc856460-d55a-4f5b-a30d-5401b9fd43a5 None None] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:29.585375 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc856460-d55a-4f5b-a30d-5401b9fd43a5 None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:29.585809 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc856460-d55a-4f5b-a30d-5401b9fd43a5 None None] PATH_INFO: `/` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:29.588636 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 891/1767] 10.222.0.42 () {54 vars in 921 bytes} [Sun Oct 30 00:49:29 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:49:29.610831 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a6cf01-04ec-48da-ab95-83186e397feb None None] REQUEST_METHOD: `POST` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:29.611767 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a6cf01-04ec-48da-ab95-83186e397feb None None] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:29.612243 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a6cf01-04ec-48da-ab95-83186e397feb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:29.642689 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.auth.core [None req-a2a6cf01-04ec-48da-ab95-83186e397feb None None] MFA Rules not processed for user `202b8b2c0f454297bfb97c1ac4033625`. Rule list: `[]` (Enabled: `True`). {{(pid=87955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:49:29.644308 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-a2a6cf01-04ec-48da-ab95-83186e397feb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:49:29.710412 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc856460-d55a-4f5b-a30d-5401b9fd43a5 None None] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:49:29.713741 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-cc856460-d55a-4f5b-a30d-5401b9fd43a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:49:29.786498 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 877/1768] 10.222.0.42 () {58 vars in 1018 bytes} [Sun Oct 30 00:49:29 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:49:29.808912 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a6cf01-04ec-48da-ab95-83186e397feb None None] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:49:29.810518 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-a2a6cf01-04ec-48da-ab95-83186e397feb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:49:29.833622 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a6cf01-04ec-48da-ab95-83186e397feb None None] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:49:29.851432 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8f4523-90d1-401f-a2a2-76cf7f1cc7fe service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '202b8b2c0f454297bfb97c1ac4033625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d2387fdf794d4eaef07bbcd7b39f2a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:49:29.851432 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8f4523-90d1-401f-a2a2-76cf7f1cc7fe service placement] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:29.851432 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8f4523-90d1-401f-a2a2-76cf7f1cc7fe service placement] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:29.851432 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8f4523-90d1-401f-a2a2-76cf7f1cc7fe service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:29.885601 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8f4523-90d1-401f-a2a2-76cf7f1cc7fe service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:49:29.886770 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc856460-d55a-4f5b-a30d-5401b9fd43a5 None None] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:49:29.889236 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8f4523-90d1-401f-a2a2-76cf7f1cc7fe service placement] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:49:29.892333 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fad662-47db-45cb-bf87-edb2614f1427 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:49:29.893053 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fad662-47db-45cb-bf87-edb2614f1427 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:29.893397 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fad662-47db-45cb-bf87-edb2614f1427 admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:29.893733 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fad662-47db-45cb-bf87-edb2614f1427 admin admin] PATH_INFO: `/v3/users/2ff437c6b6af4ac1b343280c5c191cd0` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:29.895146 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52fad662-47db-45cb-bf87-edb2614f1427 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2ff437c6b6af4ac1b343280c5c191cd0)` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:49:29.898364 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52fad662-47db-45cb-bf87-edb2614f1427 admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:49:29.903710 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 878/1769] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 30 00:49:29 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 30 00:49:29.973079 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-52fad662-47db-45cb-bf87-edb2614f1427 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2ff437c6b6af4ac1b343280c5c191cd0'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:49:29.975600 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-52fad662-47db-45cb-bf87-edb2614f1427 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2ff437c6b6af4ac1b343280c5c191cd0'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:49:30.004199 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-52fad662-47db-45cb-bf87-edb2614f1427 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2ff437c6b6af4ac1b343280c5c191cd0'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:49:30.016323 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-52fad662-47db-45cb-bf87-edb2614f1427 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2ff437c6b6af4ac1b343280c5c191cd0'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:49:30.026719 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-52fad662-47db-45cb-bf87-edb2614f1427 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2ff437c6b6af4ac1b343280c5c191cd0'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:49:30.038957 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 892/1770] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 30 00:49:29 2022] DELETE /identity/v3/users/2ff437c6b6af4ac1b343280c5c191cd0 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 00:49:30.333318 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8f4523-90d1-401f-a2a2-76cf7f1cc7fe service placement] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:49:30.347606 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8f4523-90d1-401f-a2a2-76cf7f1cc7fe service placement] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:49:30.404916 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=100 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:49:30.479669 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29b3a6e-bc22-4f36-833f-13988a0ee18d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:49:30.480407 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29b3a6e-bc22-4f36-833f-13988a0ee18d admin admin] REQUEST_METHOD: `DELETE` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:30.480679 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29b3a6e-bc22-4f36-833f-13988a0ee18d admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:30.480960 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29b3a6e-bc22-4f36-833f-13988a0ee18d admin admin] PATH_INFO: `/v3/projects/cc85f7ea91ac4d52bd06eea3460037c9` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:30.482081 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29b3a6e-bc22-4f36-833f-13988a0ee18d admin admin] RBAC: Authorizing `identity:delete_project(project_id=cc85f7ea91ac4d52bd06eea3460037c9)` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:49:30.483999 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29b3a6e-bc22-4f36-833f-13988a0ee18d admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:49:30.541056 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-f29b3a6e-bc22-4f36-833f-13988a0ee18d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cc85f7ea91ac4d52bd06eea3460037c9', 'request_id': 'req-f29b3a6e-bc22-4f36-833f-13988a0ee18d'} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:49:30.548163 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-f29b3a6e-bc22-4f36-833f-13988a0ee18d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cc85f7ea91ac4d52bd06eea3460037c9', 'request_id': 'req-f29b3a6e-bc22-4f36-833f-13988a0ee18d'} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:49:30.559053 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-f29b3a6e-bc22-4f36-833f-13988a0ee18d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cc85f7ea91ac4d52bd06eea3460037c9', 'request_id': 'req-f29b3a6e-bc22-4f36-833f-13988a0ee18d'} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:49:30.572647 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-f29b3a6e-bc22-4f36-833f-13988a0ee18d admin admin] The token cache is being invalidate because project cc85f7ea91ac4d52bd06eea3460037c9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87955) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 00:49:30.573260 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-f29b3a6e-bc22-4f36-833f-13988a0ee18d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:49:30.573979 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-f29b3a6e-bc22-4f36-833f-13988a0ee18d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:49:30.576818 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 879/1771] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 30 00:49:30 2022] DELETE /identity/v3/projects/cc85f7ea91ac4d52bd06eea3460037c9 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 00:49:30.583192 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8494ba5f-6eb5-43ab-a6f1-8a252926ee54 None None] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:30.584162 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8494ba5f-6eb5-43ab-a6f1-8a252926ee54 None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:30.585062 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8494ba5f-6eb5-43ab-a6f1-8a252926ee54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:30.609841 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.auth.core [None req-8494ba5f-6eb5-43ab-a6f1-8a252926ee54 None None] MFA Rules not processed for user `eb55b6cbca4945abb21b0e49eb745e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=87956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:49:30.611710 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-8494ba5f-6eb5-43ab-a6f1-8a252926ee54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:49:30.618302 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:49:30.682334 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 893/1772] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 30 00:49:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:49:30.690572 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07464694-b388-4b25-a156-1337a395342d None None] REQUEST_METHOD: `POST` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:30.691478 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07464694-b388-4b25-a156-1337a395342d None None] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:30.691966 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07464694-b388-4b25-a156-1337a395342d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:30.715729 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.auth.core [None req-07464694-b388-4b25-a156-1337a395342d None None] MFA Rules not processed for user `eb55b6cbca4945abb21b0e49eb745e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=87955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:49:30.717279 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-07464694-b388-4b25-a156-1337a395342d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:49:30.727030 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 880/1773] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 30 00:49:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:49:30.731142 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8494ba5f-6eb5-43ab-a6f1-8a252926ee54 None None] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:49:30.749422 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8494ba5f-6eb5-43ab-a6f1-8a252926ee54 None None] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:49:30.765196 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a86787-409d-40f6-8e8c-6b0ba7d729e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:49:30.765831 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a86787-409d-40f6-8e8c-6b0ba7d729e4 admin admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:30.766108 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a86787-409d-40f6-8e8c-6b0ba7d729e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:30.766376 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a86787-409d-40f6-8e8c-6b0ba7d729e4 admin admin] PATH_INFO: `/v3/domains` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:30.767038 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a86787-409d-40f6-8e8c-6b0ba7d729e4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87956) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:49:30.767374 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a86787-409d-40f6-8e8c-6b0ba7d729e4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:49:30.769537 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a86787-409d-40f6-8e8c-6b0ba7d729e4 admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:49:30.791616 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 894/1774] 10.222.0.42 () {58 vars in 1153 bytes} [Sun Oct 30 00:49:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:49:30.796201 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07464694-b388-4b25-a156-1337a395342d None None] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:49:30.805508 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07464694-b388-4b25-a156-1337a395342d None None] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:49:30.811912 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7ef58e-fe37-4350-9e76-e00be231e204 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:49:30.812896 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7ef58e-fe37-4350-9e76-e00be231e204 admin admin] REQUEST_METHOD: `POST` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:30.813237 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7ef58e-fe37-4350-9e76-e00be231e204 admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:30.819257 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7ef58e-fe37-4350-9e76-e00be231e204 admin admin] PATH_INFO: `/v3/projects` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:30.819459 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7ef58e-fe37-4350-9e76-e00be231e204 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:49:30.821480 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7ef58e-fe37-4350-9e76-e00be231e204 admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:49:30.866387 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 881/1775] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 30 00:49:30 2022] POST /identity/v3/projects => generated 403 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 00:49:30.871188 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a86787-409d-40f6-8e8c-6b0ba7d729e4 admin admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:49:30.882332 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a86787-409d-40f6-8e8c-6b0ba7d729e4 admin admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:49:30.961178 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6344e5f-6e87-42cb-bc1c-931772685ec2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:49:30.962005 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6344e5f-6e87-42cb-bc1c-931772685ec2 admin admin] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:30.962339 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6344e5f-6e87-42cb-bc1c-931772685ec2 admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:30.962668 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6344e5f-6e87-42cb-bc1c-931772685ec2 admin admin] PATH_INFO: `/v3/users` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:30.963415 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6344e5f-6e87-42cb-bc1c-931772685ec2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:49:30.965463 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6344e5f-6e87-42cb-bc1c-931772685ec2 admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:49:30.992495 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 895/1776] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 30 00:49:30 2022] POST /identity/v3/users => generated 302 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 00:49:30.993727 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7ef58e-fe37-4350-9e76-e00be231e204 admin admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:49:31.004687 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7ef58e-fe37-4350-9e76-e00be231e204 admin admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:49:31.009213 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb079151-4ccd-4c0f-9131-e976be7e9243 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:49:31.009809 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb079151-4ccd-4c0f-9131-e976be7e9243 admin admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:31.010109 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb079151-4ccd-4c0f-9131-e976be7e9243 admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:31.010379 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb079151-4ccd-4c0f-9131-e976be7e9243 admin admin] PATH_INFO: `/v3/roles` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:31.011022 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb079151-4ccd-4c0f-9131-e976be7e9243 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:49:31.012674 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb079151-4ccd-4c0f-9131-e976be7e9243 admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:49:31.030224 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 882/1777] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 30 00:49:30 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 00:49:31.034533 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6344e5f-6e87-42cb-bc1c-931772685ec2 admin admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:49:31.044982 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6344e5f-6e87-42cb-bc1c-931772685ec2 admin admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:49:31.049805 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f59ba7c-ecb3-4723-aad9-150a4e94214e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:49:31.050416 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f59ba7c-ecb3-4723-aad9-150a4e94214e admin admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:31.050795 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f59ba7c-ecb3-4723-aad9-150a4e94214e admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:31.051098 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f59ba7c-ecb3-4723-aad9-150a4e94214e admin admin] PATH_INFO: `/v3/roles` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:31.051804 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f59ba7c-ecb3-4723-aad9-150a4e94214e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:49:31.053442 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f59ba7c-ecb3-4723-aad9-150a4e94214e admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:49:31.064659 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 896/1778] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 30 00:49:31 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 30 00:49:31.069226 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb079151-4ccd-4c0f-9131-e976be7e9243 admin admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:49:31.080731 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb079151-4ccd-4c0f-9131-e976be7e9243 admin admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:49:31.085517 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d67f13d-61fb-4bd6-ae66-ecc851228b1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:49:31.086198 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d67f13d-61fb-4bd6-ae66-ecc851228b1a admin admin] REQUEST_METHOD: `PUT` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:31.086456 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d67f13d-61fb-4bd6-ae66-ecc851228b1a admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:31.086746 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d67f13d-61fb-4bd6-ae66-ecc851228b1a admin admin] PATH_INFO: `/v3/projects/6fb346e165af445c9db7d21d4d7682f4/users/d87537fce8f0442b9264f4f60c173d41/roles/1c93019874174c4b91118d9ce2347e47` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:31.102943 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d67f13d-61fb-4bd6-ae66-ecc851228b1a admin admin] RBAC: Authorizing `identity:create_grant(project_id=6fb346e165af445c9db7d21d4d7682f4, user_id=d87537fce8f0442b9264f4f60c173d41, role_id=1c93019874174c4b91118d9ce2347e47)` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:49:31.106938 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d67f13d-61fb-4bd6-ae66-ecc851228b1a admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:49:31.125497 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 883/1779] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 30 00:49:31 2022] PUT /identity/v3/projects/6fb346e165af445c9db7d21d4d7682f4/users/d87537fce8f0442b9264f4f60c173d41/roles/1c93019874174c4b91118d9ce2347e47 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 00:49:31.130425 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b77d9f-bc2d-4cd8-8f99-c0acb77d8194 None None] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:31.130705 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b77d9f-bc2d-4cd8-8f99-c0acb77d8194 None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:31.130970 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b77d9f-bc2d-4cd8-8f99-c0acb77d8194 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:31.150940 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.auth.core [None req-21b77d9f-bc2d-4cd8-8f99-c0acb77d8194 None None] MFA Rules not processed for user `eb55b6cbca4945abb21b0e49eb745e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=87956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:49:31.152301 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-21b77d9f-bc2d-4cd8-8f99-c0acb77d8194 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:49:31.225447 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 897/1780] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 30 00:49:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:49:31.237732 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d67f13d-61fb-4bd6-ae66-ecc851228b1a admin admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:49:31.239892 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-5d67f13d-61fb-4bd6-ae66-ecc851228b1a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:49:31.294652 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:49:31.308303 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d67f13d-61fb-4bd6-ae66-ecc851228b1a admin admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:49:31.312537 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f881ba-8559-4425-86c2-11858f316373 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5693f186c6ad4d9394f02ee3477cdcd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d2387fdf794d4eaef07bbcd7b39f2a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:49:31.313662 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f881ba-8559-4425-86c2-11858f316373 service neutron] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:31.314157 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f881ba-8559-4425-86c2-11858f316373 service neutron] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:31.314531 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f881ba-8559-4425-86c2-11858f316373 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:31.326452 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f881ba-8559-4425-86c2-11858f316373 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:49:31.326452 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f881ba-8559-4425-86c2-11858f316373 service neutron] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:49:31.336931 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 884/1781] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 30 00:49:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 00:49:32.286002 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c089c7d7-cad4-449d-920f-23de9a079cd7 None None] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:32.286487 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c089c7d7-cad4-449d-920f-23de9a079cd7 None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:32.286566 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c089c7d7-cad4-449d-920f-23de9a079cd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:32.317093 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.auth.core [None req-c089c7d7-cad4-449d-920f-23de9a079cd7 None None] MFA Rules not processed for user `d87537fce8f0442b9264f4f60c173d41`. Rule list: `[]` (Enabled: `True`). {{(pid=87956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:49:32.318332 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-c089c7d7-cad4-449d-920f-23de9a079cd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:49:32.327550 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:49:32.467165 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 898/1782] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 30 00:49:32 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:49:32.471820 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f881ba-8559-4425-86c2-11858f316373 service neutron] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:49:32.484447 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f881ba-8559-4425-86c2-11858f316373 service neutron] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:49:32.489996 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325558fa-9362-49aa-a1d3-8b9447dac449 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:49:32.490858 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325558fa-9362-49aa-a1d3-8b9447dac449 admin admin] REQUEST_METHOD: `POST` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:32.493270 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325558fa-9362-49aa-a1d3-8b9447dac449 admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:32.494004 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325558fa-9362-49aa-a1d3-8b9447dac449 admin admin] PATH_INFO: `/v3/projects` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:32.494891 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325558fa-9362-49aa-a1d3-8b9447dac449 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:49:32.497882 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325558fa-9362-49aa-a1d3-8b9447dac449 admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:49:32.553202 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 885/1783] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 30 00:49:32 2022] POST /identity/v3/projects => generated 405 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 30 00:49:32.559486 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c089c7d7-cad4-449d-920f-23de9a079cd7 None None] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:49:32.571747 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c089c7d7-cad4-449d-920f-23de9a079cd7 None None] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:49:32.643233 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3afa0e-7680-4e51-9ce0-2ae957723ba3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:49:32.643950 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3afa0e-7680-4e51-9ce0-2ae957723ba3 admin admin] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:32.644184 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3afa0e-7680-4e51-9ce0-2ae957723ba3 admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:32.644481 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3afa0e-7680-4e51-9ce0-2ae957723ba3 admin admin] PATH_INFO: `/v3/users` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:32.645400 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3afa0e-7680-4e51-9ce0-2ae957723ba3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:49:32.647393 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3afa0e-7680-4e51-9ce0-2ae957723ba3 admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:49:32.671499 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 899/1784] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 30 00:49:32 2022] POST /identity/v3/users => generated 309 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 00:49:32.675313 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325558fa-9362-49aa-a1d3-8b9447dac449 admin admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:49:32.687050 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325558fa-9362-49aa-a1d3-8b9447dac449 admin admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:49:32.692408 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4449f7-0250-42bf-9c1a-1da6040e9eaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:49:32.693089 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4449f7-0250-42bf-9c1a-1da6040e9eaa admin admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:32.693383 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4449f7-0250-42bf-9c1a-1da6040e9eaa admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:32.693709 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4449f7-0250-42bf-9c1a-1da6040e9eaa admin admin] PATH_INFO: `/v3/roles` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:32.694414 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4449f7-0250-42bf-9c1a-1da6040e9eaa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:49:32.696218 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4449f7-0250-42bf-9c1a-1da6040e9eaa admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:49:32.708846 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 886/1785] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 30 00:49:32 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 00:49:32.713428 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3afa0e-7680-4e51-9ce0-2ae957723ba3 admin admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:49:32.724592 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3afa0e-7680-4e51-9ce0-2ae957723ba3 admin admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:49:32.731330 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c07e56-a62c-4117-af40-db8e9f092500 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:49:32.731330 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c07e56-a62c-4117-af40-db8e9f092500 admin admin] REQUEST_METHOD: `PUT` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:32.738500 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c07e56-a62c-4117-af40-db8e9f092500 admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:32.738799 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c07e56-a62c-4117-af40-db8e9f092500 admin admin] PATH_INFO: `/v3/projects/959a444656fa4c47afa2bb99c1845709/users/8966c48eefb04449aa0d232e552c1ad5/roles/6ccaa8c11f29456fb4e4eeccb21616c7` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:32.754841 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c07e56-a62c-4117-af40-db8e9f092500 admin admin] RBAC: Authorizing `identity:create_grant(project_id=959a444656fa4c47afa2bb99c1845709, user_id=8966c48eefb04449aa0d232e552c1ad5, role_id=6ccaa8c11f29456fb4e4eeccb21616c7)` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:49:32.758509 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c07e56-a62c-4117-af40-db8e9f092500 admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:49:32.772657 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 900/1786] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 30 00:49:32 2022] PUT /identity/v3/projects/959a444656fa4c47afa2bb99c1845709/users/8966c48eefb04449aa0d232e552c1ad5/roles/6ccaa8c11f29456fb4e4eeccb21616c7 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 00:49:32.776838 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4449f7-0250-42bf-9c1a-1da6040e9eaa admin admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:49:32.786800 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4449f7-0250-42bf-9c1a-1da6040e9eaa admin admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:49:32.843757 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8828059-5e05-4a7c-a6b2-15b184ab43b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:49:32.844358 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8828059-5e05-4a7c-a6b2-15b184ab43b4 admin admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:32.844606 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8828059-5e05-4a7c-a6b2-15b184ab43b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:32.844913 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8828059-5e05-4a7c-a6b2-15b184ab43b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:32.845557 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8828059-5e05-4a7c-a6b2-15b184ab43b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:49:32.847429 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8828059-5e05-4a7c-a6b2-15b184ab43b4 admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:49:32.858038 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 887/1787] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 30 00:49:32 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 30 00:49:32.862414 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c07e56-a62c-4117-af40-db8e9f092500 admin admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:49:32.873536 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c07e56-a62c-4117-af40-db8e9f092500 admin admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:49:32.879019 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57e7b99-9124-4df5-929b-207277302c2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:49:32.879810 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57e7b99-9124-4df5-929b-207277302c2c admin admin] REQUEST_METHOD: `PUT` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:32.880091 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57e7b99-9124-4df5-929b-207277302c2c admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:32.880363 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57e7b99-9124-4df5-929b-207277302c2c admin admin] PATH_INFO: `/v3/projects/959a444656fa4c47afa2bb99c1845709/users/8966c48eefb04449aa0d232e552c1ad5/roles/6ccaa8c11f29456fb4e4eeccb21616c7` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:32.882388 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57e7b99-9124-4df5-929b-207277302c2c admin admin] RBAC: Authorizing `identity:create_grant(project_id=959a444656fa4c47afa2bb99c1845709, user_id=8966c48eefb04449aa0d232e552c1ad5, role_id=6ccaa8c11f29456fb4e4eeccb21616c7)` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:49:32.885095 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57e7b99-9124-4df5-929b-207277302c2c admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:49:32.896351 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 901/1788] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 30 00:49:32 2022] PUT /identity/v3/projects/959a444656fa4c47afa2bb99c1845709/users/8966c48eefb04449aa0d232e552c1ad5/roles/6ccaa8c11f29456fb4e4eeccb21616c7 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 00:49:33.681581 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff49b64a-d043-4207-b29d-ada8ca229b87 None None] REQUEST_METHOD: `POST` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:33.682138 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff49b64a-d043-4207-b29d-ada8ca229b87 None None] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:33.682138 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff49b64a-d043-4207-b29d-ada8ca229b87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:33.712808 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.auth.core [None req-ff49b64a-d043-4207-b29d-ada8ca229b87 None None] MFA Rules not processed for user `8966c48eefb04449aa0d232e552c1ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=87955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:49:33.714174 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-ff49b64a-d043-4207-b29d-ada8ca229b87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:49:33.813764 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 888/1789] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 30 00:49:33 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:49:34.571303 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb000d0d-063f-4f91-b3a8-070b0f439b9b None None] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:34.572152 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb000d0d-063f-4f91-b3a8-070b0f439b9b None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:34.572900 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb000d0d-063f-4f91-b3a8-070b0f439b9b None None] PATH_INFO: `/` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:34.574442 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 902/1790] 10.222.0.42 () {54 vars in 921 bytes} [Sun Oct 30 00:49:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:49:34.592593 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed5f832-b285-4fef-9a32-cfc61acd54c5 None None] REQUEST_METHOD: `POST` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:34.592880 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed5f832-b285-4fef-9a32-cfc61acd54c5 None None] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:34.593167 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed5f832-b285-4fef-9a32-cfc61acd54c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:34.628256 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.auth.core [None req-0ed5f832-b285-4fef-9a32-cfc61acd54c5 None None] MFA Rules not processed for user `202b8b2c0f454297bfb97c1ac4033625`. Rule list: `[]` (Enabled: `True`). {{(pid=87955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:49:34.629511 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-0ed5f832-b285-4fef-9a32-cfc61acd54c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:49:34.684055 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:49:34.746003 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 889/1791] 10.222.0.42 () {58 vars in 1018 bytes} [Sun Oct 30 00:49:34 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:49:34.770703 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb000d0d-063f-4f91-b3a8-070b0f439b9b None None] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:49:34.772418 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-cb000d0d-063f-4f91-b3a8-070b0f439b9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:49:34.795825 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb000d0d-063f-4f91-b3a8-070b0f439b9b None None] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:49:34.803245 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fdc726-49ce-4953-9e93-f484a4f625d7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '202b8b2c0f454297bfb97c1ac4033625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d2387fdf794d4eaef07bbcd7b39f2a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:49:34.803802 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fdc726-49ce-4953-9e93-f484a4f625d7 service placement] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:34.804075 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fdc726-49ce-4953-9e93-f484a4f625d7 service placement] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:34.804935 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fdc726-49ce-4953-9e93-f484a4f625d7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:34.816992 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34fdc726-49ce-4953-9e93-f484a4f625d7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:49:34.818763 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34fdc726-49ce-4953-9e93-f484a4f625d7 service placement] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:49:34.843500 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 903/1792] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 30 00:49:34 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 00:49:35.650661 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed5f832-b285-4fef-9a32-cfc61acd54c5 None None] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:49:35.718383 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed5f832-b285-4fef-9a32-cfc61acd54c5 None None] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:49:35.722794 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0bf376-dc98-43fc-9db7-33b2fc31cda3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:49:35.723452 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0bf376-dc98-43fc-9db7-33b2fc31cda3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:35.723725 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0bf376-dc98-43fc-9db7-33b2fc31cda3 admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:35.723983 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0bf376-dc98-43fc-9db7-33b2fc31cda3 admin admin] PATH_INFO: `/v3/users/d87537fce8f0442b9264f4f60c173d41` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:35.725119 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0bf376-dc98-43fc-9db7-33b2fc31cda3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d87537fce8f0442b9264f4f60c173d41)` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:49:35.727021 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0bf376-dc98-43fc-9db7-33b2fc31cda3 admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:49:35.776596 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-ad0bf376-dc98-43fc-9db7-33b2fc31cda3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd87537fce8f0442b9264f4f60c173d41'} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:49:35.777263 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-ad0bf376-dc98-43fc-9db7-33b2fc31cda3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd87537fce8f0442b9264f4f60c173d41'} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:49:35.784225 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-ad0bf376-dc98-43fc-9db7-33b2fc31cda3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd87537fce8f0442b9264f4f60c173d41'} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:49:35.784862 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-ad0bf376-dc98-43fc-9db7-33b2fc31cda3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd87537fce8f0442b9264f4f60c173d41'} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:49:35.796517 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-ad0bf376-dc98-43fc-9db7-33b2fc31cda3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd87537fce8f0442b9264f4f60c173d41'} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:49:35.812036 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 890/1793] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 30 00:49:35 2022] DELETE /identity/v3/users/d87537fce8f0442b9264f4f60c173d41 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 00:49:35.849663 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fdc726-49ce-4953-9e93-f484a4f625d7 service placement] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:49:35.851295 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-34fdc726-49ce-4953-9e93-f484a4f625d7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:49:35.869175 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fdc726-49ce-4953-9e93-f484a4f625d7 service placement] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:49:35.944598 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:49:35.965795 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fa6c52-7ea3-4c7d-a82e-7cd9358c4a3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:49:35.966978 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fa6c52-7ea3-4c7d-a82e-7cd9358c4a3b admin admin] REQUEST_METHOD: `DELETE` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:35.967376 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fa6c52-7ea3-4c7d-a82e-7cd9358c4a3b admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:35.967740 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fa6c52-7ea3-4c7d-a82e-7cd9358c4a3b admin admin] PATH_INFO: `/v3/users/2416589d10c549f4bd6af71806ff9778` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:35.969450 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fa6c52-7ea3-4c7d-a82e-7cd9358c4a3b admin admin] RBAC: Authorizing `identity:delete_user(user_id=2416589d10c549f4bd6af71806ff9778)` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:49:35.972780 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fa6c52-7ea3-4c7d-a82e-7cd9358c4a3b admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:49:36.039094 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-e9fa6c52-7ea3-4c7d-a82e-7cd9358c4a3b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2416589d10c549f4bd6af71806ff9778'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:49:36.040008 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-e9fa6c52-7ea3-4c7d-a82e-7cd9358c4a3b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2416589d10c549f4bd6af71806ff9778'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:49:36.055175 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-e9fa6c52-7ea3-4c7d-a82e-7cd9358c4a3b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2416589d10c549f4bd6af71806ff9778'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:49:36.067809 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-e9fa6c52-7ea3-4c7d-a82e-7cd9358c4a3b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2416589d10c549f4bd6af71806ff9778'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:49:36.081671 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-e9fa6c52-7ea3-4c7d-a82e-7cd9358c4a3b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2416589d10c549f4bd6af71806ff9778'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:49:36.096377 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 904/1794] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 30 00:49:35 2022] DELETE /identity/v3/users/2416589d10c549f4bd6af71806ff9778 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 00:49:36.101152 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4256efd6-550e-4538-a745-dd9943ce3ca8 None None] REQUEST_METHOD: `POST` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:36.101432 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4256efd6-550e-4538-a745-dd9943ce3ca8 None None] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:36.101874 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4256efd6-550e-4538-a745-dd9943ce3ca8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:36.122825 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.auth.core [None req-4256efd6-550e-4538-a745-dd9943ce3ca8 None None] MFA Rules not processed for user `eb55b6cbca4945abb21b0e49eb745e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=87955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:49:36.124061 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-4256efd6-550e-4538-a745-dd9943ce3ca8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:49:36.204306 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fa6c52-7ea3-4c7d-a82e-7cd9358c4a3b admin admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:49:36.206137 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-e9fa6c52-7ea3-4c7d-a82e-7cd9358c4a3b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:49:36.211424 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:49:36.247596 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 891/1795] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 30 00:49:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:49:36.255976 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4256efd6-550e-4538-a745-dd9943ce3ca8 None None] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:49:36.257572 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-4256efd6-550e-4538-a745-dd9943ce3ca8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:49:36.303798 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fa6c52-7ea3-4c7d-a82e-7cd9358c4a3b admin admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:49:36.309148 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9964931-a023-4bda-a056-812a57506cf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:49:36.309800 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9964931-a023-4bda-a056-812a57506cf9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:36.310078 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9964931-a023-4bda-a056-812a57506cf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:36.310389 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9964931-a023-4bda-a056-812a57506cf9 admin admin] PATH_INFO: `/v3/projects/6fb346e165af445c9db7d21d4d7682f4` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:36.311666 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9964931-a023-4bda-a056-812a57506cf9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6fb346e165af445c9db7d21d4d7682f4)` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:49:36.313622 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9964931-a023-4bda-a056-812a57506cf9 admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:49:36.344634 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4256efd6-550e-4538-a745-dd9943ce3ca8 None None] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:49:36.350562 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69d7def-e460-42f4-a09a-24fffbbfc93e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5693f186c6ad4d9394f02ee3477cdcd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d2387fdf794d4eaef07bbcd7b39f2a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:49:36.351441 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69d7def-e460-42f4-a09a-24fffbbfc93e service neutron] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:36.351937 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69d7def-e460-42f4-a09a-24fffbbfc93e service neutron] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:36.352395 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69d7def-e460-42f4-a09a-24fffbbfc93e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:36.364628 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69d7def-e460-42f4-a09a-24fffbbfc93e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:49:36.366256 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69d7def-e460-42f4-a09a-24fffbbfc93e service neutron] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:49:36.382521 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 892/1796] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 30 00:49:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 30 00:49:36.408712 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-a9964931-a023-4bda-a056-812a57506cf9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6fb346e165af445c9db7d21d4d7682f4', 'request_id': 'req-a9964931-a023-4bda-a056-812a57506cf9'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:49:36.425835 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-a9964931-a023-4bda-a056-812a57506cf9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6fb346e165af445c9db7d21d4d7682f4', 'request_id': 'req-a9964931-a023-4bda-a056-812a57506cf9'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:49:36.434260 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-a9964931-a023-4bda-a056-812a57506cf9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6fb346e165af445c9db7d21d4d7682f4', 'request_id': 'req-a9964931-a023-4bda-a056-812a57506cf9'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:49:36.439998 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:49:36.447064 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-a9964931-a023-4bda-a056-812a57506cf9 admin admin] The token cache is being invalidate because project 6fb346e165af445c9db7d21d4d7682f4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87956) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 00:49:36.448355 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-a9964931-a023-4bda-a056-812a57506cf9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:49:36.449821 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-a9964931-a023-4bda-a056-812a57506cf9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:49:36.451439 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 905/1797] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 30 00:49:36 2022] DELETE /identity/v3/projects/6fb346e165af445c9db7d21d4d7682f4 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 00:49:36.456545 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69d7def-e460-42f4-a09a-24fffbbfc93e service neutron] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:49:36.467037 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69d7def-e460-42f4-a09a-24fffbbfc93e service neutron] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:49:36.528714 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f64c502-232f-4728-a99e-b082058f594c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:49:36.529432 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f64c502-232f-4728-a99e-b082058f594c admin admin] REQUEST_METHOD: `DELETE` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:36.529714 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f64c502-232f-4728-a99e-b082058f594c admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:36.529984 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f64c502-232f-4728-a99e-b082058f594c admin admin] PATH_INFO: `/v3/users/8966c48eefb04449aa0d232e552c1ad5` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:36.531124 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f64c502-232f-4728-a99e-b082058f594c admin admin] RBAC: Authorizing `identity:delete_user(user_id=8966c48eefb04449aa0d232e552c1ad5)` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:49:36.533066 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f64c502-232f-4728-a99e-b082058f594c admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:49:36.586256 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-2f64c502-232f-4728-a99e-b082058f594c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8966c48eefb04449aa0d232e552c1ad5'} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:49:36.587023 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-2f64c502-232f-4728-a99e-b082058f594c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8966c48eefb04449aa0d232e552c1ad5'} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:49:36.596191 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-2f64c502-232f-4728-a99e-b082058f594c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8966c48eefb04449aa0d232e552c1ad5'} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:49:36.596976 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-2f64c502-232f-4728-a99e-b082058f594c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8966c48eefb04449aa0d232e552c1ad5'} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:49:36.610654 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-2f64c502-232f-4728-a99e-b082058f594c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8966c48eefb04449aa0d232e552c1ad5'} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:49:36.624934 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 893/1798] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 30 00:49:36 2022] DELETE /identity/v3/users/8966c48eefb04449aa0d232e552c1ad5 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 00:49:36.807872 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9964931-a023-4bda-a056-812a57506cf9 admin admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:49:36.809439 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-a9964931-a023-4bda-a056-812a57506cf9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:49:36.818556 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f64c502-232f-4728-a99e-b082058f594c admin admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:49:36.820258 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-2f64c502-232f-4728-a99e-b082058f594c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:49:36.836490 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:49:36.838826 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9964931-a023-4bda-a056-812a57506cf9 admin admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:49:36.892246 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f64c502-232f-4728-a99e-b082058f594c admin admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:49:36.896927 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c38a02a-0b32-4aae-9980-526f8f53276c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:49:36.897636 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c38a02a-0b32-4aae-9980-526f8f53276c admin admin] REQUEST_METHOD: `DELETE` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:36.897919 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c38a02a-0b32-4aae-9980-526f8f53276c admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:36.898249 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c38a02a-0b32-4aae-9980-526f8f53276c admin admin] PATH_INFO: `/v3/projects/959a444656fa4c47afa2bb99c1845709` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:36.899425 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c38a02a-0b32-4aae-9980-526f8f53276c admin admin] RBAC: Authorizing `identity:delete_project(project_id=959a444656fa4c47afa2bb99c1845709)` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:49:36.901724 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c38a02a-0b32-4aae-9980-526f8f53276c admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:49:36.905064 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8b1405-880d-426b-bf84-7d9376f778dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:49:36.906323 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8b1405-880d-426b-bf84-7d9376f778dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:36.906605 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8b1405-880d-426b-bf84-7d9376f778dd admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:36.906874 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8b1405-880d-426b-bf84-7d9376f778dd admin admin] PATH_INFO: `/v3/projects/3ce53dad1c5e4fba830856fb4309fd97` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:36.908038 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8b1405-880d-426b-bf84-7d9376f778dd admin admin] RBAC: Authorizing `identity:delete_project(project_id=3ce53dad1c5e4fba830856fb4309fd97)` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:49:36.909960 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8b1405-880d-426b-bf84-7d9376f778dd admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:49:36.951993 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-2c38a02a-0b32-4aae-9980-526f8f53276c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '959a444656fa4c47afa2bb99c1845709', 'request_id': 'req-2c38a02a-0b32-4aae-9980-526f8f53276c'} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:49:36.957606 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-2c38a02a-0b32-4aae-9980-526f8f53276c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '959a444656fa4c47afa2bb99c1845709', 'request_id': 'req-2c38a02a-0b32-4aae-9980-526f8f53276c'} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:49:36.958814 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-cc8b1405-880d-426b-bf84-7d9376f778dd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3ce53dad1c5e4fba830856fb4309fd97', 'request_id': 'req-cc8b1405-880d-426b-bf84-7d9376f778dd'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:49:36.966014 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-2c38a02a-0b32-4aae-9980-526f8f53276c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '959a444656fa4c47afa2bb99c1845709', 'request_id': 'req-2c38a02a-0b32-4aae-9980-526f8f53276c'} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:49:36.968596 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-cc8b1405-880d-426b-bf84-7d9376f778dd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3ce53dad1c5e4fba830856fb4309fd97', 'request_id': 'req-cc8b1405-880d-426b-bf84-7d9376f778dd'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:49:36.975141 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-cc8b1405-880d-426b-bf84-7d9376f778dd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3ce53dad1c5e4fba830856fb4309fd97', 'request_id': 'req-cc8b1405-880d-426b-bf84-7d9376f778dd'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:49:36.977609 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-2c38a02a-0b32-4aae-9980-526f8f53276c admin admin] The token cache is being invalidate because project 959a444656fa4c47afa2bb99c1845709 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87955) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 00:49:36.977901 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-2c38a02a-0b32-4aae-9980-526f8f53276c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:49:36.978536 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-2c38a02a-0b32-4aae-9980-526f8f53276c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:49:36.980282 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 894/1799] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 30 00:49:36 2022] DELETE /identity/v3/projects/959a444656fa4c47afa2bb99c1845709 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 00:49:36.985272 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3c79eb-b663-4ac0-bbd9-3d8b29f2f22b None None] REQUEST_METHOD: `POST` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:36.985665 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3c79eb-b663-4ac0-bbd9-3d8b29f2f22b None None] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:36.986005 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3c79eb-b663-4ac0-bbd9-3d8b29f2f22b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:36.986149 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-cc8b1405-880d-426b-bf84-7d9376f778dd admin admin] The token cache is being invalidate because project 3ce53dad1c5e4fba830856fb4309fd97 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87956) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 00:49:36.986422 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-cc8b1405-880d-426b-bf84-7d9376f778dd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:49:36.987064 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-cc8b1405-880d-426b-bf84-7d9376f778dd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:49:36.988852 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 906/1800] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 30 00:49:36 2022] DELETE /identity/v3/projects/3ce53dad1c5e4fba830856fb4309fd97 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 00:49:36.993316 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171a3526-c9c1-43eb-a82b-cd3e94c2b41e None None] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:36.993594 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171a3526-c9c1-43eb-a82b-cd3e94c2b41e None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:36.993917 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171a3526-c9c1-43eb-a82b-cd3e94c2b41e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:37.010339 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.auth.core [None req-eb3c79eb-b663-4ac0-bbd9-3d8b29f2f22b None None] MFA Rules not processed for user `eb55b6cbca4945abb21b0e49eb745e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=87955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:49:37.011821 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-eb3c79eb-b663-4ac0-bbd9-3d8b29f2f22b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:49:37.014719 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.auth.core [None req-171a3526-c9c1-43eb-a82b-cd3e94c2b41e None None] MFA Rules not processed for user `eb55b6cbca4945abb21b0e49eb745e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=87956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:49:37.017354 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-171a3526-c9c1-43eb-a82b-cd3e94c2b41e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:49:37.087398 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 907/1801] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 30 00:49:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 30 00:49:37.088891 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 895/1802] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 30 00:49:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 30 00:49:37.095235 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1d486f-8602-4d7a-85a7-ea0fa1f85648 None None] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:37.095527 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1d486f-8602-4d7a-85a7-ea0fa1f85648 None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:37.095801 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1d486f-8602-4d7a-85a7-ea0fa1f85648 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:37.096181 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14efa82-7ca9-4fa4-a7e3-fa9a14145114 None None] REQUEST_METHOD: `POST` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:37.096469 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14efa82-7ca9-4fa4-a7e3-fa9a14145114 None None] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:37.096742 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14efa82-7ca9-4fa4-a7e3-fa9a14145114 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:37.115134 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.auth.core [None req-6d1d486f-8602-4d7a-85a7-ea0fa1f85648 None None] MFA Rules not processed for user `eb55b6cbca4945abb21b0e49eb745e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=87956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:49:37.115622 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.auth.core [None req-a14efa82-7ca9-4fa4-a7e3-fa9a14145114 None None] MFA Rules not processed for user `eb55b6cbca4945abb21b0e49eb745e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=87955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:49:37.116368 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-6d1d486f-8602-4d7a-85a7-ea0fa1f85648 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:49:37.116800 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-a14efa82-7ca9-4fa4-a7e3-fa9a14145114 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:49:37.124346 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 908/1803] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 30 00:49:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 30 00:49:37.124584 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 896/1804] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 30 00:49:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 30 00:49:37.128438 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1d486f-8602-4d7a-85a7-ea0fa1f85648 None None] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:49:37.128567 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14efa82-7ca9-4fa4-a7e3-fa9a14145114 None None] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:49:37.137838 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14efa82-7ca9-4fa4-a7e3-fa9a14145114 None None] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:49:37.138917 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1d486f-8602-4d7a-85a7-ea0fa1f85648 None None] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:49:37.142765 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2361196-7dcb-4d23-b67c-842ca0574bdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:49:37.143376 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2361196-7dcb-4d23-b67c-842ca0574bdc admin admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:37.143524 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751850d7-bc5e-437c-bacb-7552782eddfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:49:37.143734 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2361196-7dcb-4d23-b67c-842ca0574bdc admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:37.143930 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2361196-7dcb-4d23-b67c-842ca0574bdc admin admin] PATH_INFO: `/v3/domains` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:37.144110 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751850d7-bc5e-437c-bacb-7552782eddfe admin admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:37.144385 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751850d7-bc5e-437c-bacb-7552782eddfe admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:37.144579 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2361196-7dcb-4d23-b67c-842ca0574bdc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:49:37.144676 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751850d7-bc5e-437c-bacb-7552782eddfe admin admin] PATH_INFO: `/v3/domains` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:37.144910 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2361196-7dcb-4d23-b67c-842ca0574bdc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:49:37.145402 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751850d7-bc5e-437c-bacb-7552782eddfe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87956) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:49:37.145700 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751850d7-bc5e-437c-bacb-7552782eddfe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:49:37.146530 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2361196-7dcb-4d23-b67c-842ca0574bdc admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:49:37.147294 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751850d7-bc5e-437c-bacb-7552782eddfe admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:49:37.158885 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 897/1805] 10.222.0.42 () {58 vars in 1153 bytes} [Sun Oct 30 00:49:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 30 00:49:37.159853 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 909/1806] 10.222.0.42 () {58 vars in 1153 bytes} [Sun Oct 30 00:49:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 30 00:49:37.163736 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2361196-7dcb-4d23-b67c-842ca0574bdc admin admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:49:37.163924 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751850d7-bc5e-437c-bacb-7552782eddfe admin admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:49:37.173650 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751850d7-bc5e-437c-bacb-7552782eddfe admin admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:49:37.173934 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2361196-7dcb-4d23-b67c-842ca0574bdc admin admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:49:37.178912 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305098a2-485b-4954-b798-c4478e432b35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:49:37.179536 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305098a2-485b-4954-b798-c4478e432b35 admin admin] REQUEST_METHOD: `POST` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:37.179819 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305098a2-485b-4954-b798-c4478e432b35 admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:37.180092 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305098a2-485b-4954-b798-c4478e432b35 admin admin] PATH_INFO: `/v3/projects` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:37.180747 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305098a2-485b-4954-b798-c4478e432b35 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:49:37.182657 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305098a2-485b-4954-b798-c4478e432b35 admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:49:37.191929 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9999fe6a-3837-4b41-8c50-f6fd75d055ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:49:37.192730 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9999fe6a-3837-4b41-8c50-f6fd75d055ef admin admin] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:37.193030 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9999fe6a-3837-4b41-8c50-f6fd75d055ef admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:37.193304 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9999fe6a-3837-4b41-8c50-f6fd75d055ef admin admin] PATH_INFO: `/v3/projects` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:37.195512 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9999fe6a-3837-4b41-8c50-f6fd75d055ef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:49:37.197882 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9999fe6a-3837-4b41-8c50-f6fd75d055ef admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:49:37.203457 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:49:37.212672 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 898/1807] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 30 00:49:37 2022] POST /identity/v3/projects => generated 365 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 00:49:37.217325 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305098a2-485b-4954-b798-c4478e432b35 admin admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:49:37.221966 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:49:37.240017 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 910/1808] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 30 00:49:37 2022] POST /identity/v3/projects => generated 383 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 30 00:49:37.241530 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9999fe6a-3837-4b41-8c50-f6fd75d055ef admin admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:49:37.299680 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305098a2-485b-4954-b798-c4478e432b35 admin admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:49:37.310912 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9999fe6a-3837-4b41-8c50-f6fd75d055ef admin admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:49:37.316791 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e545ec-f538-4f7f-8150-6977e1e864bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:49:37.317488 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e545ec-f538-4f7f-8150-6977e1e864bb admin admin] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:37.317836 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e545ec-f538-4f7f-8150-6977e1e864bb admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:37.318176 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e545ec-f538-4f7f-8150-6977e1e864bb admin admin] PATH_INFO: `/v3/users` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:37.318981 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e545ec-f538-4f7f-8150-6977e1e864bb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:49:37.321634 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e545ec-f538-4f7f-8150-6977e1e864bb admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:49:37.346538 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 911/1809] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 30 00:49:37 2022] POST /identity/v3/users => generated 292 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 30 00:49:37.350631 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e545ec-f538-4f7f-8150-6977e1e864bb admin admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:49:37.363582 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e545ec-f538-4f7f-8150-6977e1e864bb admin admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:49:37.367295 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a2a101-f9d7-47e8-b154-cfc55212662c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:49:37.368054 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a2a101-f9d7-47e8-b154-cfc55212662c admin admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:37.368396 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a2a101-f9d7-47e8-b154-cfc55212662c admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:37.368735 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a2a101-f9d7-47e8-b154-cfc55212662c admin admin] PATH_INFO: `/v3/roles` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:37.369496 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a2a101-f9d7-47e8-b154-cfc55212662c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:49:37.370693 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d944e0a-8263-420c-be73-9f267976ca3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:49:37.371328 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a2a101-f9d7-47e8-b154-cfc55212662c admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:49:37.371426 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d944e0a-8263-420c-be73-9f267976ca3e admin admin] REQUEST_METHOD: `POST` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:37.371604 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d944e0a-8263-420c-be73-9f267976ca3e admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:37.371879 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d944e0a-8263-420c-be73-9f267976ca3e admin admin] PATH_INFO: `/v3/users` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:37.372512 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d944e0a-8263-420c-be73-9f267976ca3e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:49:37.374412 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d944e0a-8263-420c-be73-9f267976ca3e admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:49:37.381737 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 912/1810] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 30 00:49:37 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 30 00:49:37.385929 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a2a101-f9d7-47e8-b154-cfc55212662c admin admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:49:37.396207 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a2a101-f9d7-47e8-b154-cfc55212662c admin admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:49:37.400552 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 899/1811] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 30 00:49:37 2022] POST /identity/v3/users => generated 283 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 30 00:49:37.400701 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560d3c2e-39f3-4a4c-8bea-169ed674a79b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:49:37.401261 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560d3c2e-39f3-4a4c-8bea-169ed674a79b admin admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:37.401530 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560d3c2e-39f3-4a4c-8bea-169ed674a79b admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:37.401719 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d944e0a-8263-420c-be73-9f267976ca3e admin admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:49:37.401815 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560d3c2e-39f3-4a4c-8bea-169ed674a79b admin admin] PATH_INFO: `/v3/roles` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:37.402415 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560d3c2e-39f3-4a4c-8bea-169ed674a79b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:49:37.404039 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560d3c2e-39f3-4a4c-8bea-169ed674a79b admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:49:37.411514 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d944e0a-8263-420c-be73-9f267976ca3e admin admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:49:37.417627 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 913/1812] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 30 00:49:37 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 30 00:49:37.418533 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560d3c2e-39f3-4a4c-8bea-169ed674a79b admin admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:49:37.419538 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab10884-4bcf-473d-875d-a31b6445147b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:49:37.420196 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab10884-4bcf-473d-875d-a31b6445147b admin admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:37.420483 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab10884-4bcf-473d-875d-a31b6445147b admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:37.420752 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab10884-4bcf-473d-875d-a31b6445147b admin admin] PATH_INFO: `/v3/roles` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:37.421430 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab10884-4bcf-473d-875d-a31b6445147b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:49:37.423029 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab10884-4bcf-473d-875d-a31b6445147b admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:49:37.429227 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560d3c2e-39f3-4a4c-8bea-169ed674a79b admin admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:49:37.434020 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 900/1813] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 30 00:49:37 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 00:49:37.434372 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7359571b-df43-41e2-8167-69f28b72a4a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:49:37.435146 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7359571b-df43-41e2-8167-69f28b72a4a4 admin admin] REQUEST_METHOD: `PUT` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:37.435567 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7359571b-df43-41e2-8167-69f28b72a4a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:37.435928 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7359571b-df43-41e2-8167-69f28b72a4a4 admin admin] PATH_INFO: `/v3/projects/a47f747eadff4e21be98fe4e123df974/users/565269e8445b4eb1ab215a108f6e7d85/roles/1c93019874174c4b91118d9ce2347e47` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:37.437793 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab10884-4bcf-473d-875d-a31b6445147b admin admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:49:37.449864 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab10884-4bcf-473d-875d-a31b6445147b admin admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:49:37.452977 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7359571b-df43-41e2-8167-69f28b72a4a4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a47f747eadff4e21be98fe4e123df974, user_id=565269e8445b4eb1ab215a108f6e7d85, role_id=1c93019874174c4b91118d9ce2347e47)` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:49:37.454470 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6fc381-7878-4310-b570-d7014a2f542b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:49:37.455077 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6fc381-7878-4310-b570-d7014a2f542b admin admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:37.455389 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6fc381-7878-4310-b570-d7014a2f542b admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:37.455663 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6fc381-7878-4310-b570-d7014a2f542b admin admin] PATH_INFO: `/v3/roles` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:37.456307 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6fc381-7878-4310-b570-d7014a2f542b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:49:37.456679 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7359571b-df43-41e2-8167-69f28b72a4a4 admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:49:37.457889 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6fc381-7878-4310-b570-d7014a2f542b admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:49:37.469624 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 901/1814] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 30 00:49:37 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 30 00:49:37.473651 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6fc381-7878-4310-b570-d7014a2f542b admin admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:49:37.474273 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 914/1815] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 30 00:49:37 2022] PUT /identity/v3/projects/a47f747eadff4e21be98fe4e123df974/users/565269e8445b4eb1ab215a108f6e7d85/roles/1c93019874174c4b91118d9ce2347e47 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 00:49:37.478959 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83342642-1197-4535-bdd9-8c42af6c8f9c None None] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:37.479397 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83342642-1197-4535-bdd9-8c42af6c8f9c None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:37.479727 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83342642-1197-4535-bdd9-8c42af6c8f9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:37.487860 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6fc381-7878-4310-b570-d7014a2f542b admin admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:49:37.502100 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.auth.core [None req-83342642-1197-4535-bdd9-8c42af6c8f9c None None] MFA Rules not processed for user `eb55b6cbca4945abb21b0e49eb745e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=87956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:49:37.507793 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-83342642-1197-4535-bdd9-8c42af6c8f9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:49:37.565644 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683eedcd-3bc1-4498-9004-59dc7c7f6361 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:49:37.566405 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683eedcd-3bc1-4498-9004-59dc7c7f6361 admin admin] REQUEST_METHOD: `PUT` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:37.566971 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683eedcd-3bc1-4498-9004-59dc7c7f6361 admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:37.567348 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683eedcd-3bc1-4498-9004-59dc7c7f6361 admin admin] PATH_INFO: `/v3/projects/cfcaf63c69fb48f192221fb6b3cd31ab/users/c3f787a6ed6344f98e71e9c19d43dd28/roles/1c93019874174c4b91118d9ce2347e47` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:37.583306 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683eedcd-3bc1-4498-9004-59dc7c7f6361 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cfcaf63c69fb48f192221fb6b3cd31ab, user_id=c3f787a6ed6344f98e71e9c19d43dd28, role_id=1c93019874174c4b91118d9ce2347e47)` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:49:37.586197 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683eedcd-3bc1-4498-9004-59dc7c7f6361 admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:49:37.601122 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:49:37.610514 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 915/1816] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 30 00:49:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 30 00:49:37.610682 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 902/1817] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 30 00:49:37 2022] PUT /identity/v3/projects/cfcaf63c69fb48f192221fb6b3cd31ab/users/c3f787a6ed6344f98e71e9c19d43dd28/roles/1c93019874174c4b91118d9ce2347e47 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 00:49:37.619499 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b04b66-57d9-4a74-b184-2729b9b27385 None None] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:37.619787 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b04b66-57d9-4a74-b184-2729b9b27385 None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:37.620269 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b04b66-57d9-4a74-b184-2729b9b27385 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:37.628667 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683eedcd-3bc1-4498-9004-59dc7c7f6361 admin admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:49:37.630507 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-683eedcd-3bc1-4498-9004-59dc7c7f6361 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:49:37.657701 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.auth.core [None req-c0b04b66-57d9-4a74-b184-2729b9b27385 None None] MFA Rules not processed for user `c3f787a6ed6344f98e71e9c19d43dd28`. Rule list: `[]` (Enabled: `True`). {{(pid=87956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:49:37.659077 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-c0b04b66-57d9-4a74-b184-2729b9b27385 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:49:37.686868 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:49:37.712096 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683eedcd-3bc1-4498-9004-59dc7c7f6361 admin admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:49:37.728177 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93332f4e-53a6-4010-8e39-183d0b49be2b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5693f186c6ad4d9394f02ee3477cdcd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d2387fdf794d4eaef07bbcd7b39f2a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:49:37.728992 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93332f4e-53a6-4010-8e39-183d0b49be2b service neutron] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:37.729483 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93332f4e-53a6-4010-8e39-183d0b49be2b service neutron] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:37.729830 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93332f4e-53a6-4010-8e39-183d0b49be2b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:37.754641 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 916/1818] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 30 00:49:37 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:49:37.759056 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b04b66-57d9-4a74-b184-2729b9b27385 None None] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:49:37.814849 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93332f4e-53a6-4010-8e39-183d0b49be2b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:49:37.816446 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93332f4e-53a6-4010-8e39-183d0b49be2b service neutron] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:49:37.828082 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 903/1819] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 30 00:49:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 30 00:49:37.841478 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b04b66-57d9-4a74-b184-2729b9b27385 None None] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:49:37.846442 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fef1f6-5625-458a-86e1-5ef5a22dc671 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:49:37.846831 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fef1f6-5625-458a-86e1-5ef5a22dc671 admin admin] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:37.847144 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fef1f6-5625-458a-86e1-5ef5a22dc671 admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:37.847385 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fef1f6-5625-458a-86e1-5ef5a22dc671 admin admin] PATH_INFO: `/v3/projects` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:37.848221 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56fef1f6-5625-458a-86e1-5ef5a22dc671 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:49:37.849914 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56fef1f6-5625-458a-86e1-5ef5a22dc671 admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:49:37.867981 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93332f4e-53a6-4010-8e39-183d0b49be2b service neutron] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:49:37.870281 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-93332f4e-53a6-4010-8e39-183d0b49be2b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:49:37.886961 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93332f4e-53a6-4010-8e39-183d0b49be2b service neutron] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:49:37.892611 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda0cd46-e994-47fc-9ac8-e9580d03232f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:49:37.893250 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda0cd46-e994-47fc-9ac8-e9580d03232f admin admin] REQUEST_METHOD: `DELETE` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:37.893573 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda0cd46-e994-47fc-9ac8-e9580d03232f admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:37.893847 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda0cd46-e994-47fc-9ac8-e9580d03232f admin admin] PATH_INFO: `/v3/users/fc09e42fa5cc41118dfe413ecc674200` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:37.895307 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 917/1820] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 30 00:49:37 2022] POST /identity/v3/projects => generated 363 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 00:49:37.896040 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda0cd46-e994-47fc-9ac8-e9580d03232f admin admin] RBAC: Authorizing `identity:delete_user(user_id=fc09e42fa5cc41118dfe413ecc674200)` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:49:37.897979 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda0cd46-e994-47fc-9ac8-e9580d03232f admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:49:37.899124 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fef1f6-5625-458a-86e1-5ef5a22dc671 admin admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:49:37.958968 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-cda0cd46-e994-47fc-9ac8-e9580d03232f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fc09e42fa5cc41118dfe413ecc674200'} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:49:37.960055 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-cda0cd46-e994-47fc-9ac8-e9580d03232f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fc09e42fa5cc41118dfe413ecc674200'} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:49:37.967920 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fef1f6-5625-458a-86e1-5ef5a22dc671 admin admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:49:37.970705 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-cda0cd46-e994-47fc-9ac8-e9580d03232f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fc09e42fa5cc41118dfe413ecc674200'} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:49:37.971550 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-cda0cd46-e994-47fc-9ac8-e9580d03232f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fc09e42fa5cc41118dfe413ecc674200'} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:49:37.973239 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52e03ec-ff09-4288-8f14-380b20e921c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:49:37.973913 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52e03ec-ff09-4288-8f14-380b20e921c1 admin admin] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:37.974197 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52e03ec-ff09-4288-8f14-380b20e921c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:37.974459 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52e03ec-ff09-4288-8f14-380b20e921c1 admin admin] PATH_INFO: `/v3/users` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:37.975151 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52e03ec-ff09-4288-8f14-380b20e921c1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:49:37.977382 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52e03ec-ff09-4288-8f14-380b20e921c1 admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:49:37.989893 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-cda0cd46-e994-47fc-9ac8-e9580d03232f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fc09e42fa5cc41118dfe413ecc674200'} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:49:38.004797 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 918/1821] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 30 00:49:37 2022] POST /identity/v3/users => generated 288 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 30 00:49:38.005858 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52e03ec-ff09-4288-8f14-380b20e921c1 admin admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:49:38.007931 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-b52e03ec-ff09-4288-8f14-380b20e921c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:49:38.012719 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 904/1822] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 30 00:49:37 2022] DELETE /identity/v3/users/fc09e42fa5cc41118dfe413ecc674200 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 00:49:38.018048 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981e0bb2-78c1-4cd5-9f20-10349404aea4 None None] REQUEST_METHOD: `POST` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:38.018520 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981e0bb2-78c1-4cd5-9f20-10349404aea4 None None] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:38.018931 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981e0bb2-78c1-4cd5-9f20-10349404aea4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:38.021387 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52e03ec-ff09-4288-8f14-380b20e921c1 admin admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:49:38.044490 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.auth.core [None req-981e0bb2-78c1-4cd5-9f20-10349404aea4 None None] MFA Rules not processed for user `eb55b6cbca4945abb21b0e49eb745e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=87955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:49:38.046360 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-981e0bb2-78c1-4cd5-9f20-10349404aea4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:49:38.057166 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:49:38.086024 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:49:38.111696 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b37c692-a6ab-4c44-a102-0b808ec04af4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:49:38.112428 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b37c692-a6ab-4c44-a102-0b808ec04af4 admin admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:38.112803 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b37c692-a6ab-4c44-a102-0b808ec04af4 admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:38.113169 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b37c692-a6ab-4c44-a102-0b808ec04af4 admin admin] PATH_INFO: `/v3/roles` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:38.113915 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b37c692-a6ab-4c44-a102-0b808ec04af4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:49:38.115639 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b37c692-a6ab-4c44-a102-0b808ec04af4 admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:49:38.147268 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 905/1823] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 30 00:49:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:49:38.147469 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 919/1824] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 30 00:49:38 2022] GET /identity/v3/roles => generated 1420 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 00:49:38.149135 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981e0bb2-78c1-4cd5-9f20-10349404aea4 None None] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:49:38.157403 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b37c692-a6ab-4c44-a102-0b808ec04af4 admin admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:49:38.159272 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-2b37c692-a6ab-4c44-a102-0b808ec04af4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:49:38.160191 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981e0bb2-78c1-4cd5-9f20-10349404aea4 None None] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:49:38.165352 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6dc3eff-2fd9-4f1a-b41f-d209f9d975bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:49:38.166171 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dc3eff-2fd9-4f1a-b41f-d209f9d975bc admin admin] REQUEST_METHOD: `PUT` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:38.166511 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dc3eff-2fd9-4f1a-b41f-d209f9d975bc admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:38.167079 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dc3eff-2fd9-4f1a-b41f-d209f9d975bc admin admin] PATH_INFO: `/v3/projects/de4dc3f37f46470ca161f91e2690d462/users/e53dffc053a74b9bbf40338fc4a2996a/roles/6ccaa8c11f29456fb4e4eeccb21616c7` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:38.187161 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6dc3eff-2fd9-4f1a-b41f-d209f9d975bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=de4dc3f37f46470ca161f91e2690d462, user_id=e53dffc053a74b9bbf40338fc4a2996a, role_id=6ccaa8c11f29456fb4e4eeccb21616c7)` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:49:38.190512 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6dc3eff-2fd9-4f1a-b41f-d209f9d975bc admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:49:38.215447 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 906/1825] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 30 00:49:38 2022] PUT /identity/v3/projects/de4dc3f37f46470ca161f91e2690d462/users/e53dffc053a74b9bbf40338fc4a2996a/roles/6ccaa8c11f29456fb4e4eeccb21616c7 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 00:49:38.217386 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6dc3eff-2fd9-4f1a-b41f-d209f9d975bc admin admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:49:38.266607 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b37c692-a6ab-4c44-a102-0b808ec04af4 admin admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:49:38.333443 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6dc3eff-2fd9-4f1a-b41f-d209f9d975bc admin admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:49:38.341757 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93058053-32d8-468d-9152-35fdecff6732 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5693f186c6ad4d9394f02ee3477cdcd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d2387fdf794d4eaef07bbcd7b39f2a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:49:38.342557 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8b3c6e-1a50-4026-81bd-2ea5c2f5b873 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:49:38.342721 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93058053-32d8-468d-9152-35fdecff6732 service neutron] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:38.343021 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93058053-32d8-468d-9152-35fdecff6732 service neutron] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:38.343450 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93058053-32d8-468d-9152-35fdecff6732 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:38.344657 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8b3c6e-1a50-4026-81bd-2ea5c2f5b873 admin admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:38.345085 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8b3c6e-1a50-4026-81bd-2ea5c2f5b873 admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:38.345763 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8b3c6e-1a50-4026-81bd-2ea5c2f5b873 admin admin] PATH_INFO: `/v3/roles` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:38.346427 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8b3c6e-1a50-4026-81bd-2ea5c2f5b873 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:49:38.352220 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8b3c6e-1a50-4026-81bd-2ea5c2f5b873 admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:49:38.358580 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93058053-32d8-468d-9152-35fdecff6732 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:49:38.360367 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93058053-32d8-468d-9152-35fdecff6732 service neutron] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:49:38.378757 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 907/1826] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 30 00:49:38 2022] GET /identity/v3/roles => generated 1420 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 00:49:38.383978 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8b3c6e-1a50-4026-81bd-2ea5c2f5b873 admin admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:49:38.385563 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 920/1827] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 30 00:49:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 00:49:38.395723 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8b3c6e-1a50-4026-81bd-2ea5c2f5b873 admin admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:49:38.403049 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafb6062-c625-4e37-9968-0aa89f295d31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:49:38.403888 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafb6062-c625-4e37-9968-0aa89f295d31 admin admin] REQUEST_METHOD: `PUT` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:38.404170 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafb6062-c625-4e37-9968-0aa89f295d31 admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:38.404508 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafb6062-c625-4e37-9968-0aa89f295d31 admin admin] PATH_INFO: `/v3/projects/de4dc3f37f46470ca161f91e2690d462/users/e53dffc053a74b9bbf40338fc4a2996a/roles/6ccaa8c11f29456fb4e4eeccb21616c7` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:38.406990 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dafb6062-c625-4e37-9968-0aa89f295d31 admin admin] RBAC: Authorizing `identity:create_grant(project_id=de4dc3f37f46470ca161f91e2690d462, user_id=e53dffc053a74b9bbf40338fc4a2996a, role_id=6ccaa8c11f29456fb4e4eeccb21616c7)` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:49:38.409826 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dafb6062-c625-4e37-9968-0aa89f295d31 admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:49:38.422724 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 908/1828] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 30 00:49:38 2022] PUT /identity/v3/projects/de4dc3f37f46470ca161f91e2690d462/users/e53dffc053a74b9bbf40338fc4a2996a/roles/6ccaa8c11f29456fb4e4eeccb21616c7 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 00:49:38.434311 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05171469-5450-4dfd-9ad0-e8d0d70e4f71 None None] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:38.434757 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05171469-5450-4dfd-9ad0-e8d0d70e4f71 None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:38.435373 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05171469-5450-4dfd-9ad0-e8d0d70e4f71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:38.476532 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.auth.core [None req-05171469-5450-4dfd-9ad0-e8d0d70e4f71 None None] MFA Rules not processed for user `e53dffc053a74b9bbf40338fc4a2996a`. Rule list: `[]` (Enabled: `True`). {{(pid=87956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:49:38.478148 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-05171469-5450-4dfd-9ad0-e8d0d70e4f71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:49:38.568165 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 921/1829] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 30 00:49:38 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:49:38.580131 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafb6062-c625-4e37-9968-0aa89f295d31 admin admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:49:38.582051 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-dafb6062-c625-4e37-9968-0aa89f295d31 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:49:38.646793 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafb6062-c625-4e37-9968-0aa89f295d31 admin admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:49:38.651120 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522ae304-4be4-4f73-b4b0-e706f78ac45f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48d928ff7fe24348ac900f09c56acc20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d2387fdf794d4eaef07bbcd7b39f2a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:49:38.651827 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522ae304-4be4-4f73-b4b0-e706f78ac45f service cinder] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:38.652109 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522ae304-4be4-4f73-b4b0-e706f78ac45f service cinder] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:38.652375 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522ae304-4be4-4f73-b4b0-e706f78ac45f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:38.662307 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522ae304-4be4-4f73-b4b0-e706f78ac45f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:49:38.663993 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522ae304-4be4-4f73-b4b0-e706f78ac45f service cinder] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:49:38.677395 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 909/1830] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 30 00:49:38 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 00:49:38.897832 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e20b361-c737-4cd7-b35a-5391e720a56a None None] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:38.898143 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e20b361-c737-4cd7-b35a-5391e720a56a None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:38.898483 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e20b361-c737-4cd7-b35a-5391e720a56a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:38.933164 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=100 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:49:38.937068 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.auth.core [None req-4e20b361-c737-4cd7-b35a-5391e720a56a None None] MFA Rules not processed for user `565269e8445b4eb1ab215a108f6e7d85`. Rule list: `[]` (Enabled: `True`). {{(pid=87956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:49:38.938694 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-4e20b361-c737-4cd7-b35a-5391e720a56a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:49:39.047075 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 922/1831] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 30 00:49:38 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:49:39.078371 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522ae304-4be4-4f73-b4b0-e706f78ac45f service cinder] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:49:39.087713 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522ae304-4be4-4f73-b4b0-e706f78ac45f service cinder] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:49:39.106301 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be13971e-a09c-41a4-abf5-1fd0b2bd6c82 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48d928ff7fe24348ac900f09c56acc20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d2387fdf794d4eaef07bbcd7b39f2a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:49:39.107471 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be13971e-a09c-41a4-abf5-1fd0b2bd6c82 service cinder] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:39.107693 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be13971e-a09c-41a4-abf5-1fd0b2bd6c82 service cinder] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:39.107967 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be13971e-a09c-41a4-abf5-1fd0b2bd6c82 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:39.118204 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be13971e-a09c-41a4-abf5-1fd0b2bd6c82 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:49:39.119818 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be13971e-a09c-41a4-abf5-1fd0b2bd6c82 service cinder] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:49:39.125892 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e20b361-c737-4cd7-b35a-5391e720a56a None None] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:49:39.128209 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-4e20b361-c737-4cd7-b35a-5391e720a56a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:49:39.130529 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 910/1832] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 30 00:49:39 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 00:49:39.220552 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e20b361-c737-4cd7-b35a-5391e720a56a None None] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:49:39.224768 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2598325-55e4-4bd6-9397-9ddfd8b0c2f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:49:39.225413 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2598325-55e4-4bd6-9397-9ddfd8b0c2f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:39.225693 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2598325-55e4-4bd6-9397-9ddfd8b0c2f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:39.225972 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2598325-55e4-4bd6-9397-9ddfd8b0c2f7 admin admin] PATH_INFO: `/v3/projects/94519552c40f420fa3aa9e1dc7867bfa` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:39.227236 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2598325-55e4-4bd6-9397-9ddfd8b0c2f7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=94519552c40f420fa3aa9e1dc7867bfa)` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:49:39.229274 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2598325-55e4-4bd6-9397-9ddfd8b0c2f7 admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:49:39.251997 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be13971e-a09c-41a4-abf5-1fd0b2bd6c82 service cinder] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:49:39.263798 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be13971e-a09c-41a4-abf5-1fd0b2bd6c82 service cinder] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:49:39.268808 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a46870-5309-4b8e-9419-dac29bbce7e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:49:39.269467 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a46870-5309-4b8e-9419-dac29bbce7e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:39.269718 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a46870-5309-4b8e-9419-dac29bbce7e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:39.270001 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a46870-5309-4b8e-9419-dac29bbce7e5 admin admin] PATH_INFO: `/v3/users/c3f787a6ed6344f98e71e9c19d43dd28` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:39.272547 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a46870-5309-4b8e-9419-dac29bbce7e5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c3f787a6ed6344f98e71e9c19d43dd28)` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:49:39.274115 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a46870-5309-4b8e-9419-dac29bbce7e5 admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:49:39.281221 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:49:39.290971 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-e2598325-55e4-4bd6-9397-9ddfd8b0c2f7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '94519552c40f420fa3aa9e1dc7867bfa', 'request_id': 'req-e2598325-55e4-4bd6-9397-9ddfd8b0c2f7'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:49:39.300996 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-e2598325-55e4-4bd6-9397-9ddfd8b0c2f7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '94519552c40f420fa3aa9e1dc7867bfa', 'request_id': 'req-e2598325-55e4-4bd6-9397-9ddfd8b0c2f7'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:49:39.311121 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-e2598325-55e4-4bd6-9397-9ddfd8b0c2f7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '94519552c40f420fa3aa9e1dc7867bfa', 'request_id': 'req-e2598325-55e4-4bd6-9397-9ddfd8b0c2f7'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:49:39.325301 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-e2598325-55e4-4bd6-9397-9ddfd8b0c2f7 admin admin] The token cache is being invalidate because project 94519552c40f420fa3aa9e1dc7867bfa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87956) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 00:49:39.325802 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-e2598325-55e4-4bd6-9397-9ddfd8b0c2f7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:49:39.326595 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-e2598325-55e4-4bd6-9397-9ddfd8b0c2f7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:49:39.328940 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 923/1833] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 30 00:49:39 2022] DELETE /identity/v3/projects/94519552c40f420fa3aa9e1dc7867bfa => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 00:49:39.332844 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2598325-55e4-4bd6-9397-9ddfd8b0c2f7 admin admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:49:39.334380 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-e2598325-55e4-4bd6-9397-9ddfd8b0c2f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:49:39.337798 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-34a46870-5309-4b8e-9419-dac29bbce7e5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c3f787a6ed6344f98e71e9c19d43dd28'} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:49:39.338571 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-34a46870-5309-4b8e-9419-dac29bbce7e5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c3f787a6ed6344f98e71e9c19d43dd28'} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:49:39.346840 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-34a46870-5309-4b8e-9419-dac29bbce7e5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c3f787a6ed6344f98e71e9c19d43dd28'} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:49:39.347686 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-34a46870-5309-4b8e-9419-dac29bbce7e5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c3f787a6ed6344f98e71e9c19d43dd28'} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:49:39.360551 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-34a46870-5309-4b8e-9419-dac29bbce7e5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c3f787a6ed6344f98e71e9c19d43dd28'} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:49:39.372701 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:49:39.380046 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 911/1834] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 30 00:49:39 2022] DELETE /identity/v3/users/c3f787a6ed6344f98e71e9c19d43dd28 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 00:49:39.383076 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e21042-7287-4247-8472-7bf549d27cfd None None] REQUEST_METHOD: `POST` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:39.383723 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e21042-7287-4247-8472-7bf549d27cfd None None] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:39.383996 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e21042-7287-4247-8472-7bf549d27cfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:39.409042 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.auth.core [None req-f7e21042-7287-4247-8472-7bf549d27cfd None None] MFA Rules not processed for user `eb55b6cbca4945abb21b0e49eb745e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=87955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:49:39.410481 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-f7e21042-7287-4247-8472-7bf549d27cfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:49:39.411994 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2598325-55e4-4bd6-9397-9ddfd8b0c2f7 admin admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:49:39.490092 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967be72d-f84c-4a39-8b8b-6887476680f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:49:39.491587 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 912/1835] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 30 00:49:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:49:39.492077 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967be72d-f84c-4a39-8b8b-6887476680f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:39.492448 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967be72d-f84c-4a39-8b8b-6887476680f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:39.492786 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967be72d-f84c-4a39-8b8b-6887476680f0 admin admin] PATH_INFO: `/v3/users/d1ce5f8d24cd4e3b81edd946270b0087` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:39.494054 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967be72d-f84c-4a39-8b8b-6887476680f0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d1ce5f8d24cd4e3b81edd946270b0087)` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:49:39.496667 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967be72d-f84c-4a39-8b8b-6887476680f0 admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:49:39.501142 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e21042-7287-4247-8472-7bf549d27cfd None None] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:49:39.502610 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-f7e21042-7287-4247-8472-7bf549d27cfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:49:39.552710 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-967be72d-f84c-4a39-8b8b-6887476680f0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd1ce5f8d24cd4e3b81edd946270b0087'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:49:39.553374 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-967be72d-f84c-4a39-8b8b-6887476680f0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd1ce5f8d24cd4e3b81edd946270b0087'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:49:39.566895 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e21042-7287-4247-8472-7bf549d27cfd None None] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:49:39.569222 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-967be72d-f84c-4a39-8b8b-6887476680f0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd1ce5f8d24cd4e3b81edd946270b0087'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:49:39.570641 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2d9714-656e-4d06-9449-8f30b7dea0ae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5693f186c6ad4d9394f02ee3477cdcd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d2387fdf794d4eaef07bbcd7b39f2a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:49:39.571281 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2d9714-656e-4d06-9449-8f30b7dea0ae service neutron] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:39.571559 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2d9714-656e-4d06-9449-8f30b7dea0ae service neutron] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:39.571828 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2d9714-656e-4d06-9449-8f30b7dea0ae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:39.574190 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-8d2d9714-656e-4d06-9449-8f30b7dea0ae service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:49:39.587398 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-967be72d-f84c-4a39-8b8b-6887476680f0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd1ce5f8d24cd4e3b81edd946270b0087'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:49:39.587398 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-967be72d-f84c-4a39-8b8b-6887476680f0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd1ce5f8d24cd4e3b81edd946270b0087'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:49:39.588293 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2d9714-656e-4d06-9449-8f30b7dea0ae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:49:39.589825 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2d9714-656e-4d06-9449-8f30b7dea0ae service neutron] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:49:39.595241 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 924/1836] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 30 00:49:39 2022] DELETE /identity/v3/users/d1ce5f8d24cd4e3b81edd946270b0087 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 00:49:39.601464 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 913/1837] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 30 00:49:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 30 00:49:39.886877 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967be72d-f84c-4a39-8b8b-6887476680f0 admin admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:49:39.888761 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-967be72d-f84c-4a39-8b8b-6887476680f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:49:39.976889 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967be72d-f84c-4a39-8b8b-6887476680f0 admin admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:49:39.978914 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2d9714-656e-4d06-9449-8f30b7dea0ae service neutron] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:49:39.983827 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9f7436-d301-4426-914e-cfec4fd40327 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:49:39.986942 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-8d2d9714-656e-4d06-9449-8f30b7dea0ae service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:49:39.991311 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9f7436-d301-4426-914e-cfec4fd40327 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:39.991732 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9f7436-d301-4426-914e-cfec4fd40327 admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:39.991982 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9f7436-d301-4426-914e-cfec4fd40327 admin admin] PATH_INFO: `/v3/projects/cd0a637112e345a0a87fcac8c50e815f` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:39.993724 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9f7436-d301-4426-914e-cfec4fd40327 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cd0a637112e345a0a87fcac8c50e815f)` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:49:39.996059 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9f7436-d301-4426-914e-cfec4fd40327 admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:49:39.997813 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:49:40.006320 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2d9714-656e-4d06-9449-8f30b7dea0ae service neutron] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:49:40.013592 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a956a107-27a7-4e3c-88d6-de364f9c5eee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:49:40.014635 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a956a107-27a7-4e3c-88d6-de364f9c5eee admin admin] REQUEST_METHOD: `DELETE` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:40.014635 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a956a107-27a7-4e3c-88d6-de364f9c5eee admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:40.014954 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a956a107-27a7-4e3c-88d6-de364f9c5eee admin admin] PATH_INFO: `/v3/projects/cfcaf63c69fb48f192221fb6b3cd31ab` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:40.016733 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a956a107-27a7-4e3c-88d6-de364f9c5eee admin admin] RBAC: Authorizing `identity:delete_project(project_id=cfcaf63c69fb48f192221fb6b3cd31ab)` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:49:40.019242 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a956a107-27a7-4e3c-88d6-de364f9c5eee admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:49:40.048628 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:49:40.065511 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-af9f7436-d301-4426-914e-cfec4fd40327 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cd0a637112e345a0a87fcac8c50e815f', 'request_id': 'req-af9f7436-d301-4426-914e-cfec4fd40327'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:49:40.077802 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-af9f7436-d301-4426-914e-cfec4fd40327 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cd0a637112e345a0a87fcac8c50e815f', 'request_id': 'req-af9f7436-d301-4426-914e-cfec4fd40327'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:49:40.085509 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-a956a107-27a7-4e3c-88d6-de364f9c5eee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cfcaf63c69fb48f192221fb6b3cd31ab', 'request_id': 'req-a956a107-27a7-4e3c-88d6-de364f9c5eee'} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:49:40.087743 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-af9f7436-d301-4426-914e-cfec4fd40327 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cd0a637112e345a0a87fcac8c50e815f', 'request_id': 'req-af9f7436-d301-4426-914e-cfec4fd40327'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:49:40.094585 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-a956a107-27a7-4e3c-88d6-de364f9c5eee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cfcaf63c69fb48f192221fb6b3cd31ab', 'request_id': 'req-a956a107-27a7-4e3c-88d6-de364f9c5eee'} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:49:40.103758 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-a956a107-27a7-4e3c-88d6-de364f9c5eee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cfcaf63c69fb48f192221fb6b3cd31ab', 'request_id': 'req-a956a107-27a7-4e3c-88d6-de364f9c5eee'} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:49:40.105881 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-af9f7436-d301-4426-914e-cfec4fd40327 admin admin] The token cache is being invalidate because project cd0a637112e345a0a87fcac8c50e815f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87956) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 00:49:40.106218 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-af9f7436-d301-4426-914e-cfec4fd40327 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:49:40.107171 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-af9f7436-d301-4426-914e-cfec4fd40327 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:49:40.110347 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 925/1838] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 30 00:49:39 2022] DELETE /identity/v3/projects/cd0a637112e345a0a87fcac8c50e815f => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 00:49:40.116994 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5aa27d-0df0-4f62-a582-ed709f7c1761 None None] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:40.117355 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5aa27d-0df0-4f62-a582-ed709f7c1761 None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:40.117702 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5aa27d-0df0-4f62-a582-ed709f7c1761 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:40.125419 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-a956a107-27a7-4e3c-88d6-de364f9c5eee admin admin] The token cache is being invalidate because project cfcaf63c69fb48f192221fb6b3cd31ab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87955) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 00:49:40.125823 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-a956a107-27a7-4e3c-88d6-de364f9c5eee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:49:40.126533 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-a956a107-27a7-4e3c-88d6-de364f9c5eee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:49:40.141530 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.auth.core [None req-4f5aa27d-0df0-4f62-a582-ed709f7c1761 None None] MFA Rules not processed for user `eb55b6cbca4945abb21b0e49eb745e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=87956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:49:40.142087 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 914/1839] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 30 00:49:39 2022] DELETE /identity/v3/projects/cfcaf63c69fb48f192221fb6b3cd31ab => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 00:49:40.142927 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-4f5aa27d-0df0-4f62-a582-ed709f7c1761 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:49:40.147526 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a956a107-27a7-4e3c-88d6-de364f9c5eee admin admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:49:40.149246 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-a956a107-27a7-4e3c-88d6-de364f9c5eee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:49:40.239251 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 926/1840] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 30 00:49:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:49:40.247024 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fcafce-9c97-4552-829c-5e7416d06955 None None] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:40.247341 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fcafce-9c97-4552-829c-5e7416d06955 None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:40.247615 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fcafce-9c97-4552-829c-5e7416d06955 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:40.252095 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a956a107-27a7-4e3c-88d6-de364f9c5eee admin admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:49:40.257900 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3752100-3a59-4a13-8e7c-25b2c06709ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:49:40.258534 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3752100-3a59-4a13-8e7c-25b2c06709ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:40.258810 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3752100-3a59-4a13-8e7c-25b2c06709ee admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:40.259080 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3752100-3a59-4a13-8e7c-25b2c06709ee admin admin] PATH_INFO: `/v3/users/e53dffc053a74b9bbf40338fc4a2996a` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:40.260781 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3752100-3a59-4a13-8e7c-25b2c06709ee admin admin] RBAC: Authorizing `identity:delete_user(user_id=e53dffc053a74b9bbf40338fc4a2996a)` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:49:40.263033 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3752100-3a59-4a13-8e7c-25b2c06709ee admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:49:40.275591 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.auth.core [None req-c6fcafce-9c97-4552-829c-5e7416d06955 None None] MFA Rules not processed for user `eb55b6cbca4945abb21b0e49eb745e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=87956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:49:40.276896 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-c6fcafce-9c97-4552-829c-5e7416d06955 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:49:40.298908 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 927/1841] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 30 00:49:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 30 00:49:40.303581 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fcafce-9c97-4552-829c-5e7416d06955 None None] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:49:40.313701 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fcafce-9c97-4552-829c-5e7416d06955 None None] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:49:40.318531 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0671f0a2-c097-4753-b652-6c532277ac7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:49:40.319142 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0671f0a2-c097-4753-b652-6c532277ac7c admin admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:40.319459 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0671f0a2-c097-4753-b652-6c532277ac7c admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:40.320165 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0671f0a2-c097-4753-b652-6c532277ac7c admin admin] PATH_INFO: `/v3/domains` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:40.320455 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0671f0a2-c097-4753-b652-6c532277ac7c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87956) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:49:40.320752 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0671f0a2-c097-4753-b652-6c532277ac7c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:49:40.322385 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-d3752100-3a59-4a13-8e7c-25b2c06709ee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e53dffc053a74b9bbf40338fc4a2996a'} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:49:40.322859 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0671f0a2-c097-4753-b652-6c532277ac7c admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:49:40.323351 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-d3752100-3a59-4a13-8e7c-25b2c06709ee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e53dffc053a74b9bbf40338fc4a2996a'} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:49:40.331463 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-d3752100-3a59-4a13-8e7c-25b2c06709ee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e53dffc053a74b9bbf40338fc4a2996a'} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:49:40.332624 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-d3752100-3a59-4a13-8e7c-25b2c06709ee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e53dffc053a74b9bbf40338fc4a2996a'} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:49:40.335303 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 928/1842] 10.222.0.42 () {58 vars in 1153 bytes} [Sun Oct 30 00:49:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:49:40.339607 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0671f0a2-c097-4753-b652-6c532277ac7c admin admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:49:40.341307 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-0671f0a2-c097-4753-b652-6c532277ac7c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:49:40.348862 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-d3752100-3a59-4a13-8e7c-25b2c06709ee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e53dffc053a74b9bbf40338fc4a2996a'} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:49:40.354117 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0671f0a2-c097-4753-b652-6c532277ac7c admin admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:49:40.359384 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3da048a-15ea-49e8-9259-446b75e1ce72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:49:40.360003 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3da048a-15ea-49e8-9259-446b75e1ce72 admin admin] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:40.360264 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3da048a-15ea-49e8-9259-446b75e1ce72 admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:40.360528 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3da048a-15ea-49e8-9259-446b75e1ce72 admin admin] PATH_INFO: `/v3/projects` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:40.361155 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3da048a-15ea-49e8-9259-446b75e1ce72 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:49:40.363047 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3da048a-15ea-49e8-9259-446b75e1ce72 admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:49:40.364952 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 915/1843] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 30 00:49:40 2022] DELETE /identity/v3/users/e53dffc053a74b9bbf40338fc4a2996a => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 00:49:40.394219 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 929/1844] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 30 00:49:40 2022] POST /identity/v3/projects => generated 379 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 30 00:49:40.398867 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3752100-3a59-4a13-8e7c-25b2c06709ee admin admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:49:40.431057 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:DELETE=17,keystone:SELECT=81,keystone:INSERT=2 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:49:40.465034 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3752100-3a59-4a13-8e7c-25b2c06709ee admin admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:49:40.532659 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc56c30a-4139-4740-ac21-2438e8e963e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:49:40.533388 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc56c30a-4139-4740-ac21-2438e8e963e7 admin admin] REQUEST_METHOD: `POST` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:40.533712 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc56c30a-4139-4740-ac21-2438e8e963e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:40.534137 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc56c30a-4139-4740-ac21-2438e8e963e7 admin admin] PATH_INFO: `/v3/users` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:40.535298 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc56c30a-4139-4740-ac21-2438e8e963e7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:49:40.537894 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc56c30a-4139-4740-ac21-2438e8e963e7 admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:49:40.564286 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e5f5bb-63fd-4e9d-bd1d-3c98a965527e None None] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:40.564588 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e5f5bb-63fd-4e9d-bd1d-3c98a965527e None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:40.564857 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e5f5bb-63fd-4e9d-bd1d-3c98a965527e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:40.567240 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 916/1845] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 30 00:49:40 2022] POST /identity/v3/users => generated 290 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 00:49:40.570919 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc56c30a-4139-4740-ac21-2438e8e963e7 admin admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:49:40.583262 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc56c30a-4139-4740-ac21-2438e8e963e7 admin admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:49:40.586281 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.auth.core [None req-08e5f5bb-63fd-4e9d-bd1d-3c98a965527e None None] MFA Rules not processed for user `565269e8445b4eb1ab215a108f6e7d85`. Rule list: `[]` (Enabled: `True`). {{(pid=87956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:49:40.587730 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-08e5f5bb-63fd-4e9d-bd1d-3c98a965527e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:49:40.589130 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1da7ca-99b4-48e4-a6db-16851fe4cea2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:49:40.589862 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1da7ca-99b4-48e4-a6db-16851fe4cea2 admin admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:40.590168 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1da7ca-99b4-48e4-a6db-16851fe4cea2 admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:40.590549 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1da7ca-99b4-48e4-a6db-16851fe4cea2 admin admin] PATH_INFO: `/v3/roles` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:40.591338 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1da7ca-99b4-48e4-a6db-16851fe4cea2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:49:40.594682 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1da7ca-99b4-48e4-a6db-16851fe4cea2 admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:49:40.607843 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 917/1846] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 30 00:49:40 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 30 00:49:40.611779 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1da7ca-99b4-48e4-a6db-16851fe4cea2 admin admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:49:40.624248 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1da7ca-99b4-48e4-a6db-16851fe4cea2 admin admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:49:40.629633 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899acd95-a305-4f38-aaa1-b8a23b64c72b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:49:40.630418 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899acd95-a305-4f38-aaa1-b8a23b64c72b admin admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:40.630771 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899acd95-a305-4f38-aaa1-b8a23b64c72b admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:40.631144 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899acd95-a305-4f38-aaa1-b8a23b64c72b admin admin] PATH_INFO: `/v3/roles` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:40.632078 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899acd95-a305-4f38-aaa1-b8a23b64c72b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:49:40.634766 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899acd95-a305-4f38-aaa1-b8a23b64c72b admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:49:40.650461 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 918/1847] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 30 00:49:40 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 30 00:49:40.654693 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:49:40.655935 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899acd95-a305-4f38-aaa1-b8a23b64c72b admin admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:49:40.672517 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899acd95-a305-4f38-aaa1-b8a23b64c72b admin admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:49:40.676080 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 930/1848] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 30 00:49:40 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 30 00:49:40.677860 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fb273e-fe70-4dc1-aa43-1fd320f52fbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:49:40.680751 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fb273e-fe70-4dc1-aa43-1fd320f52fbc admin admin] REQUEST_METHOD: `PUT` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:40.680751 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fb273e-fe70-4dc1-aa43-1fd320f52fbc admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:40.680751 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fb273e-fe70-4dc1-aa43-1fd320f52fbc admin admin] PATH_INFO: `/v3/projects/54231c32ef7f4213bddb302a26923b36/users/2789a0839a6444aab638192da031871b/roles/1c93019874174c4b91118d9ce2347e47` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:40.687043 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e5f5bb-63fd-4e9d-bd1d-3c98a965527e None None] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:49:40.689512 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-08e5f5bb-63fd-4e9d-bd1d-3c98a965527e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:49:40.713342 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e5f5bb-63fd-4e9d-bd1d-3c98a965527e None None] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:49:40.723329 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52fb273e-fe70-4dc1-aa43-1fd320f52fbc admin admin] RBAC: Authorizing `identity:create_grant(project_id=54231c32ef7f4213bddb302a26923b36, user_id=2789a0839a6444aab638192da031871b, role_id=1c93019874174c4b91118d9ce2347e47)` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:49:40.726162 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52fb273e-fe70-4dc1-aa43-1fd320f52fbc admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:49:40.729225 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bd8a7b-5c07-4a23-ad4b-1639ab97b576 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:49:40.731716 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bd8a7b-5c07-4a23-ad4b-1639ab97b576 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:40.731716 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bd8a7b-5c07-4a23-ad4b-1639ab97b576 admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:40.731716 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bd8a7b-5c07-4a23-ad4b-1639ab97b576 admin admin] PATH_INFO: `/v3/projects/de4dc3f37f46470ca161f91e2690d462` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:40.731936 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8bd8a7b-5c07-4a23-ad4b-1639ab97b576 admin admin] RBAC: Authorizing `identity:delete_project(project_id=de4dc3f37f46470ca161f91e2690d462)` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:49:40.733800 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8bd8a7b-5c07-4a23-ad4b-1639ab97b576 admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:49:40.767272 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 919/1849] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 30 00:49:40 2022] PUT /identity/v3/projects/54231c32ef7f4213bddb302a26923b36/users/2789a0839a6444aab638192da031871b/roles/1c93019874174c4b91118d9ce2347e47 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 00:49:40.775606 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5acd11-c89c-4f87-8bd6-ec43e4e1bccf None None] REQUEST_METHOD: `POST` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:40.776522 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5acd11-c89c-4f87-8bd6-ec43e4e1bccf None None] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:40.779845 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5acd11-c89c-4f87-8bd6-ec43e4e1bccf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:40.802323 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-a8bd8a7b-5c07-4a23-ad4b-1639ab97b576 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'de4dc3f37f46470ca161f91e2690d462', 'request_id': 'req-a8bd8a7b-5c07-4a23-ad4b-1639ab97b576'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:49:40.815680 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-a8bd8a7b-5c07-4a23-ad4b-1639ab97b576 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'de4dc3f37f46470ca161f91e2690d462', 'request_id': 'req-a8bd8a7b-5c07-4a23-ad4b-1639ab97b576'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:49:40.816785 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.auth.core [None req-0f5acd11-c89c-4f87-8bd6-ec43e4e1bccf None None] MFA Rules not processed for user `2789a0839a6444aab638192da031871b`. Rule list: `[]` (Enabled: `True`). {{(pid=87955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:49:40.818082 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-0f5acd11-c89c-4f87-8bd6-ec43e4e1bccf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:49:40.825869 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-a8bd8a7b-5c07-4a23-ad4b-1639ab97b576 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'de4dc3f37f46470ca161f91e2690d462', 'request_id': 'req-a8bd8a7b-5c07-4a23-ad4b-1639ab97b576'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:49:40.845899 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-a8bd8a7b-5c07-4a23-ad4b-1639ab97b576 admin admin] The token cache is being invalidate because project de4dc3f37f46470ca161f91e2690d462 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87956) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 00:49:40.846222 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-a8bd8a7b-5c07-4a23-ad4b-1639ab97b576 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:49:40.847384 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-a8bd8a7b-5c07-4a23-ad4b-1639ab97b576 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:49:40.849389 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 931/1850] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 30 00:49:40 2022] DELETE /identity/v3/projects/de4dc3f37f46470ca161f91e2690d462 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 00:49:40.854492 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237eb4c2-4224-4b6c-9c7e-edc80378b25e None None] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:40.854769 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237eb4c2-4224-4b6c-9c7e-edc80378b25e None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:40.855037 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237eb4c2-4224-4b6c-9c7e-edc80378b25e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:40.878607 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.auth.core [None req-237eb4c2-4224-4b6c-9c7e-edc80378b25e None None] MFA Rules not processed for user `eb55b6cbca4945abb21b0e49eb745e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=87956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:49:40.879375 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-237eb4c2-4224-4b6c-9c7e-edc80378b25e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:49:40.908412 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 920/1851] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 30 00:49:40 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:49:40.918178 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5acd11-c89c-4f87-8bd6-ec43e4e1bccf None None] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:49:40.919994 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-0f5acd11-c89c-4f87-8bd6-ec43e4e1bccf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:49:40.939058 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:49:40.955412 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 932/1852] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 30 00:49:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:49:40.963178 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065e42d2-1166-48f3-b601-00d41f3212be None None] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:40.963860 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065e42d2-1166-48f3-b601-00d41f3212be None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:40.964309 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065e42d2-1166-48f3-b601-00d41f3212be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:40.988029 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.auth.core [None req-065e42d2-1166-48f3-b601-00d41f3212be None None] MFA Rules not processed for user `eb55b6cbca4945abb21b0e49eb745e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=87956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:49:40.989961 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-065e42d2-1166-48f3-b601-00d41f3212be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:49:41.000755 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 933/1853] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 30 00:49:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:49:41.004657 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065e42d2-1166-48f3-b601-00d41f3212be None None] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:49:41.016619 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065e42d2-1166-48f3-b601-00d41f3212be None None] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:49:41.035300 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cf4b8f-3d51-4e44-8b11-b7b02fc83ecc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:49:41.037524 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cf4b8f-3d51-4e44-8b11-b7b02fc83ecc admin admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:41.037860 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cf4b8f-3d51-4e44-8b11-b7b02fc83ecc admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:41.038153 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cf4b8f-3d51-4e44-8b11-b7b02fc83ecc admin admin] PATH_INFO: `/v3/domains` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:41.038817 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90cf4b8f-3d51-4e44-8b11-b7b02fc83ecc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87956) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:49:41.039117 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90cf4b8f-3d51-4e44-8b11-b7b02fc83ecc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:49:41.040482 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5acd11-c89c-4f87-8bd6-ec43e4e1bccf None None] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:49:41.045219 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90cf4b8f-3d51-4e44-8b11-b7b02fc83ecc admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:49:41.046335 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a0ea1a-54e8-4401-ae62-c6699d468622 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:49:41.046952 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a0ea1a-54e8-4401-ae62-c6699d468622 admin admin] REQUEST_METHOD: `POST` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:41.047310 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a0ea1a-54e8-4401-ae62-c6699d468622 admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:41.047585 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a0ea1a-54e8-4401-ae62-c6699d468622 admin admin] PATH_INFO: `/v3/projects` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:41.054730 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a0ea1a-54e8-4401-ae62-c6699d468622 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:49:41.056978 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a0ea1a-54e8-4401-ae62-c6699d468622 admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:49:41.069379 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 934/1854] 10.222.0.42 () {58 vars in 1153 bytes} [Sun Oct 30 00:49:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:49:41.075399 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cf4b8f-3d51-4e44-8b11-b7b02fc83ecc admin admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:49:41.098037 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cf4b8f-3d51-4e44-8b11-b7b02fc83ecc admin admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:49:41.109325 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11555c39-17e5-48a2-aa72-9afc1f67be93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:49:41.111886 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11555c39-17e5-48a2-aa72-9afc1f67be93 admin admin] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:41.112071 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11555c39-17e5-48a2-aa72-9afc1f67be93 admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:41.112344 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11555c39-17e5-48a2-aa72-9afc1f67be93 admin admin] PATH_INFO: `/v3/projects` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:41.114584 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11555c39-17e5-48a2-aa72-9afc1f67be93 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:49:41.116971 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11555c39-17e5-48a2-aa72-9afc1f67be93 admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:49:41.124035 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 921/1855] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 30 00:49:40 2022] POST /identity/v3/projects => generated 377 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 00:49:41.125824 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a0ea1a-54e8-4401-ae62-c6699d468622 admin admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:49:41.154428 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 935/1856] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 30 00:49:41 2022] POST /identity/v3/projects => generated 365 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 00:49:41.158375 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11555c39-17e5-48a2-aa72-9afc1f67be93 admin admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:49:41.208196 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:49:41.209399 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a0ea1a-54e8-4401-ae62-c6699d468622 admin admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:49:41.235376 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11555c39-17e5-48a2-aa72-9afc1f67be93 admin admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:49:41.240833 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a929a1c6-db0e-466c-9a38-02c74cf6bde6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:49:41.241471 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a929a1c6-db0e-466c-9a38-02c74cf6bde6 admin admin] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:41.241743 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a929a1c6-db0e-466c-9a38-02c74cf6bde6 admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:41.242389 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a929a1c6-db0e-466c-9a38-02c74cf6bde6 admin admin] PATH_INFO: `/v3/users` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:41.242626 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a929a1c6-db0e-466c-9a38-02c74cf6bde6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:49:41.245054 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a929a1c6-db0e-466c-9a38-02c74cf6bde6 admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:49:41.271423 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 936/1857] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 30 00:49:41 2022] POST /identity/v3/users => generated 283 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 30 00:49:41.275467 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a929a1c6-db0e-466c-9a38-02c74cf6bde6 admin admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:49:41.278947 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbaeaf46-836a-4b84-a585-5cb0f1b92773 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:49:41.279866 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbaeaf46-836a-4b84-a585-5cb0f1b92773 admin admin] REQUEST_METHOD: `POST` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:41.280142 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbaeaf46-836a-4b84-a585-5cb0f1b92773 admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:41.280408 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbaeaf46-836a-4b84-a585-5cb0f1b92773 admin admin] PATH_INFO: `/v3/users` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:41.281036 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbaeaf46-836a-4b84-a585-5cb0f1b92773 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:49:41.282977 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbaeaf46-836a-4b84-a585-5cb0f1b92773 admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:49:41.286359 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a929a1c6-db0e-466c-9a38-02c74cf6bde6 admin admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:49:41.296142 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175af2b1-1a39-45af-8ec1-479638a16c8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:49:41.297221 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175af2b1-1a39-45af-8ec1-479638a16c8d admin admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:41.297580 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175af2b1-1a39-45af-8ec1-479638a16c8d admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:41.297871 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175af2b1-1a39-45af-8ec1-479638a16c8d admin admin] PATH_INFO: `/v3/roles` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:41.298610 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175af2b1-1a39-45af-8ec1-479638a16c8d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:49:41.300565 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175af2b1-1a39-45af-8ec1-479638a16c8d admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:49:41.313917 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 922/1858] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 30 00:49:41 2022] POST /identity/v3/users => generated 295 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 00:49:41.314116 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 937/1859] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 30 00:49:41 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 00:49:41.317867 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175af2b1-1a39-45af-8ec1-479638a16c8d admin admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:49:41.318296 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbaeaf46-836a-4b84-a585-5cb0f1b92773 admin admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:49:41.331861 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175af2b1-1a39-45af-8ec1-479638a16c8d admin admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:49:41.334108 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbaeaf46-836a-4b84-a585-5cb0f1b92773 admin admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:49:41.336992 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ac063b-dbd8-41b2-992e-5c7abeb313db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:49:41.337920 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ac063b-dbd8-41b2-992e-5c7abeb313db admin admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:41.338384 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ac063b-dbd8-41b2-992e-5c7abeb313db admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:41.338718 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ac063b-dbd8-41b2-992e-5c7abeb313db admin admin] PATH_INFO: `/v3/roles` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:41.339465 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ac063b-dbd8-41b2-992e-5c7abeb313db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:49:41.339719 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41163df6-8154-4382-b0e0-54cbf88ac89a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:49:41.340395 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41163df6-8154-4382-b0e0-54cbf88ac89a admin admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:41.340734 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41163df6-8154-4382-b0e0-54cbf88ac89a admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:41.341106 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41163df6-8154-4382-b0e0-54cbf88ac89a admin admin] PATH_INFO: `/v3/roles` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:41.341389 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ac063b-dbd8-41b2-992e-5c7abeb313db admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:49:41.341987 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41163df6-8154-4382-b0e0-54cbf88ac89a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:49:41.344481 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41163df6-8154-4382-b0e0-54cbf88ac89a admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:49:41.358185 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 938/1860] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 30 00:49:41 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 00:49:41.358377 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 923/1861] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 30 00:49:41 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 00:49:41.359582 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ac063b-dbd8-41b2-992e-5c7abeb313db admin admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:49:41.360885 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41163df6-8154-4382-b0e0-54cbf88ac89a admin admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:49:41.370910 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ac063b-dbd8-41b2-992e-5c7abeb313db admin admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:49:41.371900 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41163df6-8154-4382-b0e0-54cbf88ac89a admin admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:49:41.375991 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846a3090-4ca7-47b3-9470-8ea34ded008b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:49:41.376998 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846a3090-4ca7-47b3-9470-8ea34ded008b admin admin] REQUEST_METHOD: `PUT` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:41.377280 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79df2f5f-4b91-4f11-9b54-64cbf5a26c3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:49:41.377626 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846a3090-4ca7-47b3-9470-8ea34ded008b admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:41.378093 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846a3090-4ca7-47b3-9470-8ea34ded008b admin admin] PATH_INFO: `/v3/projects/83de59188f2e4332b478b1ea42b48ff2/users/a65229b09d664bb983f70d0273061c1c/roles/1c93019874174c4b91118d9ce2347e47` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:41.378204 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79df2f5f-4b91-4f11-9b54-64cbf5a26c3d admin admin] REQUEST_METHOD: `PUT` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:41.378501 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79df2f5f-4b91-4f11-9b54-64cbf5a26c3d admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:41.378843 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79df2f5f-4b91-4f11-9b54-64cbf5a26c3d admin admin] PATH_INFO: `/v3/projects/729b539f57524b44b77ac43d8d1a88d0/users/32c9566e57e94c7da4fd27982499b48c/roles/6ccaa8c11f29456fb4e4eeccb21616c7` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:41.394987 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846a3090-4ca7-47b3-9470-8ea34ded008b admin admin] RBAC: Authorizing `identity:create_grant(project_id=83de59188f2e4332b478b1ea42b48ff2, user_id=a65229b09d664bb983f70d0273061c1c, role_id=1c93019874174c4b91118d9ce2347e47)` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:49:41.398206 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846a3090-4ca7-47b3-9470-8ea34ded008b admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:49:41.411923 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79df2f5f-4b91-4f11-9b54-64cbf5a26c3d admin admin] RBAC: Authorizing `identity:create_grant(project_id=729b539f57524b44b77ac43d8d1a88d0, user_id=32c9566e57e94c7da4fd27982499b48c, role_id=6ccaa8c11f29456fb4e4eeccb21616c7)` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:49:41.415447 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79df2f5f-4b91-4f11-9b54-64cbf5a26c3d admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:49:41.419843 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:49:41.420739 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 939/1862] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 30 00:49:41 2022] PUT /identity/v3/projects/83de59188f2e4332b478b1ea42b48ff2/users/a65229b09d664bb983f70d0273061c1c/roles/1c93019874174c4b91118d9ce2347e47 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 00:49:41.437561 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5615742e-5841-4852-b159-75d659ace5ce None None] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:41.438113 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5615742e-5841-4852-b159-75d659ace5ce None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:41.438468 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5615742e-5841-4852-b159-75d659ace5ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:41.450993 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 924/1863] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 30 00:49:41 2022] PUT /identity/v3/projects/729b539f57524b44b77ac43d8d1a88d0/users/32c9566e57e94c7da4fd27982499b48c/roles/6ccaa8c11f29456fb4e4eeccb21616c7 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 00:49:41.455078 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79df2f5f-4b91-4f11-9b54-64cbf5a26c3d admin admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:49:41.478100 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.auth.core [None req-5615742e-5841-4852-b159-75d659ace5ce None None] MFA Rules not processed for user `a65229b09d664bb983f70d0273061c1c`. Rule list: `[]` (Enabled: `True`). {{(pid=87956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:49:41.481145 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-5615742e-5841-4852-b159-75d659ace5ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:49:41.547479 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79df2f5f-4b91-4f11-9b54-64cbf5a26c3d admin admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:49:41.557146 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0794ba-e489-41e3-b733-f2ccf5a4f5b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:49:41.557764 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0794ba-e489-41e3-b733-f2ccf5a4f5b0 admin admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:41.558036 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0794ba-e489-41e3-b733-f2ccf5a4f5b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:41.558305 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0794ba-e489-41e3-b733-f2ccf5a4f5b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:41.558958 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0794ba-e489-41e3-b733-f2ccf5a4f5b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:49:41.560575 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0794ba-e489-41e3-b733-f2ccf5a4f5b0 admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:49:41.603282 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 925/1864] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 30 00:49:41 2022] GET /identity/v3/roles => generated 1420 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 30 00:49:41.608428 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 940/1865] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 30 00:49:41 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 30 00:49:41.609988 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5615742e-5841-4852-b159-75d659ace5ce None None] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:49:41.611162 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0794ba-e489-41e3-b733-f2ccf5a4f5b0 admin admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:49:41.623609 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0794ba-e489-41e3-b733-f2ccf5a4f5b0 admin admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:49:41.625236 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5615742e-5841-4852-b159-75d659ace5ce None None] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:49:41.630079 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3bcee5-3eb0-40b6-8820-176f5c2f6c89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:49:41.630474 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb29985-c45e-4f9e-86b2-2c3831e9a75a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:49:41.630935 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3bcee5-3eb0-40b6-8820-176f5c2f6c89 admin admin] REQUEST_METHOD: `PUT` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:41.631088 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb29985-c45e-4f9e-86b2-2c3831e9a75a admin admin] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:41.631396 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb29985-c45e-4f9e-86b2-2c3831e9a75a admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:41.631502 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3bcee5-3eb0-40b6-8820-176f5c2f6c89 admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:41.631706 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb29985-c45e-4f9e-86b2-2c3831e9a75a admin admin] PATH_INFO: `/v3/projects` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:41.632094 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3bcee5-3eb0-40b6-8820-176f5c2f6c89 admin admin] PATH_INFO: `/v3/projects/729b539f57524b44b77ac43d8d1a88d0/users/32c9566e57e94c7da4fd27982499b48c/roles/6ccaa8c11f29456fb4e4eeccb21616c7` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:41.632499 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb29985-c45e-4f9e-86b2-2c3831e9a75a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:49:41.634703 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3bcee5-3eb0-40b6-8820-176f5c2f6c89 admin admin] RBAC: Authorizing `identity:create_grant(project_id=729b539f57524b44b77ac43d8d1a88d0, user_id=32c9566e57e94c7da4fd27982499b48c, role_id=6ccaa8c11f29456fb4e4eeccb21616c7)` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:49:41.635776 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb29985-c45e-4f9e-86b2-2c3831e9a75a admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:49:41.638592 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3bcee5-3eb0-40b6-8820-176f5c2f6c89 admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:49:41.656660 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 926/1866] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 30 00:49:41 2022] PUT /identity/v3/projects/729b539f57524b44b77ac43d8d1a88d0/users/32c9566e57e94c7da4fd27982499b48c/roles/6ccaa8c11f29456fb4e4eeccb21616c7 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 00:49:41.669565 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497fa182-364e-4191-9bac-73f5f0facbd2 None None] REQUEST_METHOD: `POST` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:41.669857 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497fa182-364e-4191-9bac-73f5f0facbd2 None None] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:41.670130 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497fa182-364e-4191-9bac-73f5f0facbd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:41.675594 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 941/1867] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 30 00:49:41 2022] POST /identity/v3/projects => generated 363 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 00:49:41.679614 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb29985-c45e-4f9e-86b2-2c3831e9a75a admin admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:49:41.714597 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.auth.core [None req-497fa182-364e-4191-9bac-73f5f0facbd2 None None] MFA Rules not processed for user `32c9566e57e94c7da4fd27982499b48c`. Rule list: `[]` (Enabled: `True`). {{(pid=87955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:49:41.717654 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-497fa182-364e-4191-9bac-73f5f0facbd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:49:41.736835 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:49:41.753615 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb29985-c45e-4f9e-86b2-2c3831e9a75a admin admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:49:41.758279 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425e3b9f-78fe-46d0-8633-15f8f64088d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:49:41.758886 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425e3b9f-78fe-46d0-8633-15f8f64088d2 admin admin] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:41.759313 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425e3b9f-78fe-46d0-8633-15f8f64088d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:41.759589 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425e3b9f-78fe-46d0-8633-15f8f64088d2 admin admin] PATH_INFO: `/v3/users` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:41.760370 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425e3b9f-78fe-46d0-8633-15f8f64088d2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:49:41.762273 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425e3b9f-78fe-46d0-8633-15f8f64088d2 admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:49:41.788637 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 942/1868] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 30 00:49:41 2022] POST /identity/v3/users => generated 288 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 30 00:49:41.792330 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425e3b9f-78fe-46d0-8633-15f8f64088d2 admin admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:49:41.803324 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425e3b9f-78fe-46d0-8633-15f8f64088d2 admin admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:49:41.807266 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 927/1869] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 30 00:49:41 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 30 00:49:41.808825 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517ee6c7-5ed8-436d-9c64-516b48fce67e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:49:41.809306 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517ee6c7-5ed8-436d-9c64-516b48fce67e admin admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:41.810013 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517ee6c7-5ed8-436d-9c64-516b48fce67e admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:41.810291 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517ee6c7-5ed8-436d-9c64-516b48fce67e admin admin] PATH_INFO: `/v3/roles` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:41.811094 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517ee6c7-5ed8-436d-9c64-516b48fce67e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:49:41.812743 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517ee6c7-5ed8-436d-9c64-516b48fce67e admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:49:41.820454 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497fa182-364e-4191-9bac-73f5f0facbd2 None None] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:49:41.822437 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-497fa182-364e-4191-9bac-73f5f0facbd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:49:41.824424 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 943/1870] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 30 00:49:41 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 30 00:49:41.828403 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517ee6c7-5ed8-436d-9c64-516b48fce67e admin admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:49:41.839542 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517ee6c7-5ed8-436d-9c64-516b48fce67e admin admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:49:41.846165 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a623a0-09cc-4425-9d4b-3e763189e265 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:49:41.847026 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a623a0-09cc-4425-9d4b-3e763189e265 admin admin] REQUEST_METHOD: `PUT` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:41.847374 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a623a0-09cc-4425-9d4b-3e763189e265 admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:41.847729 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a623a0-09cc-4425-9d4b-3e763189e265 admin admin] PATH_INFO: `/v3/projects/5a4e5812460b49bb8aa6b32a0bef78e5/users/78e700fbf0a04137bdd2e6a51379f41a/roles/6ccaa8c11f29456fb4e4eeccb21616c7` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:41.868011 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a623a0-09cc-4425-9d4b-3e763189e265 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a4e5812460b49bb8aa6b32a0bef78e5, user_id=78e700fbf0a04137bdd2e6a51379f41a, role_id=6ccaa8c11f29456fb4e4eeccb21616c7)` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:49:41.871142 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a623a0-09cc-4425-9d4b-3e763189e265 admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:49:41.886655 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 944/1871] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 30 00:49:41 2022] PUT /identity/v3/projects/5a4e5812460b49bb8aa6b32a0bef78e5/users/78e700fbf0a04137bdd2e6a51379f41a/roles/6ccaa8c11f29456fb4e4eeccb21616c7 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 00:49:41.888381 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497fa182-364e-4191-9bac-73f5f0facbd2 None None] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:49:41.890680 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a623a0-09cc-4425-9d4b-3e763189e265 admin admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:49:41.906185 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:49:41.946205 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23644b4a-576d-4acb-bd54-587482815d74 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48d928ff7fe24348ac900f09c56acc20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d2387fdf794d4eaef07bbcd7b39f2a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:49:41.947232 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23644b4a-576d-4acb-bd54-587482815d74 service cinder] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:41.947539 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23644b4a-576d-4acb-bd54-587482815d74 service cinder] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:41.947849 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23644b4a-576d-4acb-bd54-587482815d74 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:41.964822 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a623a0-09cc-4425-9d4b-3e763189e265 admin admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:49:41.970256 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada2e5e7-f948-45b1-9dbf-f0d280b4339d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:49:41.970894 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada2e5e7-f948-45b1-9dbf-f0d280b4339d admin admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:41.971181 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada2e5e7-f948-45b1-9dbf-f0d280b4339d admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:41.971480 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada2e5e7-f948-45b1-9dbf-f0d280b4339d admin admin] PATH_INFO: `/v3/roles` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:41.972131 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada2e5e7-f948-45b1-9dbf-f0d280b4339d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:49:41.973790 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada2e5e7-f948-45b1-9dbf-f0d280b4339d admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:49:41.984621 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 945/1872] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 30 00:49:41 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 00:49:41.988520 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada2e5e7-f948-45b1-9dbf-f0d280b4339d admin admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:49:41.998211 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada2e5e7-f948-45b1-9dbf-f0d280b4339d admin admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:49:42.002774 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612beb83-7f09-483a-9ab9-22bd2e4e730c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:49:42.003438 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612beb83-7f09-483a-9ab9-22bd2e4e730c admin admin] REQUEST_METHOD: `PUT` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:42.003713 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612beb83-7f09-483a-9ab9-22bd2e4e730c admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:42.003985 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612beb83-7f09-483a-9ab9-22bd2e4e730c admin admin] PATH_INFO: `/v3/projects/5a4e5812460b49bb8aa6b32a0bef78e5/users/78e700fbf0a04137bdd2e6a51379f41a/roles/6ccaa8c11f29456fb4e4eeccb21616c7` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:42.005900 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612beb83-7f09-483a-9ab9-22bd2e4e730c admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a4e5812460b49bb8aa6b32a0bef78e5, user_id=78e700fbf0a04137bdd2e6a51379f41a, role_id=6ccaa8c11f29456fb4e4eeccb21616c7)` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:49:42.008533 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612beb83-7f09-483a-9ab9-22bd2e4e730c admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:49:42.010221 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23644b4a-576d-4acb-bd54-587482815d74 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:49:42.011705 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23644b4a-576d-4acb-bd54-587482815d74 service cinder] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:49:42.019182 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 946/1873] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 30 00:49:41 2022] PUT /identity/v3/projects/5a4e5812460b49bb8aa6b32a0bef78e5/users/78e700fbf0a04137bdd2e6a51379f41a/roles/6ccaa8c11f29456fb4e4eeccb21616c7 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 00:49:42.020957 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 928/1874] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 30 00:49:41 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 30 00:49:42.029701 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d576110d-dc5e-4213-a13b-b41b55ef4d09 None None] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:42.030023 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d576110d-dc5e-4213-a13b-b41b55ef4d09 None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:42.030395 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d576110d-dc5e-4213-a13b-b41b55ef4d09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:42.061927 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.auth.core [None req-d576110d-dc5e-4213-a13b-b41b55ef4d09 None None] MFA Rules not processed for user `78e700fbf0a04137bdd2e6a51379f41a`. Rule list: `[]` (Enabled: `True`). {{(pid=87956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:49:42.063280 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-d576110d-dc5e-4213-a13b-b41b55ef4d09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:49:42.146945 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 947/1875] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 30 00:49:42 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 30 00:49:42.173026 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23644b4a-576d-4acb-bd54-587482815d74 service cinder] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:49:42.174576 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-23644b4a-576d-4acb-bd54-587482815d74 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:49:42.187194 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23644b4a-576d-4acb-bd54-587482815d74 service cinder] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:49:42.252502 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0e8a23-f573-49d2-b997-be5948306c89 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48d928ff7fe24348ac900f09c56acc20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d2387fdf794d4eaef07bbcd7b39f2a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:49:42.254462 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0e8a23-f573-49d2-b997-be5948306c89 service cinder] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:42.254462 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0e8a23-f573-49d2-b997-be5948306c89 service cinder] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:42.254462 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0e8a23-f573-49d2-b997-be5948306c89 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:42.271903 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0e8a23-f573-49d2-b997-be5948306c89 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:49:42.273460 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0e8a23-f573-49d2-b997-be5948306c89 service cinder] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:49:42.285167 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 929/1876] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 30 00:49:42 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 00:49:42.500384 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d576110d-dc5e-4213-a13b-b41b55ef4d09 None None] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:49:42.512134 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d576110d-dc5e-4213-a13b-b41b55ef4d09 None None] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:49:42.520680 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753a2871-c0d1-4c5e-ad76-4d51b9b62c03 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48d928ff7fe24348ac900f09c56acc20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d2387fdf794d4eaef07bbcd7b39f2a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:49:42.521312 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753a2871-c0d1-4c5e-ad76-4d51b9b62c03 service cinder] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:42.521674 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753a2871-c0d1-4c5e-ad76-4d51b9b62c03 service cinder] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:42.521842 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753a2871-c0d1-4c5e-ad76-4d51b9b62c03 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:42.529346 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:49:42.614512 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753a2871-c0d1-4c5e-ad76-4d51b9b62c03 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:49:42.618907 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753a2871-c0d1-4c5e-ad76-4d51b9b62c03 service cinder] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:49:42.661226 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 948/1877] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 30 00:49:42 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 00:49:43.568141 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0e8a23-f573-49d2-b997-be5948306c89 service cinder] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:49:43.578411 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0e8a23-f573-49d2-b997-be5948306c89 service cinder] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:49:43.582232 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c08851-9a62-424b-9902-01453f31240a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48d928ff7fe24348ac900f09c56acc20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d2387fdf794d4eaef07bbcd7b39f2a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:49:43.582831 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c08851-9a62-424b-9902-01453f31240a service cinder] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:43.583102 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c08851-9a62-424b-9902-01453f31240a service cinder] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:43.583401 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c08851-9a62-424b-9902-01453f31240a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:43.655881 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c08851-9a62-424b-9902-01453f31240a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:49:43.657329 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c08851-9a62-424b-9902-01453f31240a service cinder] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:49:43.671295 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 930/1878] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 30 00:49:43 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 30 00:49:45.466550 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f76852-283a-45b7-b068-39453881d1ea None None] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:45.467034 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f76852-283a-45b7-b068-39453881d1ea None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:45.469794 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f76852-283a-45b7-b068-39453881d1ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:45.492914 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.auth.core [None req-53f76852-283a-45b7-b068-39453881d1ea None None] MFA Rules not processed for user `3e7b21b55fb84a6cad507a8954492d48`. Rule list: `[]` (Enabled: `True`). {{(pid=87956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:49:45.494161 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-53f76852-283a-45b7-b068-39453881d1ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:49:45.555443 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 949/1879] 10.222.0.42 () {58 vars in 1009 bytes} [Sun Oct 30 00:49:45 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:49:45.596822 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c08851-9a62-424b-9902-01453f31240a service cinder] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:49:45.598237 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-04c08851-9a62-424b-9902-01453f31240a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:49:45.612309 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=100 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:49:45.673610 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c08851-9a62-424b-9902-01453f31240a service cinder] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:49:45.679809 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724980d9-401f-4e51-b7d5-e2fd72ac9826 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6d6e884a8104a428e4de6be1cfa467c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d2387fdf794d4eaef07bbcd7b39f2a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:49:45.680425 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724980d9-401f-4e51-b7d5-e2fd72ac9826 service swift] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:45.680700 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724980d9-401f-4e51-b7d5-e2fd72ac9826 service swift] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:45.680967 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724980d9-401f-4e51-b7d5-e2fd72ac9826 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:45.689405 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724980d9-401f-4e51-b7d5-e2fd72ac9826 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:49:45.691174 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724980d9-401f-4e51-b7d5-e2fd72ac9826 service swift] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:49:45.700351 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 931/1880] 10.222.0.42 () {60 vars in 1384 bytes} [Sun Oct 30 00:49:45 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 30 00:49:46.287932 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46242929-1403-464d-a49b-66dfa123ebef None None] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:46.288291 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46242929-1403-464d-a49b-66dfa123ebef None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:46.288564 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46242929-1403-464d-a49b-66dfa123ebef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:46.311171 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.auth.core [None req-46242929-1403-464d-a49b-66dfa123ebef None None] MFA Rules not processed for user `3e7b21b55fb84a6cad507a8954492d48`. Rule list: `[]` (Enabled: `True`). {{(pid=87956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:49:46.312420 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-46242929-1403-464d-a49b-66dfa123ebef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:49:46.321191 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 950/1881] 10.222.0.42 () {58 vars in 967 bytes} [Sun Oct 30 00:49:46 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:49:46.335133 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724980d9-401f-4e51-b7d5-e2fd72ac9826 service swift] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:49:46.346243 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724980d9-401f-4e51-b7d5-e2fd72ac9826 service swift] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:49:46.354171 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f711432-da9e-4008-a5ae-1ec36d3ba5ae service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6d6e884a8104a428e4de6be1cfa467c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d2387fdf794d4eaef07bbcd7b39f2a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:49:46.355325 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f711432-da9e-4008-a5ae-1ec36d3ba5ae service swift] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:46.355700 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f711432-da9e-4008-a5ae-1ec36d3ba5ae service swift] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:46.356008 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f711432-da9e-4008-a5ae-1ec36d3ba5ae service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:46.365475 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f711432-da9e-4008-a5ae-1ec36d3ba5ae service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:49:46.367076 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f711432-da9e-4008-a5ae-1ec36d3ba5ae service swift] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:49:46.377196 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 932/1882] 10.222.0.42 () {60 vars in 1384 bytes} [Sun Oct 30 00:49:46 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 30 00:49:46.745450 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ae32ab-7b27-4e1a-8138-2774fb0e8e13 None None] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:46.745941 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ae32ab-7b27-4e1a-8138-2774fb0e8e13 None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:46.746029 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ae32ab-7b27-4e1a-8138-2774fb0e8e13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:46.768033 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.auth.core [None req-79ae32ab-7b27-4e1a-8138-2774fb0e8e13 None None] MFA Rules not processed for user `3e7b21b55fb84a6cad507a8954492d48`. Rule list: `[]` (Enabled: `True`). {{(pid=87956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:49:46.769289 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-79ae32ab-7b27-4e1a-8138-2774fb0e8e13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:49:46.778858 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 951/1883] 10.222.0.42 () {58 vars in 1009 bytes} [Sun Oct 30 00:49:46 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:49:46.791080 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f711432-da9e-4008-a5ae-1ec36d3ba5ae service swift] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:49:46.802817 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f711432-da9e-4008-a5ae-1ec36d3ba5ae service swift] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:49:46.808185 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0057eb8d-d766-4b18-a431-8bd73e6e3689 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6d6e884a8104a428e4de6be1cfa467c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d2387fdf794d4eaef07bbcd7b39f2a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:49:46.808792 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0057eb8d-d766-4b18-a431-8bd73e6e3689 service swift] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:46.809337 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0057eb8d-d766-4b18-a431-8bd73e6e3689 service swift] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:46.809583 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0057eb8d-d766-4b18-a431-8bd73e6e3689 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:46.818256 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0057eb8d-d766-4b18-a431-8bd73e6e3689 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:49:46.819892 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0057eb8d-d766-4b18-a431-8bd73e6e3689 service swift] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:49:46.828473 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 933/1884] 10.222.0.42 () {60 vars in 1384 bytes} [Sun Oct 30 00:49:46 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 30 00:49:47.164608 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f379f2-12d7-444f-9ef3-afd848f5f51c None None] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:47.164912 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f379f2-12d7-444f-9ef3-afd848f5f51c None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:47.165186 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f379f2-12d7-444f-9ef3-afd848f5f51c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:47.184748 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.auth.core [None req-b7f379f2-12d7-444f-9ef3-afd848f5f51c None None] MFA Rules not processed for user `3e7b21b55fb84a6cad507a8954492d48`. Rule list: `[]` (Enabled: `True`). {{(pid=87956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:49:47.185979 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-b7f379f2-12d7-444f-9ef3-afd848f5f51c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:49:47.194318 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 952/1885] 10.222.0.42 () {58 vars in 967 bytes} [Sun Oct 30 00:49:47 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:49:47.210998 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0057eb8d-d766-4b18-a431-8bd73e6e3689 service swift] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:49:47.233431 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0057eb8d-d766-4b18-a431-8bd73e6e3689 service swift] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:49:47.238425 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce191fb-8ee3-46a3-b1d4-92bc64819694 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6d6e884a8104a428e4de6be1cfa467c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d2387fdf794d4eaef07bbcd7b39f2a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:49:47.239586 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce191fb-8ee3-46a3-b1d4-92bc64819694 service swift] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:47.239586 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce191fb-8ee3-46a3-b1d4-92bc64819694 service swift] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:47.239586 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce191fb-8ee3-46a3-b1d4-92bc64819694 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:47.250707 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce191fb-8ee3-46a3-b1d4-92bc64819694 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:49:47.252554 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce191fb-8ee3-46a3-b1d4-92bc64819694 service swift] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:49:47.262879 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 934/1886] 10.222.0.42 () {60 vars in 1384 bytes} [Sun Oct 30 00:49:47 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 30 00:49:47.686866 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f379f2-12d7-444f-9ef3-afd848f5f51c None None] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:49:47.792561 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f379f2-12d7-444f-9ef3-afd848f5f51c None None] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:49:47.799505 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427bf0a4-e77f-4bfb-bc73-f7eed2afa48f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:49:47.800201 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427bf0a4-e77f-4bfb-bc73-f7eed2afa48f admin admin] REQUEST_METHOD: `DELETE` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:47.800472 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427bf0a4-e77f-4bfb-bc73-f7eed2afa48f admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:47.800918 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427bf0a4-e77f-4bfb-bc73-f7eed2afa48f admin admin] PATH_INFO: `/v3/users/2789a0839a6444aab638192da031871b` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:47.802330 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427bf0a4-e77f-4bfb-bc73-f7eed2afa48f admin admin] RBAC: Authorizing `identity:delete_user(user_id=2789a0839a6444aab638192da031871b)` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:49:47.811170 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427bf0a4-e77f-4bfb-bc73-f7eed2afa48f admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:49:47.874920 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:49:47.885153 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-427bf0a4-e77f-4bfb-bc73-f7eed2afa48f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2789a0839a6444aab638192da031871b'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:49:47.886116 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-427bf0a4-e77f-4bfb-bc73-f7eed2afa48f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2789a0839a6444aab638192da031871b'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:49:47.900653 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-427bf0a4-e77f-4bfb-bc73-f7eed2afa48f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2789a0839a6444aab638192da031871b'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:49:47.935273 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-427bf0a4-e77f-4bfb-bc73-f7eed2afa48f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2789a0839a6444aab638192da031871b'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:49:47.944577 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-427bf0a4-e77f-4bfb-bc73-f7eed2afa48f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2789a0839a6444aab638192da031871b'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:49:47.958227 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b2fc99-81bb-449b-8972-a887034eb801 None None] REQUEST_METHOD: `POST` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:47.958776 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b2fc99-81bb-449b-8972-a887034eb801 None None] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:47.958859 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b2fc99-81bb-449b-8972-a887034eb801 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:47.962287 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 953/1887] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 30 00:49:47 2022] DELETE /identity/v3/users/2789a0839a6444aab638192da031871b => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 00:49:47.984553 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.auth.core [None req-73b2fc99-81bb-449b-8972-a887034eb801 None None] MFA Rules not processed for user `eb55b6cbca4945abb21b0e49eb745e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=87955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:49:47.986917 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-73b2fc99-81bb-449b-8972-a887034eb801 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:49:48.099377 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 935/1888] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 30 00:49:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:49:48.111962 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427bf0a4-e77f-4bfb-bc73-f7eed2afa48f admin admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:49:48.113847 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-427bf0a4-e77f-4bfb-bc73-f7eed2afa48f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:49:48.237812 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427bf0a4-e77f-4bfb-bc73-f7eed2afa48f admin admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:49:48.245931 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58b3c5f-deff-4079-8de9-5c9cf409ec1c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5693f186c6ad4d9394f02ee3477cdcd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d2387fdf794d4eaef07bbcd7b39f2a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:49:48.246586 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58b3c5f-deff-4079-8de9-5c9cf409ec1c service neutron] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:48.246857 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58b3c5f-deff-4079-8de9-5c9cf409ec1c service neutron] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:48.247313 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58b3c5f-deff-4079-8de9-5c9cf409ec1c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:48.258798 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58b3c5f-deff-4079-8de9-5c9cf409ec1c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:49:48.260502 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58b3c5f-deff-4079-8de9-5c9cf409ec1c service neutron] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:49:48.274019 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 954/1889] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 30 00:49:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 00:49:48.630752 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b2fc99-81bb-449b-8972-a887034eb801 None None] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:49:48.632529 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-73b2fc99-81bb-449b-8972-a887034eb801 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:49:48.659942 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b2fc99-81bb-449b-8972-a887034eb801 None None] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:49:48.664990 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ef64c6-51d2-4661-8c39-71ecadadf149 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:49:48.665941 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ef64c6-51d2-4661-8c39-71ecadadf149 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:48.666370 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ef64c6-51d2-4661-8c39-71ecadadf149 admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:48.666780 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ef64c6-51d2-4661-8c39-71ecadadf149 admin admin] PATH_INFO: `/v3/projects/54231c32ef7f4213bddb302a26923b36` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:48.668442 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ef64c6-51d2-4661-8c39-71ecadadf149 admin admin] RBAC: Authorizing `identity:delete_project(project_id=54231c32ef7f4213bddb302a26923b36)` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:49:48.670977 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ef64c6-51d2-4661-8c39-71ecadadf149 admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:49:48.744812 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-28ef64c6-51d2-4661-8c39-71ecadadf149 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '54231c32ef7f4213bddb302a26923b36', 'request_id': 'req-28ef64c6-51d2-4661-8c39-71ecadadf149'} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:49:48.750944 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:49:48.752681 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-28ef64c6-51d2-4661-8c39-71ecadadf149 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '54231c32ef7f4213bddb302a26923b36', 'request_id': 'req-28ef64c6-51d2-4661-8c39-71ecadadf149'} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:49:48.762566 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-28ef64c6-51d2-4661-8c39-71ecadadf149 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '54231c32ef7f4213bddb302a26923b36', 'request_id': 'req-28ef64c6-51d2-4661-8c39-71ecadadf149'} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:49:48.782907 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-28ef64c6-51d2-4661-8c39-71ecadadf149 admin admin] The token cache is being invalidate because project 54231c32ef7f4213bddb302a26923b36 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87955) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 00:49:48.783252 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-28ef64c6-51d2-4661-8c39-71ecadadf149 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:49:48.783865 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-28ef64c6-51d2-4661-8c39-71ecadadf149 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:49:48.785378 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 936/1890] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 30 00:49:48 2022] DELETE /identity/v3/projects/54231c32ef7f4213bddb302a26923b36 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 00:49:48.789950 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58b3c5f-deff-4079-8de9-5c9cf409ec1c service neutron] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:49:48.801759 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58b3c5f-deff-4079-8de9-5c9cf409ec1c service neutron] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:49:48.866839 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23b8a32-f9d4-4b38-82fc-004278a55fa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:49:48.867549 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23b8a32-f9d4-4b38-82fc-004278a55fa9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:48.867945 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23b8a32-f9d4-4b38-82fc-004278a55fa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:48.868253 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23b8a32-f9d4-4b38-82fc-004278a55fa9 admin admin] PATH_INFO: `/v3/users/32c9566e57e94c7da4fd27982499b48c` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:48.869444 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23b8a32-f9d4-4b38-82fc-004278a55fa9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=32c9566e57e94c7da4fd27982499b48c)` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:49:48.871436 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23b8a32-f9d4-4b38-82fc-004278a55fa9 admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:49:48.935442 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-b23b8a32-f9d4-4b38-82fc-004278a55fa9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '32c9566e57e94c7da4fd27982499b48c'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:49:48.936386 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-b23b8a32-f9d4-4b38-82fc-004278a55fa9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '32c9566e57e94c7da4fd27982499b48c'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:49:48.945298 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:49:48.949463 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ef64c6-51d2-4661-8c39-71ecadadf149 admin admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:49:48.952538 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-b23b8a32-f9d4-4b38-82fc-004278a55fa9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '32c9566e57e94c7da4fd27982499b48c'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:49:48.955016 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-28ef64c6-51d2-4661-8c39-71ecadadf149 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:49:48.960905 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-b23b8a32-f9d4-4b38-82fc-004278a55fa9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '32c9566e57e94c7da4fd27982499b48c'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:49:48.969139 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-b23b8a32-f9d4-4b38-82fc-004278a55fa9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '32c9566e57e94c7da4fd27982499b48c'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:49:48.976300 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 955/1891] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 30 00:49:48 2022] DELETE /identity/v3/users/32c9566e57e94c7da4fd27982499b48c => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 00:49:48.978874 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ef64c6-51d2-4661-8c39-71ecadadf149 admin admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:49:49.049957 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca34024-04cd-4c7f-ad50-e316e3f84483 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:49:49.050714 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca34024-04cd-4c7f-ad50-e316e3f84483 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:49.051098 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca34024-04cd-4c7f-ad50-e316e3f84483 admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:49.051519 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca34024-04cd-4c7f-ad50-e316e3f84483 admin admin] PATH_INFO: `/v3/users/06fbfffaa46d45fe90aebd02ae82c604` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:49.052764 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca34024-04cd-4c7f-ad50-e316e3f84483 admin admin] RBAC: Authorizing `identity:delete_user(user_id=06fbfffaa46d45fe90aebd02ae82c604)` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:49:49.055255 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca34024-04cd-4c7f-ad50-e316e3f84483 admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:49:49.117811 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-9ca34024-04cd-4c7f-ad50-e316e3f84483 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '06fbfffaa46d45fe90aebd02ae82c604'} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:49:49.118528 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-9ca34024-04cd-4c7f-ad50-e316e3f84483 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '06fbfffaa46d45fe90aebd02ae82c604'} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:49:49.126561 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-9ca34024-04cd-4c7f-ad50-e316e3f84483 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '06fbfffaa46d45fe90aebd02ae82c604'} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:49:49.127576 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-9ca34024-04cd-4c7f-ad50-e316e3f84483 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '06fbfffaa46d45fe90aebd02ae82c604'} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:49:49.140679 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-9ca34024-04cd-4c7f-ad50-e316e3f84483 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '06fbfffaa46d45fe90aebd02ae82c604'} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:49:49.160493 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 937/1892] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 30 00:49:48 2022] DELETE /identity/v3/users/06fbfffaa46d45fe90aebd02ae82c604 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 00:49:49.164789 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1264638-2b2b-42a0-adb1-76c64dbb3f6a None None] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:49.165077 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1264638-2b2b-42a0-adb1-76c64dbb3f6a None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:49.165347 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1264638-2b2b-42a0-adb1-76c64dbb3f6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:49.184623 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.auth.core [None req-c1264638-2b2b-42a0-adb1-76c64dbb3f6a None None] MFA Rules not processed for user `eb55b6cbca4945abb21b0e49eb745e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=87956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:49:49.185859 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-c1264638-2b2b-42a0-adb1-76c64dbb3f6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:49:49.249805 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 956/1893] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 30 00:49:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:49:49.260228 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca34024-04cd-4c7f-ad50-e316e3f84483 admin admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:49:49.262079 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-9ca34024-04cd-4c7f-ad50-e316e3f84483 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:49:49.283618 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1264638-2b2b-42a0-adb1-76c64dbb3f6a None None] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:49:49.284972 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-c1264638-2b2b-42a0-adb1-76c64dbb3f6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:49:49.299433 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1264638-2b2b-42a0-adb1-76c64dbb3f6a None None] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:49:49.305382 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49104424-39a2-4fb5-965e-2be8ee76c602 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:49:49.306160 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49104424-39a2-4fb5-965e-2be8ee76c602 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:49.307250 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49104424-39a2-4fb5-965e-2be8ee76c602 admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:49.307691 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49104424-39a2-4fb5-965e-2be8ee76c602 admin admin] PATH_INFO: `/v3/projects/729b539f57524b44b77ac43d8d1a88d0` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:49.310021 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49104424-39a2-4fb5-965e-2be8ee76c602 admin admin] RBAC: Authorizing `identity:delete_project(project_id=729b539f57524b44b77ac43d8d1a88d0)` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:49:49.312454 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49104424-39a2-4fb5-965e-2be8ee76c602 admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:49:49.328457 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca34024-04cd-4c7f-ad50-e316e3f84483 admin admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:49:49.332167 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330e0a72-9d50-4962-842a-67f685dbcff6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5693f186c6ad4d9394f02ee3477cdcd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d2387fdf794d4eaef07bbcd7b39f2a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:49:49.332826 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330e0a72-9d50-4962-842a-67f685dbcff6 service neutron] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:49.333100 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330e0a72-9d50-4962-842a-67f685dbcff6 service neutron] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:49.333376 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330e0a72-9d50-4962-842a-67f685dbcff6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:49.345632 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330e0a72-9d50-4962-842a-67f685dbcff6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:49:49.347166 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330e0a72-9d50-4962-842a-67f685dbcff6 service neutron] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:49:49.359065 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 938/1894] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 30 00:49:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 00:49:49.375024 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-49104424-39a2-4fb5-965e-2be8ee76c602 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '729b539f57524b44b77ac43d8d1a88d0', 'request_id': 'req-49104424-39a2-4fb5-965e-2be8ee76c602'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:49:49.383602 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-49104424-39a2-4fb5-965e-2be8ee76c602 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '729b539f57524b44b77ac43d8d1a88d0', 'request_id': 'req-49104424-39a2-4fb5-965e-2be8ee76c602'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:49:49.390437 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-49104424-39a2-4fb5-965e-2be8ee76c602 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '729b539f57524b44b77ac43d8d1a88d0', 'request_id': 'req-49104424-39a2-4fb5-965e-2be8ee76c602'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:49:49.402628 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-49104424-39a2-4fb5-965e-2be8ee76c602 admin admin] The token cache is being invalidate because project 729b539f57524b44b77ac43d8d1a88d0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87956) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 00:49:49.402983 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-49104424-39a2-4fb5-965e-2be8ee76c602 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:49:49.403930 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-49104424-39a2-4fb5-965e-2be8ee76c602 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:49:49.406439 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 957/1895] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 30 00:49:49 2022] DELETE /identity/v3/projects/729b539f57524b44b77ac43d8d1a88d0 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 00:49:49.412146 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b86e10-dceb-4177-aeaa-c0e47c4b13f6 None None] REQUEST_METHOD: `POST` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:49.412505 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b86e10-dceb-4177-aeaa-c0e47c4b13f6 None None] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:49.412824 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b86e10-dceb-4177-aeaa-c0e47c4b13f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:49.428626 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:49:49.436874 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.auth.core [None req-c3b86e10-dceb-4177-aeaa-c0e47c4b13f6 None None] MFA Rules not processed for user `eb55b6cbca4945abb21b0e49eb745e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=87955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:49:49.438682 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-c3b86e10-dceb-4177-aeaa-c0e47c4b13f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:49:49.500724 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 939/1896] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 30 00:49:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:49:49.508537 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22910c5e-56a9-4628-954d-133f6cbd78e6 None None] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:49.508732 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22910c5e-56a9-4628-954d-133f6cbd78e6 None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:49.509185 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22910c5e-56a9-4628-954d-133f6cbd78e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:49.533748 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.auth.core [None req-22910c5e-56a9-4628-954d-133f6cbd78e6 None None] MFA Rules not processed for user `eb55b6cbca4945abb21b0e49eb745e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=87956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:49:49.534962 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-22910c5e-56a9-4628-954d-133f6cbd78e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:49:49.543088 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 958/1897] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 30 00:49:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:49:49.547457 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b86e10-dceb-4177-aeaa-c0e47c4b13f6 None None] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:49:49.557058 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b86e10-dceb-4177-aeaa-c0e47c4b13f6 None None] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:49:49.561553 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb018cb-8393-4bc1-b215-dfd1369f3dde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:49:49.562154 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb018cb-8393-4bc1-b215-dfd1369f3dde admin admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:49.562427 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb018cb-8393-4bc1-b215-dfd1369f3dde admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:49.562690 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb018cb-8393-4bc1-b215-dfd1369f3dde admin admin] PATH_INFO: `/v3/domains` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:49.563362 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb018cb-8393-4bc1-b215-dfd1369f3dde admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:49:49.563659 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb018cb-8393-4bc1-b215-dfd1369f3dde admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:49:49.565234 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb018cb-8393-4bc1-b215-dfd1369f3dde admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:49:49.579240 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 940/1898] 10.222.0.42 () {58 vars in 1153 bytes} [Sun Oct 30 00:49:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:49:49.581970 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22910c5e-56a9-4628-954d-133f6cbd78e6 None None] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:49:49.591608 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22910c5e-56a9-4628-954d-133f6cbd78e6 None None] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:49:49.597025 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5517e0-cb64-4785-931a-43a168d9c781 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:49:49.597663 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5517e0-cb64-4785-931a-43a168d9c781 admin admin] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:49.597936 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5517e0-cb64-4785-931a-43a168d9c781 admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:49.598200 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5517e0-cb64-4785-931a-43a168d9c781 admin admin] PATH_INFO: `/v3/projects` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:49.599335 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5517e0-cb64-4785-931a-43a168d9c781 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:49:49.601302 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5517e0-cb64-4785-931a-43a168d9c781 admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:49:49.635040 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 959/1899] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 30 00:49:49 2022] POST /identity/v3/projects => generated 373 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 00:49:49.639529 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb018cb-8393-4bc1-b215-dfd1369f3dde admin admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:49:49.653180 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb018cb-8393-4bc1-b215-dfd1369f3dde admin admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:49:49.656297 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5517e0-cb64-4785-931a-43a168d9c781 admin admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:49:49.658303 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-6c5517e0-cb64-4785-931a-43a168d9c781 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:49:49.695181 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=88,keystone:DELETE=9,keystone:INSERT=3 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:49:49.730670 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cab7f1-9405-4db0-a1f8-13f7625c6d5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:49:49.731516 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cab7f1-9405-4db0-a1f8-13f7625c6d5a admin admin] REQUEST_METHOD: `POST` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:49.732124 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cab7f1-9405-4db0-a1f8-13f7625c6d5a admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:49.732400 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cab7f1-9405-4db0-a1f8-13f7625c6d5a admin admin] PATH_INFO: `/v3/users` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:49.733056 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60cab7f1-9405-4db0-a1f8-13f7625c6d5a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:49:49.735119 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60cab7f1-9405-4db0-a1f8-13f7625c6d5a admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:49:49.743448 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5517e0-cb64-4785-931a-43a168d9c781 admin admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:49:49.748967 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1810d66b-fc75-4dcb-8741-13936fcc090c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:49:49.749842 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1810d66b-fc75-4dcb-8741-13936fcc090c admin admin] REQUEST_METHOD: `DELETE` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:49.750102 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1810d66b-fc75-4dcb-8741-13936fcc090c admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:49.750500 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1810d66b-fc75-4dcb-8741-13936fcc090c admin admin] PATH_INFO: `/v3/projects/b774cebc78ea4f66b9adf5937194f980` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:49.751967 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1810d66b-fc75-4dcb-8741-13936fcc090c admin admin] RBAC: Authorizing `identity:delete_project(project_id=b774cebc78ea4f66b9adf5937194f980)` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:49:49.754091 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1810d66b-fc75-4dcb-8741-13936fcc090c admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:49:49.774059 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 941/1900] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 30 00:49:49 2022] POST /identity/v3/users => generated 287 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 00:49:49.775593 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cab7f1-9405-4db0-a1f8-13f7625c6d5a admin admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:49:49.777493 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-60cab7f1-9405-4db0-a1f8-13f7625c6d5a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:49:49.789331 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cab7f1-9405-4db0-a1f8-13f7625c6d5a admin admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:49:49.794260 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eef24ce-9d68-4085-9847-4d4839ddbdbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:49:49.794928 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eef24ce-9d68-4085-9847-4d4839ddbdbf admin admin] REQUEST_METHOD: `DELETE` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:49.795224 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eef24ce-9d68-4085-9847-4d4839ddbdbf admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:49.795490 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eef24ce-9d68-4085-9847-4d4839ddbdbf admin admin] PATH_INFO: `/v3/users/451debb39f774b1e8bb1e1dba61cc5fe` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:49.796962 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eef24ce-9d68-4085-9847-4d4839ddbdbf admin admin] RBAC: Authorizing `identity:delete_user(user_id=451debb39f774b1e8bb1e1dba61cc5fe)` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:49:49.799383 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eef24ce-9d68-4085-9847-4d4839ddbdbf admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:49:49.817334 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-1810d66b-fc75-4dcb-8741-13936fcc090c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b774cebc78ea4f66b9adf5937194f980', 'request_id': 'req-1810d66b-fc75-4dcb-8741-13936fcc090c'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:49:49.825811 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-1810d66b-fc75-4dcb-8741-13936fcc090c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b774cebc78ea4f66b9adf5937194f980', 'request_id': 'req-1810d66b-fc75-4dcb-8741-13936fcc090c'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:49:49.832594 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-1810d66b-fc75-4dcb-8741-13936fcc090c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b774cebc78ea4f66b9adf5937194f980', 'request_id': 'req-1810d66b-fc75-4dcb-8741-13936fcc090c'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:49:49.844121 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-1810d66b-fc75-4dcb-8741-13936fcc090c admin admin] The token cache is being invalidate because project b774cebc78ea4f66b9adf5937194f980 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87956) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 00:49:49.844401 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-1810d66b-fc75-4dcb-8741-13936fcc090c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:49:49.845229 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-1810d66b-fc75-4dcb-8741-13936fcc090c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:49:49.846837 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 960/1901] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 30 00:49:49 2022] DELETE /identity/v3/projects/b774cebc78ea4f66b9adf5937194f980 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 00:49:49.850124 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1810d66b-fc75-4dcb-8741-13936fcc090c admin admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:49:49.850124 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-1810d66b-fc75-4dcb-8741-13936fcc090c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:49:49.850318 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-5eef24ce-9d68-4085-9847-4d4839ddbdbf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '451debb39f774b1e8bb1e1dba61cc5fe'} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:49:49.850318 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-5eef24ce-9d68-4085-9847-4d4839ddbdbf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '451debb39f774b1e8bb1e1dba61cc5fe'} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:49:49.856977 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-5eef24ce-9d68-4085-9847-4d4839ddbdbf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '451debb39f774b1e8bb1e1dba61cc5fe'} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:49:49.857635 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-5eef24ce-9d68-4085-9847-4d4839ddbdbf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '451debb39f774b1e8bb1e1dba61cc5fe'} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:49:49.870372 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-5eef24ce-9d68-4085-9847-4d4839ddbdbf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '451debb39f774b1e8bb1e1dba61cc5fe'} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:49:49.873962 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:49:49.886858 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 942/1902] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 30 00:49:49 2022] DELETE /identity/v3/users/451debb39f774b1e8bb1e1dba61cc5fe => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 00:49:49.888380 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be56ace8-d86b-400b-b26d-0dd1d70b3d43 None None] REQUEST_METHOD: `POST` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:49.888668 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be56ace8-d86b-400b-b26d-0dd1d70b3d43 None None] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:49.888937 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be56ace8-d86b-400b-b26d-0dd1d70b3d43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:49.908396 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.auth.core [None req-be56ace8-d86b-400b-b26d-0dd1d70b3d43 None None] MFA Rules not processed for user `eb55b6cbca4945abb21b0e49eb745e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=87955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:49:49.909860 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-be56ace8-d86b-400b-b26d-0dd1d70b3d43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:49:49.914835 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1810d66b-fc75-4dcb-8741-13936fcc090c admin admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:49:49.977113 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 943/1903] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 30 00:49:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:49:49.978562 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad8961b-5a2e-4f04-999f-acd213dc495a None None] REQUEST_METHOD: `POST` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:49.978837 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad8961b-5a2e-4f04-999f-acd213dc495a None None] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:49.985483 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad8961b-5a2e-4f04-999f-acd213dc495a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:49.992843 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdca9361-4a55-48e7-8204-a6cc031c6745 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:49:49.993575 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdca9361-4a55-48e7-8204-a6cc031c6745 admin admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:49.993957 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdca9361-4a55-48e7-8204-a6cc031c6745 admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:49.994360 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdca9361-4a55-48e7-8204-a6cc031c6745 admin admin] PATH_INFO: `/v3/roles` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:49.995225 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdca9361-4a55-48e7-8204-a6cc031c6745 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:49:49.996937 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdca9361-4a55-48e7-8204-a6cc031c6745 admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:49:50.003043 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.auth.core [None req-8ad8961b-5a2e-4f04-999f-acd213dc495a None None] MFA Rules not processed for user `eb55b6cbca4945abb21b0e49eb745e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=87955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:49:50.004297 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-8ad8961b-5a2e-4f04-999f-acd213dc495a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:49:50.013224 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 961/1904] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 30 00:49:49 2022] GET /identity/v3/roles => generated 1420 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 00:49:50.014332 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dd1baa-9c29-454c-98aa-d1afa559e321 None None] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:50.014616 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dd1baa-9c29-454c-98aa-d1afa559e321 None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:50.014882 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dd1baa-9c29-454c-98aa-d1afa559e321 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:50.023910 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:49:50.040030 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.auth.core [None req-68dd1baa-9c29-454c-98aa-d1afa559e321 None None] MFA Rules not processed for user `eb55b6cbca4945abb21b0e49eb745e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=87956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:49:50.040362 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 944/1905] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 30 00:49:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:49:50.041171 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-68dd1baa-9c29-454c-98aa-d1afa559e321 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:49:50.048220 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad8961b-5a2e-4f04-999f-acd213dc495a None None] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:49:50.054379 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 962/1906] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 30 00:49:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:49:50.055294 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68dd1baa-9c29-454c-98aa-d1afa559e321 None None] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:49:50.058622 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-68dd1baa-9c29-454c-98aa-d1afa559e321 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:49:50.062135 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-8ad8961b-5a2e-4f04-999f-acd213dc495a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:49:50.092481 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad8961b-5a2e-4f04-999f-acd213dc495a None None] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:49:50.116063 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc1f3f9-860f-4a88-9810-5e77c466c220 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:49:50.116696 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc1f3f9-860f-4a88-9810-5e77c466c220 admin admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:50.116965 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc1f3f9-860f-4a88-9810-5e77c466c220 admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:50.117623 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc1f3f9-860f-4a88-9810-5e77c466c220 admin admin] PATH_INFO: `/v3/roles` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:50.117984 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc1f3f9-860f-4a88-9810-5e77c466c220 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:49:50.119662 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc1f3f9-860f-4a88-9810-5e77c466c220 admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:49:50.146482 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 945/1907] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 30 00:49:50 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 00:49:50.147245 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc1f3f9-860f-4a88-9810-5e77c466c220 admin admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:49:50.165668 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68dd1baa-9c29-454c-98aa-d1afa559e321 None None] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:49:50.166691 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc1f3f9-860f-4a88-9810-5e77c466c220 admin admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:49:50.174776 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df8aafc-9033-433a-8120-da6d807a22ec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5693f186c6ad4d9394f02ee3477cdcd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d2387fdf794d4eaef07bbcd7b39f2a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:49:50.176056 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df8aafc-9033-433a-8120-da6d807a22ec service neutron] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:50.176593 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df8aafc-9033-433a-8120-da6d807a22ec service neutron] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:50.177034 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df8aafc-9033-433a-8120-da6d807a22ec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:50.183066 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9611b0af-765e-450b-8bd7-8da39d8c6389 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:49:50.183963 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9611b0af-765e-450b-8bd7-8da39d8c6389 admin admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:50.186258 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9611b0af-765e-450b-8bd7-8da39d8c6389 admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:50.189204 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9611b0af-765e-450b-8bd7-8da39d8c6389 admin admin] PATH_INFO: `/v3/domains` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:50.189793 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9611b0af-765e-450b-8bd7-8da39d8c6389 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:49:50.190138 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9611b0af-765e-450b-8bd7-8da39d8c6389 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:49:50.193777 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9611b0af-765e-450b-8bd7-8da39d8c6389 admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:49:50.195804 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df8aafc-9033-433a-8120-da6d807a22ec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:49:50.199885 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df8aafc-9033-433a-8120-da6d807a22ec service neutron] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:49:50.216154 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 963/1908] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 30 00:49:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 00:49:50.217023 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df8aafc-9033-433a-8120-da6d807a22ec service neutron] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:49:50.222287 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 946/1909] 10.222.0.42 () {58 vars in 1153 bytes} [Sun Oct 30 00:49:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:49:50.226533 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9611b0af-765e-450b-8bd7-8da39d8c6389 admin admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:49:50.231964 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df8aafc-9033-433a-8120-da6d807a22ec service neutron] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:49:50.244999 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9611b0af-765e-450b-8bd7-8da39d8c6389 admin admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:49:50.246937 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bf56b6-ab05-484f-b9ba-4341cdf33942 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:49:50.248214 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bf56b6-ab05-484f-b9ba-4341cdf33942 admin admin] REQUEST_METHOD: `PUT` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:50.248858 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bf56b6-ab05-484f-b9ba-4341cdf33942 admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:50.249140 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bf56b6-ab05-484f-b9ba-4341cdf33942 admin admin] PATH_INFO: `/v3/projects/4baf488c61a048ca8dc593e82eaddd86/users/dd47858cd5414ea9a2c9b515f631eb72/roles/1c93019874174c4b91118d9ce2347e47` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:50.259827 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de06bbe9-d05d-481b-9b99-070ad6dfad75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:49:50.260666 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de06bbe9-d05d-481b-9b99-070ad6dfad75 admin admin] REQUEST_METHOD: `POST` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:50.260964 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de06bbe9-d05d-481b-9b99-070ad6dfad75 admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:50.261424 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de06bbe9-d05d-481b-9b99-070ad6dfad75 admin admin] PATH_INFO: `/v3/projects` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:50.262171 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de06bbe9-d05d-481b-9b99-070ad6dfad75 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:49:50.264444 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de06bbe9-d05d-481b-9b99-070ad6dfad75 admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:49:50.300235 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19bf56b6-ab05-484f-b9ba-4341cdf33942 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4baf488c61a048ca8dc593e82eaddd86, user_id=dd47858cd5414ea9a2c9b515f631eb72, role_id=1c93019874174c4b91118d9ce2347e47)` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:49:50.303563 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 947/1910] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 30 00:49:50 2022] POST /identity/v3/projects => generated 385 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 30 00:49:50.304664 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de06bbe9-d05d-481b-9b99-070ad6dfad75 admin admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:49:50.305221 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19bf56b6-ab05-484f-b9ba-4341cdf33942 admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:49:50.306849 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-de06bbe9-d05d-481b-9b99-070ad6dfad75 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:49:50.327297 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 964/1911] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 30 00:49:50 2022] PUT /identity/v3/projects/4baf488c61a048ca8dc593e82eaddd86/users/dd47858cd5414ea9a2c9b515f631eb72/roles/1c93019874174c4b91118d9ce2347e47 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 00:49:50.327297 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bf56b6-ab05-484f-b9ba-4341cdf33942 admin admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:49:50.416722 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de06bbe9-d05d-481b-9b99-070ad6dfad75 admin admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:49:50.422110 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfb6435-d018-46fb-853a-a50e2923d701 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:49:50.422750 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfb6435-d018-46fb-853a-a50e2923d701 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:50.423054 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfb6435-d018-46fb-853a-a50e2923d701 admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:50.423362 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfb6435-d018-46fb-853a-a50e2923d701 admin admin] PATH_INFO: `/v3/users/a65229b09d664bb983f70d0273061c1c` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:50.424806 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfb6435-d018-46fb-853a-a50e2923d701 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a65229b09d664bb983f70d0273061c1c)` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:49:50.425098 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bf56b6-ab05-484f-b9ba-4341cdf33942 admin admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:49:50.426579 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfb6435-d018-46fb-853a-a50e2923d701 admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:49:50.430852 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688d8b39-3dce-427e-b56f-c394d308229d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:49:50.431664 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688d8b39-3dce-427e-b56f-c394d308229d admin admin] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:50.431890 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688d8b39-3dce-427e-b56f-c394d308229d admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:50.432250 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688d8b39-3dce-427e-b56f-c394d308229d admin admin] PATH_INFO: `/v3/users` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:50.433575 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688d8b39-3dce-427e-b56f-c394d308229d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:49:50.434708 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688d8b39-3dce-427e-b56f-c394d308229d admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:49:50.472279 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 965/1912] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 30 00:49:50 2022] POST /identity/v3/users => generated 293 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 00:49:50.473681 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98e20b2-9724-4e14-8214-911aa906c755 None None] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:50.474100 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98e20b2-9724-4e14-8214-911aa906c755 None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:50.474379 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98e20b2-9724-4e14-8214-911aa906c755 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:50.490554 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=92,keystone:INSERT=1,keystone:DELETE=7 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:49:50.492979 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-8bfb6435-d018-46fb-853a-a50e2923d701 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a65229b09d664bb983f70d0273061c1c'} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:49:50.494051 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-8bfb6435-d018-46fb-853a-a50e2923d701 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a65229b09d664bb983f70d0273061c1c'} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:49:50.506007 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-8bfb6435-d018-46fb-853a-a50e2923d701 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a65229b09d664bb983f70d0273061c1c'} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:49:50.506904 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-8bfb6435-d018-46fb-853a-a50e2923d701 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a65229b09d664bb983f70d0273061c1c'} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:49:50.513807 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.auth.core [None req-a98e20b2-9724-4e14-8214-911aa906c755 None None] MFA Rules not processed for user `dd47858cd5414ea9a2c9b515f631eb72`. Rule list: `[]` (Enabled: `True`). {{(pid=87956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:49:50.515459 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-a98e20b2-9724-4e14-8214-911aa906c755 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:49:50.525826 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-8bfb6435-d018-46fb-853a-a50e2923d701 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a65229b09d664bb983f70d0273061c1c'} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:49:50.546316 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 948/1913] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 30 00:49:50 2022] DELETE /identity/v3/users/a65229b09d664bb983f70d0273061c1c => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 00:49:50.547546 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfb6435-d018-46fb-853a-a50e2923d701 admin admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:49:50.549652 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-8bfb6435-d018-46fb-853a-a50e2923d701 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:49:50.615617 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:49:50.636246 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 966/1914] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 30 00:49:50 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:49:50.637678 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e738bd42-bb84-441c-9d16-e8495b0b016d None None] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:50.637967 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e738bd42-bb84-441c-9d16-e8495b0b016d None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:50.638237 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e738bd42-bb84-441c-9d16-e8495b0b016d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:50.649986 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfb6435-d018-46fb-853a-a50e2923d701 admin admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:49:50.655708 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6a849b-39d5-4782-a68a-de2e07cd32ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:49:50.656352 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6a849b-39d5-4782-a68a-de2e07cd32ba admin admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:50.656651 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6a849b-39d5-4782-a68a-de2e07cd32ba admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:50.656962 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6a849b-39d5-4782-a68a-de2e07cd32ba admin admin] PATH_INFO: `/v3/roles` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:50.657594 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6a849b-39d5-4782-a68a-de2e07cd32ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:49:50.659460 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6a849b-39d5-4782-a68a-de2e07cd32ba admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:49:50.668442 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.auth.core [None req-e738bd42-bb84-441c-9d16-e8495b0b016d None None] MFA Rules not processed for user `eb55b6cbca4945abb21b0e49eb745e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=87956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:49:50.669725 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-e738bd42-bb84-441c-9d16-e8495b0b016d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:49:50.673599 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 949/1915] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 30 00:49:50 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 00:49:50.674469 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6a849b-39d5-4782-a68a-de2e07cd32ba admin admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:49:50.676302 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-ea6a849b-39d5-4782-a68a-de2e07cd32ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:49:50.683247 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 967/1916] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 30 00:49:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:49:50.683247 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e738bd42-bb84-441c-9d16-e8495b0b016d None None] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:49:50.684554 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-e738bd42-bb84-441c-9d16-e8495b0b016d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:49:50.695004 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6a849b-39d5-4782-a68a-de2e07cd32ba admin admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:49:50.703168 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc77d9a-a6b2-4141-b37b-109d6b6740fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:49:50.703889 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc77d9a-a6b2-4141-b37b-109d6b6740fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:50.704171 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc77d9a-a6b2-4141-b37b-109d6b6740fa admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:50.704679 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc77d9a-a6b2-4141-b37b-109d6b6740fa admin admin] PATH_INFO: `/v3/projects/260a4b066fb44053804caffae552fe2a` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:50.705579 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc77d9a-a6b2-4141-b37b-109d6b6740fa admin admin] RBAC: Authorizing `identity:delete_project(project_id=260a4b066fb44053804caffae552fe2a)` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:49:50.708880 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc77d9a-a6b2-4141-b37b-109d6b6740fa admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:49:50.752330 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e738bd42-bb84-441c-9d16-e8495b0b016d None None] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:49:50.760092 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-bfc77d9a-a6b2-4141-b37b-109d6b6740fa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '260a4b066fb44053804caffae552fe2a', 'request_id': 'req-bfc77d9a-a6b2-4141-b37b-109d6b6740fa'} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:49:50.768269 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-bfc77d9a-a6b2-4141-b37b-109d6b6740fa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '260a4b066fb44053804caffae552fe2a', 'request_id': 'req-bfc77d9a-a6b2-4141-b37b-109d6b6740fa'} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:49:50.776371 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-bfc77d9a-a6b2-4141-b37b-109d6b6740fa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '260a4b066fb44053804caffae552fe2a', 'request_id': 'req-bfc77d9a-a6b2-4141-b37b-109d6b6740fa'} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:49:50.797938 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-bfc77d9a-a6b2-4141-b37b-109d6b6740fa admin admin] The token cache is being invalidate because project 260a4b066fb44053804caffae552fe2a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87955) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 00:49:50.798646 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-bfc77d9a-a6b2-4141-b37b-109d6b6740fa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:49:50.799972 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-bfc77d9a-a6b2-4141-b37b-109d6b6740fa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:49:50.801693 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 950/1917] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 30 00:49:50 2022] DELETE /identity/v3/projects/260a4b066fb44053804caffae552fe2a => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 00:49:50.805204 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc77d9a-a6b2-4141-b37b-109d6b6740fa admin admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:49:50.805204 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-bfc77d9a-a6b2-4141-b37b-109d6b6740fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:49:50.815685 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb03a5e-2b70-4759-85bb-eb41ba486f34 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48d928ff7fe24348ac900f09c56acc20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d2387fdf794d4eaef07bbcd7b39f2a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:49:50.816318 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb03a5e-2b70-4759-85bb-eb41ba486f34 service cinder] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:50.816775 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb03a5e-2b70-4759-85bb-eb41ba486f34 service cinder] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:50.817191 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb03a5e-2b70-4759-85bb-eb41ba486f34 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:50.819421 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-3bb03a5e-2b70-4759-85bb-eb41ba486f34 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:49:50.865043 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:49:50.895823 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc77d9a-a6b2-4141-b37b-109d6b6740fa admin admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:49:50.899959 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb03a5e-2b70-4759-85bb-eb41ba486f34 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:49:50.905814 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb03a5e-2b70-4759-85bb-eb41ba486f34 service cinder] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:49:50.908754 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd0d12a-f1ce-45de-a6b7-6c9ba42bd0eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:49:50.909716 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd0d12a-f1ce-45de-a6b7-6c9ba42bd0eb admin admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:50.910175 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd0d12a-f1ce-45de-a6b7-6c9ba42bd0eb admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:50.910704 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd0d12a-f1ce-45de-a6b7-6c9ba42bd0eb admin admin] PATH_INFO: `/v3/roles` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:50.911585 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd0d12a-f1ce-45de-a6b7-6c9ba42bd0eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:49:50.913680 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd0d12a-f1ce-45de-a6b7-6c9ba42bd0eb admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:49:50.925904 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 968/1918] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 30 00:49:50 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 243 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 00:49:50.926781 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb03a5e-2b70-4759-85bb-eb41ba486f34 service cinder] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:49:50.928440 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-3bb03a5e-2b70-4759-85bb-eb41ba486f34 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:49:50.945604 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 951/1919] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 30 00:49:50 2022] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 00:49:50.948962 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734a3fc0-bedb-4547-ae84-5c1b52519b8b None None] REQUEST_METHOD: `POST` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:50.949761 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734a3fc0-bedb-4547-ae84-5c1b52519b8b None None] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:50.950273 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734a3fc0-bedb-4547-ae84-5c1b52519b8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:50.983456 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.auth.core [None req-734a3fc0-bedb-4547-ae84-5c1b52519b8b None None] MFA Rules not processed for user `eb55b6cbca4945abb21b0e49eb745e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=87955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:49:50.984718 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-734a3fc0-bedb-4547-ae84-5c1b52519b8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:49:50.993587 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 952/1920] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 30 00:49:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:49:51.000950 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734a3fc0-bedb-4547-ae84-5c1b52519b8b None None] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:49:51.012191 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734a3fc0-bedb-4547-ae84-5c1b52519b8b None None] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:49:51.017582 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e374cb-833f-4a75-b345-a30b64ed2d05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:49:51.018481 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e374cb-833f-4a75-b345-a30b64ed2d05 admin admin] REQUEST_METHOD: `PUT` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:51.018701 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e374cb-833f-4a75-b345-a30b64ed2d05 admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:51.019059 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e374cb-833f-4a75-b345-a30b64ed2d05 admin admin] PATH_INFO: `/v3/projects/db34efe7e7214964aa8fb92fb924829f/users/6980cb62f44e47be98572ec35d3aa602/roles/1c93019874174c4b91118d9ce2347e47` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:51.033635 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb03a5e-2b70-4759-85bb-eb41ba486f34 service cinder] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:49:51.036160 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e374cb-833f-4a75-b345-a30b64ed2d05 admin admin] RBAC: Authorizing `identity:create_grant(project_id=db34efe7e7214964aa8fb92fb924829f, user_id=6980cb62f44e47be98572ec35d3aa602, role_id=1c93019874174c4b91118d9ce2347e47)` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:49:51.037391 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db86a53a-f1f6-43e5-9035-4c7f4742f7c1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5693f186c6ad4d9394f02ee3477cdcd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d2387fdf794d4eaef07bbcd7b39f2a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:49:51.038079 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db86a53a-f1f6-43e5-9035-4c7f4742f7c1 service neutron] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:51.038431 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db86a53a-f1f6-43e5-9035-4c7f4742f7c1 service neutron] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:51.038773 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db86a53a-f1f6-43e5-9035-4c7f4742f7c1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:51.038888 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e374cb-833f-4a75-b345-a30b64ed2d05 admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:49:51.041783 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-db86a53a-f1f6-43e5-9035-4c7f4742f7c1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:49:51.052848 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 953/1921] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 30 00:49:50 2022] PUT /identity/v3/projects/db34efe7e7214964aa8fb92fb924829f/users/6980cb62f44e47be98572ec35d3aa602/roles/1c93019874174c4b91118d9ce2347e47 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 00:49:51.061874 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e374cb-833f-4a75-b345-a30b64ed2d05 admin admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:49:51.061978 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db86a53a-f1f6-43e5-9035-4c7f4742f7c1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:49:51.061978 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db86a53a-f1f6-43e5-9035-4c7f4742f7c1 service neutron] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:49:51.063582 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-93e374cb-833f-4a75-b345-a30b64ed2d05 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:49:51.064357 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=100 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:49:51.069584 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 969/1922] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 30 00:49:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 00:49:51.071493 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d68dbbe-d691-475d-9cd3-d5331be79e19 None None] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:51.071641 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d68dbbe-d691-475d-9cd3-d5331be79e19 None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:51.071992 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d68dbbe-d691-475d-9cd3-d5331be79e19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:51.094173 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.auth.core [None req-9d68dbbe-d691-475d-9cd3-d5331be79e19 None None] MFA Rules not processed for user `eb55b6cbca4945abb21b0e49eb745e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=87956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:49:51.095506 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-9d68dbbe-d691-475d-9cd3-d5331be79e19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:49:51.143848 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e374cb-833f-4a75-b345-a30b64ed2d05 admin admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:49:51.148754 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f578689d-461d-45b7-b75a-c72f446b77dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:49:51.149395 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f578689d-461d-45b7-b75a-c72f446b77dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:51.149783 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f578689d-461d-45b7-b75a-c72f446b77dc admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:51.150089 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f578689d-461d-45b7-b75a-c72f446b77dc admin admin] PATH_INFO: `/v3/users/dd47858cd5414ea9a2c9b515f631eb72` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:51.151550 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f578689d-461d-45b7-b75a-c72f446b77dc admin admin] RBAC: Authorizing `identity:delete_user(user_id=dd47858cd5414ea9a2c9b515f631eb72)` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:49:51.153998 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f578689d-461d-45b7-b75a-c72f446b77dc admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:49:51.164701 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 970/1923] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 30 00:49:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:49:51.170002 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efa3390-8e52-4bfd-92bc-6534fb07df4e None None] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:51.170293 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efa3390-8e52-4bfd-92bc-6534fb07df4e None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:51.171284 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efa3390-8e52-4bfd-92bc-6534fb07df4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:51.205753 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.auth.core [None req-8efa3390-8e52-4bfd-92bc-6534fb07df4e None None] MFA Rules not processed for user `6980cb62f44e47be98572ec35d3aa602`. Rule list: `[]` (Enabled: `True`). {{(pid=87956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:49:51.206990 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-8efa3390-8e52-4bfd-92bc-6534fb07df4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:49:51.207581 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-f578689d-461d-45b7-b75a-c72f446b77dc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dd47858cd5414ea9a2c9b515f631eb72'} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:49:51.208541 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-f578689d-461d-45b7-b75a-c72f446b77dc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dd47858cd5414ea9a2c9b515f631eb72'} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:49:51.218132 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-f578689d-461d-45b7-b75a-c72f446b77dc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dd47858cd5414ea9a2c9b515f631eb72'} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:49:51.218922 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-f578689d-461d-45b7-b75a-c72f446b77dc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dd47858cd5414ea9a2c9b515f631eb72'} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:49:51.239177 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-f578689d-461d-45b7-b75a-c72f446b77dc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dd47858cd5414ea9a2c9b515f631eb72'} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:49:51.255947 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 954/1924] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 30 00:49:51 2022] DELETE /identity/v3/users/dd47858cd5414ea9a2c9b515f631eb72 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 00:49:51.260216 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f578689d-461d-45b7-b75a-c72f446b77dc admin admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:49:51.261815 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-f578689d-461d-45b7-b75a-c72f446b77dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:49:51.278134 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 971/1925] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 30 00:49:51 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:49:51.279246 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba70656-db46-4440-bdb8-46b532bdc8c1 None None] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:51.279539 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba70656-db46-4440-bdb8-46b532bdc8c1 None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:51.279856 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba70656-db46-4440-bdb8-46b532bdc8c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:51.296898 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:49:51.307862 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.auth.core [None req-dba70656-db46-4440-bdb8-46b532bdc8c1 None None] MFA Rules not processed for user `eb55b6cbca4945abb21b0e49eb745e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=87956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:49:51.309706 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-dba70656-db46-4440-bdb8-46b532bdc8c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:49:51.345179 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f578689d-461d-45b7-b75a-c72f446b77dc admin admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:49:51.351182 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fee398d-08e9-4a46-8e48-7802e93a2608 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:49:51.351894 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fee398d-08e9-4a46-8e48-7802e93a2608 admin admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:51.352340 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fee398d-08e9-4a46-8e48-7802e93a2608 admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:51.352655 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fee398d-08e9-4a46-8e48-7802e93a2608 admin admin] PATH_INFO: `/v3/domains` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:51.353468 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fee398d-08e9-4a46-8e48-7802e93a2608 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:49:51.353867 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fee398d-08e9-4a46-8e48-7802e93a2608 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:49:51.355604 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fee398d-08e9-4a46-8e48-7802e93a2608 admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:49:51.370580 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 955/1926] 10.222.0.42 () {58 vars in 1153 bytes} [Sun Oct 30 00:49:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:49:51.371707 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fee398d-08e9-4a46-8e48-7802e93a2608 admin admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:49:51.373847 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-5fee398d-08e9-4a46-8e48-7802e93a2608 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:49:51.381175 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 972/1927] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 30 00:49:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:49:51.382124 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba70656-db46-4440-bdb8-46b532bdc8c1 None None] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:49:51.396668 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba70656-db46-4440-bdb8-46b532bdc8c1 None None] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:49:51.401791 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8cb431-4109-4823-9a3d-0e75298a3861 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:49:51.402836 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8cb431-4109-4823-9a3d-0e75298a3861 admin admin] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:51.403127 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8cb431-4109-4823-9a3d-0e75298a3861 admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:51.403444 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8cb431-4109-4823-9a3d-0e75298a3861 admin admin] PATH_INFO: `/v3/projects` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:51.404139 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8cb431-4109-4823-9a3d-0e75298a3861 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:49:51.406525 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8cb431-4109-4823-9a3d-0e75298a3861 admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:49:51.443269 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 973/1928] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 30 00:49:51 2022] POST /identity/v3/projects => generated 391 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 00:49:51.443269 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8cb431-4109-4823-9a3d-0e75298a3861 admin admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:49:51.443532 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-fd8cb431-4109-4823-9a3d-0e75298a3861 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:49:51.450065 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fee398d-08e9-4a46-8e48-7802e93a2608 admin admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:49:51.455117 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:49:51.500621 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33d06db-a20f-46c8-890c-e3c434ff8df7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48d928ff7fe24348ac900f09c56acc20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d2387fdf794d4eaef07bbcd7b39f2a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:49:51.501227 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33d06db-a20f-46c8-890c-e3c434ff8df7 service cinder] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:51.501616 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33d06db-a20f-46c8-890c-e3c434ff8df7 service cinder] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:51.501920 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33d06db-a20f-46c8-890c-e3c434ff8df7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:51.509401 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8cb431-4109-4823-9a3d-0e75298a3861 admin admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:49:51.514090 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb7b44c-9b9c-4f01-94b1-e913bb7bb2b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:49:51.514717 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb7b44c-9b9c-4f01-94b1-e913bb7bb2b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:51.514986 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb7b44c-9b9c-4f01-94b1-e913bb7bb2b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:51.515296 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb7b44c-9b9c-4f01-94b1-e913bb7bb2b0 admin admin] PATH_INFO: `/v3/projects/83de59188f2e4332b478b1ea42b48ff2` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:51.516420 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb7b44c-9b9c-4f01-94b1-e913bb7bb2b0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=83de59188f2e4332b478b1ea42b48ff2)` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:49:51.518375 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb7b44c-9b9c-4f01-94b1-e913bb7bb2b0 admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:49:51.559312 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33d06db-a20f-46c8-890c-e3c434ff8df7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:49:51.560753 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33d06db-a20f-46c8-890c-e3c434ff8df7 service cinder] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:49:51.566180 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-9fb7b44c-9b9c-4f01-94b1-e913bb7bb2b0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '83de59188f2e4332b478b1ea42b48ff2', 'request_id': 'req-9fb7b44c-9b9c-4f01-94b1-e913bb7bb2b0'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:49:51.569931 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 956/1929] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 30 00:49:51 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 00:49:51.570792 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33d06db-a20f-46c8-890c-e3c434ff8df7 service cinder] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:49:51.573178 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-c33d06db-a20f-46c8-890c-e3c434ff8df7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:49:51.575428 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-9fb7b44c-9b9c-4f01-94b1-e913bb7bb2b0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '83de59188f2e4332b478b1ea42b48ff2', 'request_id': 'req-9fb7b44c-9b9c-4f01-94b1-e913bb7bb2b0'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:49:51.583416 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-9fb7b44c-9b9c-4f01-94b1-e913bb7bb2b0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '83de59188f2e4332b478b1ea42b48ff2', 'request_id': 'req-9fb7b44c-9b9c-4f01-94b1-e913bb7bb2b0'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:49:51.595867 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-9fb7b44c-9b9c-4f01-94b1-e913bb7bb2b0 admin admin] The token cache is being invalidate because project 83de59188f2e4332b478b1ea42b48ff2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87956) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 00:49:51.596165 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-9fb7b44c-9b9c-4f01-94b1-e913bb7bb2b0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:49:51.596970 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-9fb7b44c-9b9c-4f01-94b1-e913bb7bb2b0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:49:51.598605 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 974/1930] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 30 00:49:51 2022] DELETE /identity/v3/projects/83de59188f2e4332b478b1ea42b48ff2 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 00:49:51.602131 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb7b44c-9b9c-4f01-94b1-e913bb7bb2b0 admin admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:49:51.603548 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-9fb7b44c-9b9c-4f01-94b1-e913bb7bb2b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:49:51.613160 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=100 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:49:51.641890 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33d06db-a20f-46c8-890c-e3c434ff8df7 service cinder] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:49:51.683570 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb7b44c-9b9c-4f01-94b1-e913bb7bb2b0 admin admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:49:51.688623 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e744a5-7feb-4a35-aa83-d2a294fb0782 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:49:51.689503 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e744a5-7feb-4a35-aa83-d2a294fb0782 admin admin] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:51.689870 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e744a5-7feb-4a35-aa83-d2a294fb0782 admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:51.690246 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e744a5-7feb-4a35-aa83-d2a294fb0782 admin admin] PATH_INFO: `/v3/users` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:51.691525 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e744a5-7feb-4a35-aa83-d2a294fb0782 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:49:51.693539 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e744a5-7feb-4a35-aa83-d2a294fb0782 admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:49:51.700887 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54ea1aa-d46b-4789-ae2e-842651ecfc54 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5693f186c6ad4d9394f02ee3477cdcd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d2387fdf794d4eaef07bbcd7b39f2a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:49:51.701494 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54ea1aa-d46b-4789-ae2e-842651ecfc54 service neutron] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:51.701775 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54ea1aa-d46b-4789-ae2e-842651ecfc54 service neutron] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:51.702046 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54ea1aa-d46b-4789-ae2e-842651ecfc54 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:51.703838 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-f54ea1aa-d46b-4789-ae2e-842651ecfc54 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:49:51.717576 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54ea1aa-d46b-4789-ae2e-842651ecfc54 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:49:51.719086 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54ea1aa-d46b-4789-ae2e-842651ecfc54 service neutron] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:49:51.719621 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 975/1931] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 30 00:49:51 2022] POST /identity/v3/users => generated 296 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 00:49:51.721025 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e744a5-7feb-4a35-aa83-d2a294fb0782 admin admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:49:51.723256 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-e0e744a5-7feb-4a35-aa83-d2a294fb0782 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:49:51.734519 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 957/1932] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 30 00:49:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 00:49:51.735241 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54ea1aa-d46b-4789-ae2e-842651ecfc54 service neutron] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:49:51.739984 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e744a5-7feb-4a35-aa83-d2a294fb0782 admin admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:49:51.745450 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54ea1aa-d46b-4789-ae2e-842651ecfc54 service neutron] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:49:51.746352 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672d4d3c-4427-4fea-86ba-0c78d209f2a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:49:51.746994 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672d4d3c-4427-4fea-86ba-0c78d209f2a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:51.747294 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672d4d3c-4427-4fea-86ba-0c78d209f2a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:51.747792 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672d4d3c-4427-4fea-86ba-0c78d209f2a7 admin admin] PATH_INFO: `/v3/users/78e700fbf0a04137bdd2e6a51379f41a` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:51.748898 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672d4d3c-4427-4fea-86ba-0c78d209f2a7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=78e700fbf0a04137bdd2e6a51379f41a)` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:49:51.750812 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672d4d3c-4427-4fea-86ba-0c78d209f2a7 admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:49:51.751372 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e692342-8614-451a-bd1b-09e3fb1ada14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:49:51.752055 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e692342-8614-451a-bd1b-09e3fb1ada14 admin admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:51.752391 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e692342-8614-451a-bd1b-09e3fb1ada14 admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:51.752730 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e692342-8614-451a-bd1b-09e3fb1ada14 admin admin] PATH_INFO: `/v3/roles` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:51.753543 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e692342-8614-451a-bd1b-09e3fb1ada14 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:49:51.755256 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e692342-8614-451a-bd1b-09e3fb1ada14 admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:49:51.769585 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 958/1933] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 30 00:49:51 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 00:49:51.773917 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e692342-8614-451a-bd1b-09e3fb1ada14 admin admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:49:51.780882 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=85,keystone:DELETE=11,keystone:INSERT=4 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:49:51.785674 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e692342-8614-451a-bd1b-09e3fb1ada14 admin admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:49:51.791328 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a2ac01-7430-44f2-bcee-2f36b91b07e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:49:51.792038 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a2ac01-7430-44f2-bcee-2f36b91b07e0 admin admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:51.792374 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a2ac01-7430-44f2-bcee-2f36b91b07e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:51.792744 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a2ac01-7430-44f2-bcee-2f36b91b07e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:51.793488 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a2ac01-7430-44f2-bcee-2f36b91b07e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:49:51.795335 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a2ac01-7430-44f2-bcee-2f36b91b07e0 admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:49:51.811748 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 959/1934] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 30 00:49:51 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 00:49:51.814403 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a2ac01-7430-44f2-bcee-2f36b91b07e0 admin admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:49:51.819110 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-672d4d3c-4427-4fea-86ba-0c78d209f2a7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '78e700fbf0a04137bdd2e6a51379f41a'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:49:51.820663 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-672d4d3c-4427-4fea-86ba-0c78d209f2a7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '78e700fbf0a04137bdd2e6a51379f41a'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:49:51.829991 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a2ac01-7430-44f2-bcee-2f36b91b07e0 admin admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:49:51.840334 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-672d4d3c-4427-4fea-86ba-0c78d209f2a7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '78e700fbf0a04137bdd2e6a51379f41a'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:49:51.844559 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd08944-09fa-4fc6-9961-0889181f5d64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:49:51.845425 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd08944-09fa-4fc6-9961-0889181f5d64 admin admin] REQUEST_METHOD: `PUT` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:51.845741 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd08944-09fa-4fc6-9961-0889181f5d64 admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:51.846119 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd08944-09fa-4fc6-9961-0889181f5d64 admin admin] PATH_INFO: `/v3/projects/901fd7b6d41e4592ad26f087d0bfc866/users/a61d514217dc465db13024bf6458996b/roles/1c93019874174c4b91118d9ce2347e47` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:51.850760 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-672d4d3c-4427-4fea-86ba-0c78d209f2a7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '78e700fbf0a04137bdd2e6a51379f41a'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:49:51.862167 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-672d4d3c-4427-4fea-86ba-0c78d209f2a7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '78e700fbf0a04137bdd2e6a51379f41a'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:49:51.868186 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd08944-09fa-4fc6-9961-0889181f5d64 admin admin] RBAC: Authorizing `identity:create_grant(project_id=901fd7b6d41e4592ad26f087d0bfc866, user_id=a61d514217dc465db13024bf6458996b, role_id=1c93019874174c4b91118d9ce2347e47)` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:49:51.871118 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd08944-09fa-4fc6-9961-0889181f5d64 admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:49:51.880885 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 976/1935] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 30 00:49:51 2022] DELETE /identity/v3/users/78e700fbf0a04137bdd2e6a51379f41a => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 00:49:51.893474 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 960/1936] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 30 00:49:51 2022] PUT /identity/v3/projects/901fd7b6d41e4592ad26f087d0bfc866/users/a61d514217dc465db13024bf6458996b/roles/1c93019874174c4b91118d9ce2347e47 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 00:49:51.905162 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6acce1f-efdf-4906-93a4-39125082d3fd None None] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:51.905719 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6acce1f-efdf-4906-93a4-39125082d3fd None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:51.906193 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6acce1f-efdf-4906-93a4-39125082d3fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:51.963603 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.auth.core [None req-f6acce1f-efdf-4906-93a4-39125082d3fd None None] MFA Rules not processed for user `a61d514217dc465db13024bf6458996b`. Rule list: `[]` (Enabled: `True`). {{(pid=87956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:49:51.966630 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-f6acce1f-efdf-4906-93a4-39125082d3fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:49:52.057106 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 977/1937] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 30 00:49:51 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 30 00:49:52.076291 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd08944-09fa-4fc6-9961-0889181f5d64 admin admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:49:52.078319 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-edd08944-09fa-4fc6-9961-0889181f5d64 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:49:52.152754 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd08944-09fa-4fc6-9961-0889181f5d64 admin admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:49:52.157906 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a079db5c-1bc2-41d1-8fb1-ee8934f5aa31 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48d928ff7fe24348ac900f09c56acc20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d2387fdf794d4eaef07bbcd7b39f2a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:49:52.159398 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a079db5c-1bc2-41d1-8fb1-ee8934f5aa31 service cinder] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:52.159781 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a079db5c-1bc2-41d1-8fb1-ee8934f5aa31 service cinder] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:52.160150 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a079db5c-1bc2-41d1-8fb1-ee8934f5aa31 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:52.171728 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a079db5c-1bc2-41d1-8fb1-ee8934f5aa31 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:49:52.173452 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a079db5c-1bc2-41d1-8fb1-ee8934f5aa31 service cinder] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:49:52.239388 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 961/1938] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 30 00:49:52 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 00:49:52.291145 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6acce1f-efdf-4906-93a4-39125082d3fd None None] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:49:52.293142 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-f6acce1f-efdf-4906-93a4-39125082d3fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:49:52.412252 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a079db5c-1bc2-41d1-8fb1-ee8934f5aa31 service cinder] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:49:52.414906 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-a079db5c-1bc2-41d1-8fb1-ee8934f5aa31 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:49:52.455394 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6acce1f-efdf-4906-93a4-39125082d3fd None None] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:49:52.473777 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829f7817-d13d-4ac4-ba72-c6ed857d246f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:49:52.475615 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829f7817-d13d-4ac4-ba72-c6ed857d246f admin admin] REQUEST_METHOD: `DELETE` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:52.475615 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829f7817-d13d-4ac4-ba72-c6ed857d246f admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:52.475615 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829f7817-d13d-4ac4-ba72-c6ed857d246f admin admin] PATH_INFO: `/v3/projects/4baf488c61a048ca8dc593e82eaddd86` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:52.478012 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829f7817-d13d-4ac4-ba72-c6ed857d246f admin admin] RBAC: Authorizing `identity:delete_project(project_id=4baf488c61a048ca8dc593e82eaddd86)` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:49:52.480241 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829f7817-d13d-4ac4-ba72-c6ed857d246f admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:49:52.497073 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:49:52.529556 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a079db5c-1bc2-41d1-8fb1-ee8934f5aa31 service cinder] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:49:52.536566 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62097d92-7558-49ae-963f-02afd921b05e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:49:52.537475 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62097d92-7558-49ae-963f-02afd921b05e admin admin] REQUEST_METHOD: `DELETE` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:52.537870 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62097d92-7558-49ae-963f-02afd921b05e admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:52.538294 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62097d92-7558-49ae-963f-02afd921b05e admin admin] PATH_INFO: `/v3/projects/5a4e5812460b49bb8aa6b32a0bef78e5` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:52.540830 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62097d92-7558-49ae-963f-02afd921b05e admin admin] RBAC: Authorizing `identity:delete_project(project_id=5a4e5812460b49bb8aa6b32a0bef78e5)` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:49:52.543414 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62097d92-7558-49ae-963f-02afd921b05e admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:49:52.547991 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:49:52.579067 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-829f7817-d13d-4ac4-ba72-c6ed857d246f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4baf488c61a048ca8dc593e82eaddd86', 'request_id': 'req-829f7817-d13d-4ac4-ba72-c6ed857d246f'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:49:52.594110 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-829f7817-d13d-4ac4-ba72-c6ed857d246f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4baf488c61a048ca8dc593e82eaddd86', 'request_id': 'req-829f7817-d13d-4ac4-ba72-c6ed857d246f'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:49:52.602990 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-829f7817-d13d-4ac4-ba72-c6ed857d246f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4baf488c61a048ca8dc593e82eaddd86', 'request_id': 'req-829f7817-d13d-4ac4-ba72-c6ed857d246f'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:49:52.619809 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-829f7817-d13d-4ac4-ba72-c6ed857d246f admin admin] The token cache is being invalidate because project 4baf488c61a048ca8dc593e82eaddd86 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87956) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 00:49:52.620700 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-829f7817-d13d-4ac4-ba72-c6ed857d246f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:49:52.621989 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-829f7817-d13d-4ac4-ba72-c6ed857d246f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:49:52.625294 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 978/1939] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 30 00:49:52 2022] DELETE /identity/v3/projects/4baf488c61a048ca8dc593e82eaddd86 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 00:49:52.630547 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416a66dd-4a3e-4495-89f4-4fd62bb450b0 None None] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:52.630967 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416a66dd-4a3e-4495-89f4-4fd62bb450b0 None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:52.631405 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416a66dd-4a3e-4495-89f4-4fd62bb450b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:52.645194 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-62097d92-7558-49ae-963f-02afd921b05e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5a4e5812460b49bb8aa6b32a0bef78e5', 'request_id': 'req-62097d92-7558-49ae-963f-02afd921b05e'} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:49:52.662731 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-62097d92-7558-49ae-963f-02afd921b05e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5a4e5812460b49bb8aa6b32a0bef78e5', 'request_id': 'req-62097d92-7558-49ae-963f-02afd921b05e'} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:49:52.662946 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.auth.core [None req-416a66dd-4a3e-4495-89f4-4fd62bb450b0 None None] MFA Rules not processed for user `eb55b6cbca4945abb21b0e49eb745e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=87956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:49:52.664602 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-416a66dd-4a3e-4495-89f4-4fd62bb450b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:49:52.691830 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-62097d92-7558-49ae-963f-02afd921b05e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5a4e5812460b49bb8aa6b32a0bef78e5', 'request_id': 'req-62097d92-7558-49ae-963f-02afd921b05e'} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:49:52.706750 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-62097d92-7558-49ae-963f-02afd921b05e admin admin] The token cache is being invalidate because project 5a4e5812460b49bb8aa6b32a0bef78e5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87955) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 00:49:52.707448 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-62097d92-7558-49ae-963f-02afd921b05e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:49:52.708300 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-62097d92-7558-49ae-963f-02afd921b05e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:49:52.709911 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 962/1940] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 30 00:49:52 2022] DELETE /identity/v3/projects/5a4e5812460b49bb8aa6b32a0bef78e5 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 00:49:52.714960 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a41cbe-8fc6-4936-8ba6-227bb5ce8de1 None None] REQUEST_METHOD: `POST` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:52.715409 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a41cbe-8fc6-4936-8ba6-227bb5ce8de1 None None] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:52.716191 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a41cbe-8fc6-4936-8ba6-227bb5ce8de1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:52.746277 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.auth.core [None req-67a41cbe-8fc6-4936-8ba6-227bb5ce8de1 None None] MFA Rules not processed for user `eb55b6cbca4945abb21b0e49eb745e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=87955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:49:52.747594 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-67a41cbe-8fc6-4936-8ba6-227bb5ce8de1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:49:52.781803 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 979/1941] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 30 00:49:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:49:52.790787 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0670624-fa05-41e1-aed0-21adf39eaa8c None None] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:52.791067 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0670624-fa05-41e1-aed0-21adf39eaa8c None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:52.791366 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0670624-fa05-41e1-aed0-21adf39eaa8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:52.814547 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.auth.core [None req-a0670624-fa05-41e1-aed0-21adf39eaa8c None None] MFA Rules not processed for user `eb55b6cbca4945abb21b0e49eb745e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=87956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:49:52.815712 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-a0670624-fa05-41e1-aed0-21adf39eaa8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:49:52.818586 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 963/1942] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 30 00:49:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:49:52.824307 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 980/1943] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 30 00:49:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 30 00:49:52.826875 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332c7d4c-5139-451f-88c4-290d62fd3836 None None] REQUEST_METHOD: `POST` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:52.827160 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332c7d4c-5139-451f-88c4-290d62fd3836 None None] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:52.827468 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332c7d4c-5139-451f-88c4-290d62fd3836 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:52.828460 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0670624-fa05-41e1-aed0-21adf39eaa8c None None] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:49:52.839369 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0670624-fa05-41e1-aed0-21adf39eaa8c None None] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:49:52.844328 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9a39b6-d0dc-48e5-b76e-e13a7554342d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:49:52.845138 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9a39b6-d0dc-48e5-b76e-e13a7554342d admin admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:52.845485 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9a39b6-d0dc-48e5-b76e-e13a7554342d admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:52.845854 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9a39b6-d0dc-48e5-b76e-e13a7554342d admin admin] PATH_INFO: `/v3/domains` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:52.846562 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9a39b6-d0dc-48e5-b76e-e13a7554342d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87956) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:49:52.847065 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9a39b6-d0dc-48e5-b76e-e13a7554342d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:49:52.848190 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.auth.core [None req-332c7d4c-5139-451f-88c4-290d62fd3836 None None] MFA Rules not processed for user `eb55b6cbca4945abb21b0e49eb745e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=87955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:49:52.848830 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9a39b6-d0dc-48e5-b76e-e13a7554342d admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:49:52.849411 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-332c7d4c-5139-451f-88c4-290d62fd3836 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:49:52.860135 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 964/1944] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 30 00:49:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:49:52.865367 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 981/1945] 10.222.0.42 () {58 vars in 1153 bytes} [Sun Oct 30 00:49:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:49:52.865939 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332c7d4c-5139-451f-88c4-290d62fd3836 None None] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:49:52.866479 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9a39b6-d0dc-48e5-b76e-e13a7554342d admin admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:49:52.876977 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332c7d4c-5139-451f-88c4-290d62fd3836 None None] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:49:52.878126 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9a39b6-d0dc-48e5-b76e-e13a7554342d admin admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:49:52.882395 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bac243a-1695-4d0b-a1c2-8366ede44667 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:49:52.883008 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bac243a-1695-4d0b-a1c2-8366ede44667 admin admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:52.883325 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bac243a-1695-4d0b-a1c2-8366ede44667 admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:52.883446 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c73f4dc-835c-4c49-a404-c251161bf934 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:49:52.883597 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bac243a-1695-4d0b-a1c2-8366ede44667 admin admin] PATH_INFO: `/v3/domains` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:52.884012 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c73f4dc-835c-4c49-a404-c251161bf934 admin admin] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:52.884330 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c73f4dc-835c-4c49-a404-c251161bf934 admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:52.884452 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bac243a-1695-4d0b-a1c2-8366ede44667 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:49:52.884616 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c73f4dc-835c-4c49-a404-c251161bf934 admin admin] PATH_INFO: `/v3/projects` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:52.884725 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bac243a-1695-4d0b-a1c2-8366ede44667 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:49:52.885218 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c73f4dc-835c-4c49-a404-c251161bf934 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:49:52.886325 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bac243a-1695-4d0b-a1c2-8366ede44667 admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:49:52.887122 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c73f4dc-835c-4c49-a404-c251161bf934 admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:49:52.901648 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 965/1946] 10.222.0.42 () {58 vars in 1153 bytes} [Sun Oct 30 00:49:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 30 00:49:52.906416 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bac243a-1695-4d0b-a1c2-8366ede44667 admin admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:49:52.917978 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bac243a-1695-4d0b-a1c2-8366ede44667 admin admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:49:52.920570 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 982/1947] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 30 00:49:52 2022] POST /identity/v3/projects => generated 397 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 00:49:52.924856 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c73f4dc-835c-4c49-a404-c251161bf934 admin admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:49:52.926339 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bcb93c-6833-4149-8527-f88a4059fe01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:49:52.926947 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bcb93c-6833-4149-8527-f88a4059fe01 admin admin] REQUEST_METHOD: `POST` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:52.927248 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bcb93c-6833-4149-8527-f88a4059fe01 admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:52.927512 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bcb93c-6833-4149-8527-f88a4059fe01 admin admin] PATH_INFO: `/v3/projects` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:52.928227 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4bcb93c-6833-4149-8527-f88a4059fe01 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:49:52.930162 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4bcb93c-6833-4149-8527-f88a4059fe01 admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:49:52.963775 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 966/1948] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 30 00:49:52 2022] POST /identity/v3/projects => generated 387 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 30 00:49:52.968347 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bcb93c-6833-4149-8527-f88a4059fe01 admin admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:49:53.015353 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c73f4dc-835c-4c49-a404-c251161bf934 admin admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:49:53.032146 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:49:53.061329 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bcb93c-6833-4149-8527-f88a4059fe01 admin admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:49:53.068310 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e5797f-4706-459d-bf71-0176fb1e12b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:49:53.069175 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e5797f-4706-459d-bf71-0176fb1e12b2 admin admin] REQUEST_METHOD: `POST` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:53.069505 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e5797f-4706-459d-bf71-0176fb1e12b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:53.070058 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e5797f-4706-459d-bf71-0176fb1e12b2 admin admin] PATH_INFO: `/v3/users` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:53.070832 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e5797f-4706-459d-bf71-0176fb1e12b2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:49:53.074219 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e5797f-4706-459d-bf71-0176fb1e12b2 admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:49:53.084581 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:49:53.105620 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 967/1949] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 30 00:49:52 2022] POST /identity/v3/users => generated 294 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 00:49:53.109917 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e5797f-4706-459d-bf71-0176fb1e12b2 admin admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:49:53.120784 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e5797f-4706-459d-bf71-0176fb1e12b2 admin admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:49:53.126090 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd783fc-c687-413f-a81e-6237f30bd80a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:49:53.126703 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd783fc-c687-413f-a81e-6237f30bd80a admin admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:53.126980 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd783fc-c687-413f-a81e-6237f30bd80a admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:53.127285 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd783fc-c687-413f-a81e-6237f30bd80a admin admin] PATH_INFO: `/v3/roles` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:53.127936 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd783fc-c687-413f-a81e-6237f30bd80a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:49:53.129694 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd783fc-c687-413f-a81e-6237f30bd80a admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:49:53.137869 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb549bf-2e9f-4084-80f8-1b6b33c108d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:49:53.138685 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb549bf-2e9f-4084-80f8-1b6b33c108d9 admin admin] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:53.138978 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb549bf-2e9f-4084-80f8-1b6b33c108d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:53.139289 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb549bf-2e9f-4084-80f8-1b6b33c108d9 admin admin] PATH_INFO: `/v3/users` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:53.140067 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb549bf-2e9f-4084-80f8-1b6b33c108d9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:49:53.142247 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb549bf-2e9f-4084-80f8-1b6b33c108d9 admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:49:53.149328 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 968/1950] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 30 00:49:53 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 30 00:49:53.151017 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd783fc-c687-413f-a81e-6237f30bd80a admin admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:49:53.167959 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd783fc-c687-413f-a81e-6237f30bd80a admin admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:49:53.170120 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 983/1951] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 30 00:49:52 2022] POST /identity/v3/users => generated 299 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 00:49:53.174655 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb549bf-2e9f-4084-80f8-1b6b33c108d9 admin admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:49:53.178630 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf470fb-b96c-4027-89f8-e52d47ebe3e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:49:53.179343 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf470fb-b96c-4027-89f8-e52d47ebe3e6 admin admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:53.179829 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf470fb-b96c-4027-89f8-e52d47ebe3e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:53.180157 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf470fb-b96c-4027-89f8-e52d47ebe3e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:53.182720 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf470fb-b96c-4027-89f8-e52d47ebe3e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:49:53.184470 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf470fb-b96c-4027-89f8-e52d47ebe3e6 admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:49:53.184995 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb549bf-2e9f-4084-80f8-1b6b33c108d9 admin admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:49:53.189953 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1a435f-4a84-45b5-8534-d2c8263f7812 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:49:53.190560 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1a435f-4a84-45b5-8534-d2c8263f7812 admin admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:53.190834 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1a435f-4a84-45b5-8534-d2c8263f7812 admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:53.191103 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1a435f-4a84-45b5-8534-d2c8263f7812 admin admin] PATH_INFO: `/v3/roles` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:53.191843 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1a435f-4a84-45b5-8534-d2c8263f7812 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:49:53.194033 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1a435f-4a84-45b5-8534-d2c8263f7812 admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:49:53.199788 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 969/1952] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 30 00:49:53 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 00:49:53.205240 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf470fb-b96c-4027-89f8-e52d47ebe3e6 admin admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:49:53.208161 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 984/1953] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 30 00:49:53 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 00:49:53.215320 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1a435f-4a84-45b5-8534-d2c8263f7812 admin admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:49:53.220395 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf470fb-b96c-4027-89f8-e52d47ebe3e6 admin admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:49:53.225234 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd8bb51-450e-46f7-a019-fec201fc0093 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:49:53.225969 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd8bb51-450e-46f7-a019-fec201fc0093 admin admin] REQUEST_METHOD: `PUT` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:53.226309 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd8bb51-450e-46f7-a019-fec201fc0093 admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:53.226659 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd8bb51-450e-46f7-a019-fec201fc0093 admin admin] PATH_INFO: `/v3/projects/c369b95dde8a4946a475875229631658/users/9e280f6547f847b79f4bf538eecc1854/roles/1c93019874174c4b91118d9ce2347e47` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:53.237005 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1a435f-4a84-45b5-8534-d2c8263f7812 admin admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:49:53.242326 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a953a45-e22e-4af2-8a1e-b2ceffa8fbc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:49:53.242930 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a953a45-e22e-4af2-8a1e-b2ceffa8fbc0 admin admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:53.243217 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a953a45-e22e-4af2-8a1e-b2ceffa8fbc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:53.243522 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a953a45-e22e-4af2-8a1e-b2ceffa8fbc0 admin admin] PATH_INFO: `/v3/roles` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:53.244030 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd8bb51-450e-46f7-a019-fec201fc0093 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c369b95dde8a4946a475875229631658, user_id=9e280f6547f847b79f4bf538eecc1854, role_id=1c93019874174c4b91118d9ce2347e47)` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:49:53.244143 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a953a45-e22e-4af2-8a1e-b2ceffa8fbc0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:49:53.245825 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a953a45-e22e-4af2-8a1e-b2ceffa8fbc0 admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:49:53.246678 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd8bb51-450e-46f7-a019-fec201fc0093 admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:49:53.260943 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 985/1954] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 30 00:49:53 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 00:49:53.261383 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 970/1955] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 30 00:49:53 2022] PUT /identity/v3/projects/c369b95dde8a4946a475875229631658/users/9e280f6547f847b79f4bf538eecc1854/roles/1c93019874174c4b91118d9ce2347e47 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 00:49:53.262048 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a953a45-e22e-4af2-8a1e-b2ceffa8fbc0 admin admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:49:53.272248 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a953a45-e22e-4af2-8a1e-b2ceffa8fbc0 admin admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:49:53.272710 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4649d63-f7d1-41a5-ae23-3a38aa213fb3 None None] REQUEST_METHOD: `POST` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:53.272996 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4649d63-f7d1-41a5-ae23-3a38aa213fb3 None None] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:53.273270 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4649d63-f7d1-41a5-ae23-3a38aa213fb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:53.304636 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.auth.core [None req-b4649d63-f7d1-41a5-ae23-3a38aa213fb3 None None] MFA Rules not processed for user `9e280f6547f847b79f4bf538eecc1854`. Rule list: `[]` (Enabled: `True`). {{(pid=87955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:49:53.306862 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-b4649d63-f7d1-41a5-ae23-3a38aa213fb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:49:53.343596 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd188981-9799-4521-adfa-5f42abb40afd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:49:53.344269 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd188981-9799-4521-adfa-5f42abb40afd admin admin] REQUEST_METHOD: `PUT` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:53.344609 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd188981-9799-4521-adfa-5f42abb40afd admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:53.344919 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd188981-9799-4521-adfa-5f42abb40afd admin admin] PATH_INFO: `/v3/projects/3fd90f60d6324c58803da77dbf01f240/users/58d1fc4ac62e4d59845baea6c3592763/roles/1c93019874174c4b91118d9ce2347e47` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:53.361698 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd188981-9799-4521-adfa-5f42abb40afd admin admin] RBAC: Authorizing `identity:create_grant(project_id=3fd90f60d6324c58803da77dbf01f240, user_id=58d1fc4ac62e4d59845baea6c3592763, role_id=1c93019874174c4b91118d9ce2347e47)` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:49:53.364386 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd188981-9799-4521-adfa-5f42abb40afd admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:49:53.381817 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 986/1956] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 30 00:49:53 2022] PUT /identity/v3/projects/3fd90f60d6324c58803da77dbf01f240/users/58d1fc4ac62e4d59845baea6c3592763/roles/1c93019874174c4b91118d9ce2347e47 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 00:49:53.388407 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 971/1957] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 30 00:49:53 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:49:53.393136 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd188981-9799-4521-adfa-5f42abb40afd admin admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:49:53.396529 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6d2d1d-de73-4fe2-bff8-e144aa59d16c None None] REQUEST_METHOD: `POST` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:53.397010 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6d2d1d-de73-4fe2-bff8-e144aa59d16c None None] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:53.397462 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6d2d1d-de73-4fe2-bff8-e144aa59d16c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:53.428820 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.auth.core [None req-3f6d2d1d-de73-4fe2-bff8-e144aa59d16c None None] MFA Rules not processed for user `58d1fc4ac62e4d59845baea6c3592763`. Rule list: `[]` (Enabled: `True`). {{(pid=87955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:49:53.430010 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-3f6d2d1d-de73-4fe2-bff8-e144aa59d16c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:49:53.474674 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd188981-9799-4521-adfa-5f42abb40afd admin admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:49:53.479516 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4708a04-654c-45e8-bfd3-69a5772e8783 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:49:53.480216 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4708a04-654c-45e8-bfd3-69a5772e8783 admin admin] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:53.480404 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4708a04-654c-45e8-bfd3-69a5772e8783 admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:53.480819 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4708a04-654c-45e8-bfd3-69a5772e8783 admin admin] PATH_INFO: `/v3/projects` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:53.481368 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4708a04-654c-45e8-bfd3-69a5772e8783 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:49:53.483463 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4708a04-654c-45e8-bfd3-69a5772e8783 admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:49:53.506566 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:49:53.514594 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 987/1958] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 30 00:49:53 2022] POST /identity/v3/projects => generated 385 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 00:49:53.519157 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4708a04-654c-45e8-bfd3-69a5772e8783 admin admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:49:53.521537 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 972/1959] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 30 00:49:53 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:49:53.524844 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:49:53.528184 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6d2d1d-de73-4fe2-bff8-e144aa59d16c None None] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:49:53.529719 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-3f6d2d1d-de73-4fe2-bff8-e144aa59d16c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:49:53.592331 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6d2d1d-de73-4fe2-bff8-e144aa59d16c None None] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:49:53.593046 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4708a04-654c-45e8-bfd3-69a5772e8783 admin admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:49:53.598917 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fd1c92-11fa-4633-ae4f-eaa0cb704500 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:49:53.599838 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fd1c92-11fa-4633-ae4f-eaa0cb704500 admin admin] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:53.600132 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fd1c92-11fa-4633-ae4f-eaa0cb704500 admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:53.600485 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fd1c92-11fa-4633-ae4f-eaa0cb704500 admin admin] PATH_INFO: `/v3/users` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:53.601195 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37fd1c92-11fa-4633-ae4f-eaa0cb704500 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:49:53.603233 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37fd1c92-11fa-4633-ae4f-eaa0cb704500 admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:49:53.628251 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 988/1960] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 30 00:49:53 2022] POST /identity/v3/users => generated 299 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 00:49:53.631938 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fd1c92-11fa-4633-ae4f-eaa0cb704500 admin admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:49:53.644272 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fd1c92-11fa-4633-ae4f-eaa0cb704500 admin admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:49:53.648282 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791c4f1a-9190-447c-86d7-4cd12369316a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48d928ff7fe24348ac900f09c56acc20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d2387fdf794d4eaef07bbcd7b39f2a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:49:53.648959 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791c4f1a-9190-447c-86d7-4cd12369316a service cinder] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:53.649298 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791c4f1a-9190-447c-86d7-4cd12369316a service cinder] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:53.649649 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791c4f1a-9190-447c-86d7-4cd12369316a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:53.650131 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ccfc32-e569-4aee-9117-f573306dae93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:49:53.651178 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ccfc32-e569-4aee-9117-f573306dae93 admin admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:53.651521 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ccfc32-e569-4aee-9117-f573306dae93 admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:53.651664 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ccfc32-e569-4aee-9117-f573306dae93 admin admin] PATH_INFO: `/v3/roles` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:53.652322 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ccfc32-e569-4aee-9117-f573306dae93 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:49:53.653979 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ccfc32-e569-4aee-9117-f573306dae93 admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:49:53.665397 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 989/1961] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 30 00:49:53 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 30 00:49:53.669709 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ccfc32-e569-4aee-9117-f573306dae93 admin admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:49:53.682197 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ccfc32-e569-4aee-9117-f573306dae93 admin admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:49:53.688088 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1220e188-b13f-4183-a755-15c5cbe45f9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:49:53.688826 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1220e188-b13f-4183-a755-15c5cbe45f9b admin admin] REQUEST_METHOD: `PUT` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:53.689170 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1220e188-b13f-4183-a755-15c5cbe45f9b admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:53.689513 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1220e188-b13f-4183-a755-15c5cbe45f9b admin admin] PATH_INFO: `/v3/projects/a11410721fa9444fbd9aee61d165fb31/users/c39feba86a8a45d4bc267eb614e2845e/roles/6ccaa8c11f29456fb4e4eeccb21616c7` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:53.705781 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1220e188-b13f-4183-a755-15c5cbe45f9b admin admin] RBAC: Authorizing `identity:create_grant(project_id=a11410721fa9444fbd9aee61d165fb31, user_id=c39feba86a8a45d4bc267eb614e2845e, role_id=6ccaa8c11f29456fb4e4eeccb21616c7)` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:49:53.708480 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1220e188-b13f-4183-a755-15c5cbe45f9b admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:49:53.716551 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791c4f1a-9190-447c-86d7-4cd12369316a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:49:53.718079 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791c4f1a-9190-447c-86d7-4cd12369316a service cinder] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:49:53.732711 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 990/1962] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 30 00:49:53 2022] PUT /identity/v3/projects/a11410721fa9444fbd9aee61d165fb31/users/c39feba86a8a45d4bc267eb614e2845e/roles/6ccaa8c11f29456fb4e4eeccb21616c7 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 00:49:53.735279 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 973/1963] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 30 00:49:53 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 30 00:49:53.736832 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1220e188-b13f-4183-a755-15c5cbe45f9b admin admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:49:53.818984 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1220e188-b13f-4183-a755-15c5cbe45f9b admin admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:49:53.830291 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d3a708-d80c-4304-a8b4-56edbf3b95aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:49:53.830885 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d3a708-d80c-4304-a8b4-56edbf3b95aa admin admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:53.831157 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d3a708-d80c-4304-a8b4-56edbf3b95aa admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:53.831419 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d3a708-d80c-4304-a8b4-56edbf3b95aa admin admin] PATH_INFO: `/v3/roles` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:53.832077 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d3a708-d80c-4304-a8b4-56edbf3b95aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:49:53.834080 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d3a708-d80c-4304-a8b4-56edbf3b95aa admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:49:53.847240 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 991/1964] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 30 00:49:53 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 00:49:53.849487 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791c4f1a-9190-447c-86d7-4cd12369316a service cinder] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:49:53.877213 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791c4f1a-9190-447c-86d7-4cd12369316a service cinder] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:49:53.882533 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69dc7dbd-ad1d-4b4c-b319-dce09d4260a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:49:53.883375 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dc7dbd-ad1d-4b4c-b319-dce09d4260a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:53.883713 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dc7dbd-ad1d-4b4c-b319-dce09d4260a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:53.884160 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dc7dbd-ad1d-4b4c-b319-dce09d4260a0 admin admin] PATH_INFO: `/v3/projects/a11410721fa9444fbd9aee61d165fb31/users/c39feba86a8a45d4bc267eb614e2845e/roles/6ccaa8c11f29456fb4e4eeccb21616c7` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:53.886263 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69dc7dbd-ad1d-4b4c-b319-dce09d4260a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a11410721fa9444fbd9aee61d165fb31, user_id=c39feba86a8a45d4bc267eb614e2845e, role_id=6ccaa8c11f29456fb4e4eeccb21616c7)` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:49:53.889044 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69dc7dbd-ad1d-4b4c-b319-dce09d4260a0 admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:49:53.907290 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 974/1965] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 30 00:49:53 2022] PUT /identity/v3/projects/a11410721fa9444fbd9aee61d165fb31/users/c39feba86a8a45d4bc267eb614e2845e/roles/6ccaa8c11f29456fb4e4eeccb21616c7 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 00:49:53.915004 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df588030-377b-42db-8c70-e28f9a25d6b0 None None] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:53.915378 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df588030-377b-42db-8c70-e28f9a25d6b0 None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:53.915647 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df588030-377b-42db-8c70-e28f9a25d6b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:53.945122 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.auth.core [None req-df588030-377b-42db-8c70-e28f9a25d6b0 None None] MFA Rules not processed for user `c39feba86a8a45d4bc267eb614e2845e`. Rule list: `[]` (Enabled: `True`). {{(pid=87956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:49:53.946846 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-df588030-377b-42db-8c70-e28f9a25d6b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:49:54.010945 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:49:54.076314 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 992/1966] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 30 00:49:53 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:49:54.095444 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69dc7dbd-ad1d-4b4c-b319-dce09d4260a0 admin admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:49:54.159856 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69dc7dbd-ad1d-4b4c-b319-dce09d4260a0 admin admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:49:54.163765 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd222a8-534c-4b95-aebe-1669d6e1dca2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48d928ff7fe24348ac900f09c56acc20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d2387fdf794d4eaef07bbcd7b39f2a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:49:54.164406 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd222a8-534c-4b95-aebe-1669d6e1dca2 service cinder] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:54.164685 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd222a8-534c-4b95-aebe-1669d6e1dca2 service cinder] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:54.164950 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd222a8-534c-4b95-aebe-1669d6e1dca2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:54.175658 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd222a8-534c-4b95-aebe-1669d6e1dca2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:49:54.177085 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd222a8-534c-4b95-aebe-1669d6e1dca2 service cinder] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:49:54.181075 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:49:54.188345 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 975/1967] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 30 00:49:54 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 00:49:54.217902 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df588030-377b-42db-8c70-e28f9a25d6b0 None None] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:49:54.262899 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd222a8-534c-4b95-aebe-1669d6e1dca2 service cinder] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:49:54.264393 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-4fd222a8-534c-4b95-aebe-1669d6e1dca2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:49:54.299227 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df588030-377b-42db-8c70-e28f9a25d6b0 None None] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:49:54.304179 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bd2436-e896-4631-9bc2-1fb324ec122a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:49:54.304985 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bd2436-e896-4631-9bc2-1fb324ec122a admin admin] REQUEST_METHOD: `DELETE` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:54.305949 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bd2436-e896-4631-9bc2-1fb324ec122a admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:54.305949 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bd2436-e896-4631-9bc2-1fb324ec122a admin admin] PATH_INFO: `/v3/users/9e280f6547f847b79f4bf538eecc1854` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:54.307718 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8bd2436-e896-4631-9bc2-1fb324ec122a admin admin] RBAC: Authorizing `identity:delete_user(user_id=9e280f6547f847b79f4bf538eecc1854)` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:49:54.311077 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8bd2436-e896-4631-9bc2-1fb324ec122a admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:49:54.341488 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd222a8-534c-4b95-aebe-1669d6e1dca2 service cinder] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:49:54.347726 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b745e3d9-994b-4f06-acb1-a62b21908b12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:49:54.348517 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b745e3d9-994b-4f06-acb1-a62b21908b12 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:54.348840 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b745e3d9-994b-4f06-acb1-a62b21908b12 admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:54.349207 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b745e3d9-994b-4f06-acb1-a62b21908b12 admin admin] PATH_INFO: `/v3/users/6980cb62f44e47be98572ec35d3aa602` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:54.350541 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b745e3d9-994b-4f06-acb1-a62b21908b12 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6980cb62f44e47be98572ec35d3aa602)` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:49:54.352820 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b745e3d9-994b-4f06-acb1-a62b21908b12 admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:49:54.382041 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-c8bd2436-e896-4631-9bc2-1fb324ec122a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9e280f6547f847b79f4bf538eecc1854'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:49:54.382759 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-c8bd2436-e896-4631-9bc2-1fb324ec122a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9e280f6547f847b79f4bf538eecc1854'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:49:54.403147 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-c8bd2436-e896-4631-9bc2-1fb324ec122a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9e280f6547f847b79f4bf538eecc1854'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:49:54.424529 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-c8bd2436-e896-4631-9bc2-1fb324ec122a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9e280f6547f847b79f4bf538eecc1854'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:49:54.434777 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-c8bd2436-e896-4631-9bc2-1fb324ec122a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9e280f6547f847b79f4bf538eecc1854'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:49:54.438322 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-b745e3d9-994b-4f06-acb1-a62b21908b12 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6980cb62f44e47be98572ec35d3aa602'} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:49:54.439192 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-b745e3d9-994b-4f06-acb1-a62b21908b12 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6980cb62f44e47be98572ec35d3aa602'} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:49:54.441969 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 993/1968] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 30 00:49:54 2022] DELETE /identity/v3/users/9e280f6547f847b79f4bf538eecc1854 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 00:49:54.448935 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640a2afa-cb20-485b-8f40-cfde48037607 None None] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:54.449288 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640a2afa-cb20-485b-8f40-cfde48037607 None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:54.449580 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-b745e3d9-994b-4f06-acb1-a62b21908b12 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6980cb62f44e47be98572ec35d3aa602'} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:49:54.449706 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640a2afa-cb20-485b-8f40-cfde48037607 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:54.450413 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-b745e3d9-994b-4f06-acb1-a62b21908b12 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6980cb62f44e47be98572ec35d3aa602'} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:49:54.471418 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.auth.core [None req-640a2afa-cb20-485b-8f40-cfde48037607 None None] MFA Rules not processed for user `eb55b6cbca4945abb21b0e49eb745e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=87956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:49:54.472704 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-640a2afa-cb20-485b-8f40-cfde48037607 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:49:54.472994 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-b745e3d9-994b-4f06-acb1-a62b21908b12 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6980cb62f44e47be98572ec35d3aa602'} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:49:54.493211 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 976/1969] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 30 00:49:54 2022] DELETE /identity/v3/users/6980cb62f44e47be98572ec35d3aa602 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 00:49:54.498079 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8982ee01-3717-4ecb-bc6a-a369de5e14d6 None None] REQUEST_METHOD: `POST` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:54.498361 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8982ee01-3717-4ecb-bc6a-a369de5e14d6 None None] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:54.498633 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8982ee01-3717-4ecb-bc6a-a369de5e14d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:54.522470 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.auth.core [None req-8982ee01-3717-4ecb-bc6a-a369de5e14d6 None None] MFA Rules not processed for user `eb55b6cbca4945abb21b0e49eb745e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=87955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:49:54.524014 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-8982ee01-3717-4ecb-bc6a-a369de5e14d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:49:54.535849 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:49:54.549367 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 994/1970] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 30 00:49:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:49:54.560886 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640a2afa-cb20-485b-8f40-cfde48037607 None None] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:49:54.562737 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-640a2afa-cb20-485b-8f40-cfde48037607 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:49:54.591854 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 977/1971] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 30 00:49:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 30 00:49:54.601726 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8982ee01-3717-4ecb-bc6a-a369de5e14d6 None None] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:49:54.603476 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-8982ee01-3717-4ecb-bc6a-a369de5e14d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:49:54.624300 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:49:54.630444 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640a2afa-cb20-485b-8f40-cfde48037607 None None] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:49:54.679220 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8982ee01-3717-4ecb-bc6a-a369de5e14d6 None None] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:49:54.682854 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a3d669-91c2-449d-a059-a811ab636e0b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5693f186c6ad4d9394f02ee3477cdcd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d2387fdf794d4eaef07bbcd7b39f2a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:49:54.683489 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a3d669-91c2-449d-a059-a811ab636e0b service neutron] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:54.683768 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a3d669-91c2-449d-a059-a811ab636e0b service neutron] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:54.684034 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a3d669-91c2-449d-a059-a811ab636e0b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:54.686105 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d00dc3-546d-4d6a-9307-928b75c041c6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5693f186c6ad4d9394f02ee3477cdcd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d2387fdf794d4eaef07bbcd7b39f2a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:49:54.686713 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d00dc3-546d-4d6a-9307-928b75c041c6 service neutron] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:54.686990 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d00dc3-546d-4d6a-9307-928b75c041c6 service neutron] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:54.687282 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d00dc3-546d-4d6a-9307-928b75c041c6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:54.692945 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a3d669-91c2-449d-a059-a811ab636e0b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:49:54.694354 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a3d669-91c2-449d-a059-a811ab636e0b service neutron] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:49:54.696463 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d00dc3-546d-4d6a-9307-928b75c041c6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:49:54.697869 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d00dc3-546d-4d6a-9307-928b75c041c6 service neutron] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:49:54.704457 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 978/1972] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 30 00:49:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 30 00:49:54.707364 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 995/1973] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 30 00:49:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 30 00:49:54.999538 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a3d669-91c2-449d-a059-a811ab636e0b service neutron] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:49:55.000963 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-40a3d669-91c2-449d-a059-a811ab636e0b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:49:55.025710 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a3d669-91c2-449d-a059-a811ab636e0b service neutron] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:49:55.027914 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d00dc3-546d-4d6a-9307-928b75c041c6 service neutron] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:49:55.029919 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-82d00dc3-546d-4d6a-9307-928b75c041c6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:49:55.032571 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909ac744-47c4-41b1-b026-41fffe3dd869 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:49:55.033243 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909ac744-47c4-41b1-b026-41fffe3dd869 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:55.033517 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909ac744-47c4-41b1-b026-41fffe3dd869 admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:55.033787 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909ac744-47c4-41b1-b026-41fffe3dd869 admin admin] PATH_INFO: `/v3/projects/c369b95dde8a4946a475875229631658` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:55.035061 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909ac744-47c4-41b1-b026-41fffe3dd869 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c369b95dde8a4946a475875229631658)` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:49:55.037626 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909ac744-47c4-41b1-b026-41fffe3dd869 admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:49:55.052957 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d00dc3-546d-4d6a-9307-928b75c041c6 service neutron] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:49:55.063315 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1e21de-e810-40ff-ada3-b1fce2bafa2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:49:55.064168 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1e21de-e810-40ff-ada3-b1fce2bafa2f admin admin] REQUEST_METHOD: `DELETE` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:55.064512 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1e21de-e810-40ff-ada3-b1fce2bafa2f admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:55.064850 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1e21de-e810-40ff-ada3-b1fce2bafa2f admin admin] PATH_INFO: `/v3/projects/db34efe7e7214964aa8fb92fb924829f` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:55.067296 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1e21de-e810-40ff-ada3-b1fce2bafa2f admin admin] RBAC: Authorizing `identity:delete_project(project_id=db34efe7e7214964aa8fb92fb924829f)` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:49:55.069713 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1e21de-e810-40ff-ada3-b1fce2bafa2f admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:49:55.130430 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-909ac744-47c4-41b1-b026-41fffe3dd869 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c369b95dde8a4946a475875229631658', 'request_id': 'req-909ac744-47c4-41b1-b026-41fffe3dd869'} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:49:55.140294 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-909ac744-47c4-41b1-b026-41fffe3dd869 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c369b95dde8a4946a475875229631658', 'request_id': 'req-909ac744-47c4-41b1-b026-41fffe3dd869'} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:49:55.157846 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-909ac744-47c4-41b1-b026-41fffe3dd869 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c369b95dde8a4946a475875229631658', 'request_id': 'req-909ac744-47c4-41b1-b026-41fffe3dd869'} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:49:55.163926 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-6d1e21de-e810-40ff-ada3-b1fce2bafa2f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'db34efe7e7214964aa8fb92fb924829f', 'request_id': 'req-6d1e21de-e810-40ff-ada3-b1fce2bafa2f'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:49:55.177410 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-6d1e21de-e810-40ff-ada3-b1fce2bafa2f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'db34efe7e7214964aa8fb92fb924829f', 'request_id': 'req-6d1e21de-e810-40ff-ada3-b1fce2bafa2f'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:49:55.180776 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-909ac744-47c4-41b1-b026-41fffe3dd869 admin admin] The token cache is being invalidate because project c369b95dde8a4946a475875229631658 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87955) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 00:49:55.181277 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-909ac744-47c4-41b1-b026-41fffe3dd869 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:49:55.181756 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-909ac744-47c4-41b1-b026-41fffe3dd869 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:49:55.183567 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 979/1974] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 30 00:49:54 2022] DELETE /identity/v3/projects/c369b95dde8a4946a475875229631658 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 00:49:55.186394 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-6d1e21de-e810-40ff-ada3-b1fce2bafa2f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'db34efe7e7214964aa8fb92fb924829f', 'request_id': 'req-6d1e21de-e810-40ff-ada3-b1fce2bafa2f'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:49:55.187797 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909ac744-47c4-41b1-b026-41fffe3dd869 admin admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:49:55.189147 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-909ac744-47c4-41b1-b026-41fffe3dd869 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:49:55.199549 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-6d1e21de-e810-40ff-ada3-b1fce2bafa2f admin admin] The token cache is being invalidate because project db34efe7e7214964aa8fb92fb924829f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87956) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 00:49:55.199841 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-6d1e21de-e810-40ff-ada3-b1fce2bafa2f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:49:55.200482 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-6d1e21de-e810-40ff-ada3-b1fce2bafa2f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:49:55.201999 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 996/1975] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 30 00:49:55 2022] DELETE /identity/v3/projects/db34efe7e7214964aa8fb92fb924829f => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 00:49:55.207078 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f83b58-19b4-426e-8f06-ce613d90bf03 None None] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:55.207373 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f83b58-19b4-426e-8f06-ce613d90bf03 None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:55.207782 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f83b58-19b4-426e-8f06-ce613d90bf03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:55.228415 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.auth.core [None req-24f83b58-19b4-426e-8f06-ce613d90bf03 None None] MFA Rules not processed for user `eb55b6cbca4945abb21b0e49eb745e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=87956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:49:55.230686 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-24f83b58-19b4-426e-8f06-ce613d90bf03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:49:55.266259 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909ac744-47c4-41b1-b026-41fffe3dd869 admin admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:49:55.274689 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:49:55.307353 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 997/1976] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 30 00:49:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:49:55.316524 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010cc6db-2b1b-42e2-b783-c6365e27d631 None None] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:55.316821 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010cc6db-2b1b-42e2-b783-c6365e27d631 None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:55.317083 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010cc6db-2b1b-42e2-b783-c6365e27d631 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:55.352550 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.auth.core [None req-010cc6db-2b1b-42e2-b783-c6365e27d631 None None] MFA Rules not processed for user `eb55b6cbca4945abb21b0e49eb745e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=87956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:49:55.354737 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-010cc6db-2b1b-42e2-b783-c6365e27d631 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:49:55.366383 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 998/1977] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 30 00:49:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 30 00:49:55.367408 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010cc6db-2b1b-42e2-b783-c6365e27d631 None None] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:49:55.372201 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:49:55.380323 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010cc6db-2b1b-42e2-b783-c6365e27d631 None None] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:49:55.382314 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74364d5-6953-4cbc-896b-32fd9cca9ea0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:49:55.382995 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74364d5-6953-4cbc-896b-32fd9cca9ea0 admin admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:55.383408 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74364d5-6953-4cbc-896b-32fd9cca9ea0 admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:55.383700 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74364d5-6953-4cbc-896b-32fd9cca9ea0 admin admin] PATH_INFO: `/v3/domains` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:55.384472 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74364d5-6953-4cbc-896b-32fd9cca9ea0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87956) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:49:55.384718 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74364d5-6953-4cbc-896b-32fd9cca9ea0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:49:55.386329 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74364d5-6953-4cbc-896b-32fd9cca9ea0 admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:49:55.387612 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c2fba0-d2d4-46aa-b259-352c85a30d65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:49:55.388763 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c2fba0-d2d4-46aa-b259-352c85a30d65 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:55.389119 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c2fba0-d2d4-46aa-b259-352c85a30d65 admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:55.389544 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c2fba0-d2d4-46aa-b259-352c85a30d65 admin admin] PATH_INFO: `/v3/users/c39feba86a8a45d4bc267eb614e2845e` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:55.392427 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c2fba0-d2d4-46aa-b259-352c85a30d65 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c39feba86a8a45d4bc267eb614e2845e)` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:49:55.394845 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c2fba0-d2d4-46aa-b259-352c85a30d65 admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:49:55.399679 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 999/1978] 10.222.0.42 () {58 vars in 1153 bytes} [Sun Oct 30 00:49:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 30 00:49:55.404505 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74364d5-6953-4cbc-896b-32fd9cca9ea0 admin admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:49:55.415176 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74364d5-6953-4cbc-896b-32fd9cca9ea0 admin admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:49:55.419898 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817ce593-c2f4-4935-ad3b-e9d550da7947 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:49:55.420503 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817ce593-c2f4-4935-ad3b-e9d550da7947 admin admin] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:55.420777 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817ce593-c2f4-4935-ad3b-e9d550da7947 admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:55.421045 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817ce593-c2f4-4935-ad3b-e9d550da7947 admin admin] PATH_INFO: `/v3/projects` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:55.421673 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817ce593-c2f4-4935-ad3b-e9d550da7947 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:49:55.423594 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817ce593-c2f4-4935-ad3b-e9d550da7947 admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:49:55.451470 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-10c2fba0-d2d4-46aa-b259-352c85a30d65 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c39feba86a8a45d4bc267eb614e2845e'} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:49:55.452102 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-10c2fba0-d2d4-46aa-b259-352c85a30d65 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c39feba86a8a45d4bc267eb614e2845e'} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:49:55.452706 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 1000/1979] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 30 00:49:55 2022] POST /identity/v3/projects => generated 369 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 30 00:49:55.457004 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817ce593-c2f4-4935-ad3b-e9d550da7947 admin admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:49:55.458999 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-10c2fba0-d2d4-46aa-b259-352c85a30d65 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c39feba86a8a45d4bc267eb614e2845e'} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:49:55.459655 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-10c2fba0-d2d4-46aa-b259-352c85a30d65 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c39feba86a8a45d4bc267eb614e2845e'} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:49:55.472365 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-10c2fba0-d2d4-46aa-b259-352c85a30d65 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c39feba86a8a45d4bc267eb614e2845e'} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:49:55.490287 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 980/1980] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 30 00:49:55 2022] DELETE /identity/v3/users/c39feba86a8a45d4bc267eb614e2845e => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 00:49:55.544638 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817ce593-c2f4-4935-ad3b-e9d550da7947 admin admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:49:55.618081 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9867e5-63ca-482e-b60b-cc90c14cc629 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:49:55.618854 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9867e5-63ca-482e-b60b-cc90c14cc629 admin admin] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:55.619257 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9867e5-63ca-482e-b60b-cc90c14cc629 admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:55.619627 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9867e5-63ca-482e-b60b-cc90c14cc629 admin admin] PATH_INFO: `/v3/users` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:55.620732 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9867e5-63ca-482e-b60b-cc90c14cc629 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:49:55.622479 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9867e5-63ca-482e-b60b-cc90c14cc629 admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:49:55.651999 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 1001/1981] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 30 00:49:55 2022] POST /identity/v3/users => generated 285 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 00:49:55.657353 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c2fba0-d2d4-46aa-b259-352c85a30d65 admin admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:49:55.665136 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-10c2fba0-d2d4-46aa-b259-352c85a30d65 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:49:55.685498 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c2fba0-d2d4-46aa-b259-352c85a30d65 admin admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:49:55.690184 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a4be25-0fc2-4c32-83a7-dcd9c62f84f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:49:55.690803 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a4be25-0fc2-4c32-83a7-dcd9c62f84f9 admin admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:55.691079 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a4be25-0fc2-4c32-83a7-dcd9c62f84f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:55.691390 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a4be25-0fc2-4c32-83a7-dcd9c62f84f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:55.692029 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a4be25-0fc2-4c32-83a7-dcd9c62f84f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:49:55.693629 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a4be25-0fc2-4c32-83a7-dcd9c62f84f9 admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:49:55.704434 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 981/1982] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 30 00:49:55 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 00:49:55.708936 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9867e5-63ca-482e-b60b-cc90c14cc629 admin admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:49:55.720780 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9867e5-63ca-482e-b60b-cc90c14cc629 admin admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:49:55.731173 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17982ccf-df87-402c-8a7c-f65f6fd0c5c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:49:55.731925 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17982ccf-df87-402c-8a7c-f65f6fd0c5c5 admin admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:55.732260 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17982ccf-df87-402c-8a7c-f65f6fd0c5c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:55.732643 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17982ccf-df87-402c-8a7c-f65f6fd0c5c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:55.733309 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17982ccf-df87-402c-8a7c-f65f6fd0c5c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:49:55.734933 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17982ccf-df87-402c-8a7c-f65f6fd0c5c5 admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:49:55.748549 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 1002/1983] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 30 00:49:55 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 00:49:55.752738 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a4be25-0fc2-4c32-83a7-dcd9c62f84f9 admin admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:49:55.763934 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a4be25-0fc2-4c32-83a7-dcd9c62f84f9 admin admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:49:55.771361 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96009023-6518-4434-9a4f-691cbb2317a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:49:55.771361 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96009023-6518-4434-9a4f-691cbb2317a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:55.771361 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96009023-6518-4434-9a4f-691cbb2317a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:55.771361 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96009023-6518-4434-9a4f-691cbb2317a0 admin admin] PATH_INFO: `/v3/projects/bfa5fff67fe64dee90c6efdcc489cd0f/users/71fa0f9151e143dc876d60bf975c2eb9/roles/1c93019874174c4b91118d9ce2347e47` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:55.788678 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96009023-6518-4434-9a4f-691cbb2317a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bfa5fff67fe64dee90c6efdcc489cd0f, user_id=71fa0f9151e143dc876d60bf975c2eb9, role_id=1c93019874174c4b91118d9ce2347e47)` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:49:55.791599 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96009023-6518-4434-9a4f-691cbb2317a0 admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:49:55.806913 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 982/1984] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 30 00:49:55 2022] PUT /identity/v3/projects/bfa5fff67fe64dee90c6efdcc489cd0f/users/71fa0f9151e143dc876d60bf975c2eb9/roles/1c93019874174c4b91118d9ce2347e47 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 00:49:55.817731 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d37b303-2ce5-49e8-877c-1e693b4c5db9 None None] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:55.817966 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d37b303-2ce5-49e8-877c-1e693b4c5db9 None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:55.818250 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d37b303-2ce5-49e8-877c-1e693b4c5db9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:55.851499 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.auth.core [None req-5d37b303-2ce5-49e8-877c-1e693b4c5db9 None None] MFA Rules not processed for user `71fa0f9151e143dc876d60bf975c2eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=87956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:49:55.857626 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-5d37b303-2ce5-49e8-877c-1e693b4c5db9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:49:55.867966 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:49:55.925908 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 1003/1985] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 30 00:49:55 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:49:55.938877 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96009023-6518-4434-9a4f-691cbb2317a0 admin admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:49:55.940811 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-96009023-6518-4434-9a4f-691cbb2317a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:49:56.002061 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96009023-6518-4434-9a4f-691cbb2317a0 admin admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:49:56.006130 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bca5462-ae44-44c8-a50b-71f64f1a09c4 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36a86cf3eaf24b369737b65046142593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d2387fdf794d4eaef07bbcd7b39f2a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:49:56.006736 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bca5462-ae44-44c8-a50b-71f64f1a09c4 service glance] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:56.007008 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bca5462-ae44-44c8-a50b-71f64f1a09c4 service glance] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:56.007374 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bca5462-ae44-44c8-a50b-71f64f1a09c4 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:56.019440 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bca5462-ae44-44c8-a50b-71f64f1a09c4 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:49:56.020935 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bca5462-ae44-44c8-a50b-71f64f1a09c4 service glance] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:49:56.031089 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 983/1986] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 30 00:49:55 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 00:49:56.064736 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d37b303-2ce5-49e8-877c-1e693b4c5db9 None None] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:49:56.066255 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-5d37b303-2ce5-49e8-877c-1e693b4c5db9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:49:56.146716 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d37b303-2ce5-49e8-877c-1e693b4c5db9 None None] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:49:56.151691 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a662606f-6ff0-49b9-ab00-0ecf5f5d2409 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:49:56.152378 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a662606f-6ff0-49b9-ab00-0ecf5f5d2409 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:56.152716 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a662606f-6ff0-49b9-ab00-0ecf5f5d2409 admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:56.153180 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a662606f-6ff0-49b9-ab00-0ecf5f5d2409 admin admin] PATH_INFO: `/v3/projects/a11410721fa9444fbd9aee61d165fb31` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:56.155417 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a662606f-6ff0-49b9-ab00-0ecf5f5d2409 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a11410721fa9444fbd9aee61d165fb31)` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:49:56.157606 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a662606f-6ff0-49b9-ab00-0ecf5f5d2409 admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:49:56.228186 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-a662606f-6ff0-49b9-ab00-0ecf5f5d2409 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a11410721fa9444fbd9aee61d165fb31', 'request_id': 'req-a662606f-6ff0-49b9-ab00-0ecf5f5d2409'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:49:56.251348 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-a662606f-6ff0-49b9-ab00-0ecf5f5d2409 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a11410721fa9444fbd9aee61d165fb31', 'request_id': 'req-a662606f-6ff0-49b9-ab00-0ecf5f5d2409'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:49:56.260114 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-a662606f-6ff0-49b9-ab00-0ecf5f5d2409 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a11410721fa9444fbd9aee61d165fb31', 'request_id': 'req-a662606f-6ff0-49b9-ab00-0ecf5f5d2409'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:49:56.280173 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-a662606f-6ff0-49b9-ab00-0ecf5f5d2409 admin admin] The token cache is being invalidate because project a11410721fa9444fbd9aee61d165fb31 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87956) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 00:49:56.280585 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-a662606f-6ff0-49b9-ab00-0ecf5f5d2409 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:49:56.281916 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-a662606f-6ff0-49b9-ab00-0ecf5f5d2409 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:49:56.283918 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 1004/1987] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 30 00:49:56 2022] DELETE /identity/v3/projects/a11410721fa9444fbd9aee61d165fb31 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 00:49:56.288489 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3777ef-6b51-4d31-b3d4-1acb04cb467a None None] REQUEST_METHOD: `POST` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:56.289393 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3777ef-6b51-4d31-b3d4-1acb04cb467a None None] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:56.289800 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3777ef-6b51-4d31-b3d4-1acb04cb467a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:56.313192 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.auth.core [None req-fd3777ef-6b51-4d31-b3d4-1acb04cb467a None None] MFA Rules not processed for user `eb55b6cbca4945abb21b0e49eb745e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=87955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:49:56.314400 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-fd3777ef-6b51-4d31-b3d4-1acb04cb467a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:49:56.351957 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:49:56.387457 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 984/1988] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 30 00:49:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:49:56.396979 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ad934b-e3c0-495f-b931-d094d3641e5e None None] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:56.397450 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ad934b-e3c0-495f-b931-d094d3641e5e None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:56.397772 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ad934b-e3c0-495f-b931-d094d3641e5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:56.421197 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.auth.core [None req-66ad934b-e3c0-495f-b931-d094d3641e5e None None] MFA Rules not processed for user `eb55b6cbca4945abb21b0e49eb745e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=87956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:49:56.422562 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-66ad934b-e3c0-495f-b931-d094d3641e5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:49:56.450383 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 1005/1989] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 30 00:49:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:49:56.455013 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3777ef-6b51-4d31-b3d4-1acb04cb467a None None] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:49:56.464954 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3777ef-6b51-4d31-b3d4-1acb04cb467a None None] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:49:56.469568 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1718d592-bd1b-4a28-ad29-8496bf43e356 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:49:56.470211 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1718d592-bd1b-4a28-ad29-8496bf43e356 admin admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:56.470468 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1718d592-bd1b-4a28-ad29-8496bf43e356 admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:56.470727 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1718d592-bd1b-4a28-ad29-8496bf43e356 admin admin] PATH_INFO: `/v3/domains` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:56.471404 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1718d592-bd1b-4a28-ad29-8496bf43e356 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:49:56.471747 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1718d592-bd1b-4a28-ad29-8496bf43e356 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:49:56.473346 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1718d592-bd1b-4a28-ad29-8496bf43e356 admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:49:56.488229 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 985/1990] 10.222.0.42 () {58 vars in 1153 bytes} [Sun Oct 30 00:49:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:49:56.492974 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ad934b-e3c0-495f-b931-d094d3641e5e None None] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:49:56.503400 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ad934b-e3c0-495f-b931-d094d3641e5e None None] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:49:56.508979 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ba7fb1-ba26-4d75-ae6e-3659cf97d342 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:49:56.509466 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ba7fb1-ba26-4d75-ae6e-3659cf97d342 admin admin] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:56.509730 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ba7fb1-ba26-4d75-ae6e-3659cf97d342 admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:56.509996 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ba7fb1-ba26-4d75-ae6e-3659cf97d342 admin admin] PATH_INFO: `/v3/projects` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:56.510653 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ba7fb1-ba26-4d75-ae6e-3659cf97d342 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:49:56.512556 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ba7fb1-ba26-4d75-ae6e-3659cf97d342 admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:49:56.562338 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 1006/1991] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 30 00:49:56 2022] POST /identity/v3/projects => generated 393 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 00:49:56.566396 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1718d592-bd1b-4a28-ad29-8496bf43e356 admin admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:49:56.577064 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1718d592-bd1b-4a28-ad29-8496bf43e356 admin admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:49:56.659222 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99530d93-e886-402d-b374-4c642d4ca11c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:49:56.659878 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99530d93-e886-402d-b374-4c642d4ca11c admin admin] REQUEST_METHOD: `POST` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:56.660415 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99530d93-e886-402d-b374-4c642d4ca11c admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:56.660694 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99530d93-e886-402d-b374-4c642d4ca11c admin admin] PATH_INFO: `/v3/users` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:56.661357 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99530d93-e886-402d-b374-4c642d4ca11c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:49:56.663522 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99530d93-e886-402d-b374-4c642d4ca11c admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:49:56.687234 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 986/1992] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 30 00:49:56 2022] POST /identity/v3/users => generated 297 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 00:49:56.691477 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ba7fb1-ba26-4d75-ae6e-3659cf97d342 admin admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:49:56.702889 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ba7fb1-ba26-4d75-ae6e-3659cf97d342 admin admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:49:56.707893 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c582a061-039c-4655-9135-8e753ca0d09a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:49:56.708562 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c582a061-039c-4655-9135-8e753ca0d09a admin admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:56.708848 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c582a061-039c-4655-9135-8e753ca0d09a admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:56.709119 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c582a061-039c-4655-9135-8e753ca0d09a admin admin] PATH_INFO: `/v3/roles` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:56.709755 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c582a061-039c-4655-9135-8e753ca0d09a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:49:56.711512 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c582a061-039c-4655-9135-8e753ca0d09a admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:49:56.721567 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 1007/1993] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 30 00:49:56 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 00:49:56.725706 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99530d93-e886-402d-b374-4c642d4ca11c admin admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:49:56.735981 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99530d93-e886-402d-b374-4c642d4ca11c admin admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:49:56.741142 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6031cf8-0e25-4a82-a818-91c6cbb3f59f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:49:56.741769 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6031cf8-0e25-4a82-a818-91c6cbb3f59f admin admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:56.742043 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6031cf8-0e25-4a82-a818-91c6cbb3f59f admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:56.742311 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6031cf8-0e25-4a82-a818-91c6cbb3f59f admin admin] PATH_INFO: `/v3/roles` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:56.743010 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6031cf8-0e25-4a82-a818-91c6cbb3f59f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:49:56.744642 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6031cf8-0e25-4a82-a818-91c6cbb3f59f admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:49:56.755770 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 987/1994] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 30 00:49:56 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 00:49:56.760029 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c582a061-039c-4655-9135-8e753ca0d09a admin admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:49:56.766788 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:49:56.771663 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c582a061-039c-4655-9135-8e753ca0d09a admin admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:49:56.778504 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bac2cd9-d23a-4d39-8717-5ac2e9b2ac61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:49:56.779183 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bac2cd9-d23a-4d39-8717-5ac2e9b2ac61 admin admin] REQUEST_METHOD: `PUT` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:56.779574 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bac2cd9-d23a-4d39-8717-5ac2e9b2ac61 admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:56.779874 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bac2cd9-d23a-4d39-8717-5ac2e9b2ac61 admin admin] PATH_INFO: `/v3/projects/9b64ddd4ee374ddd8d76d5f09e272cc8/users/33d65f96966544029ce7a2c94bee1065/roles/1c93019874174c4b91118d9ce2347e47` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:56.798097 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bac2cd9-d23a-4d39-8717-5ac2e9b2ac61 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9b64ddd4ee374ddd8d76d5f09e272cc8, user_id=33d65f96966544029ce7a2c94bee1065, role_id=1c93019874174c4b91118d9ce2347e47)` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:49:56.800798 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bac2cd9-d23a-4d39-8717-5ac2e9b2ac61 admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:49:56.816269 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 1008/1995] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 30 00:49:56 2022] PUT /identity/v3/projects/9b64ddd4ee374ddd8d76d5f09e272cc8/users/33d65f96966544029ce7a2c94bee1065/roles/1c93019874174c4b91118d9ce2347e47 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 00:49:56.828300 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17b9eef-a95f-4c17-8952-b98c329d93e9 None None] REQUEST_METHOD: `POST` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:56.828581 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17b9eef-a95f-4c17-8952-b98c329d93e9 None None] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:56.828839 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17b9eef-a95f-4c17-8952-b98c329d93e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:56.857909 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.auth.core [None req-d17b9eef-a95f-4c17-8952-b98c329d93e9 None None] MFA Rules not processed for user `33d65f96966544029ce7a2c94bee1065`. Rule list: `[]` (Enabled: `True`). {{(pid=87955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:49:56.859135 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-d17b9eef-a95f-4c17-8952-b98c329d93e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:49:56.937195 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 988/1996] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 30 00:49:56 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:49:56.941559 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bac2cd9-d23a-4d39-8717-5ac2e9b2ac61 admin admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:49:57.003876 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bac2cd9-d23a-4d39-8717-5ac2e9b2ac61 admin admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:49:57.008679 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a629ca0d-7a21-4046-a70e-5edb4d69d0f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:49:57.009291 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a629ca0d-7a21-4046-a70e-5edb4d69d0f7 admin admin] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:57.009568 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a629ca0d-7a21-4046-a70e-5edb4d69d0f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:57.009921 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a629ca0d-7a21-4046-a70e-5edb4d69d0f7 admin admin] PATH_INFO: `/v3/projects` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:57.010548 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a629ca0d-7a21-4046-a70e-5edb4d69d0f7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:49:57.012465 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a629ca0d-7a21-4046-a70e-5edb4d69d0f7 admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:49:57.039717 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 1009/1997] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 30 00:49:56 2022] POST /identity/v3/projects => generated 389 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 00:49:57.043879 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17b9eef-a95f-4c17-8952-b98c329d93e9 None None] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:49:57.055692 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17b9eef-a95f-4c17-8952-b98c329d93e9 None None] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:49:57.086622 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:49:57.114769 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a0a185-3b21-4590-ac77-0add05f10f0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:49:57.115433 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a0a185-3b21-4590-ac77-0add05f10f0d admin admin] REQUEST_METHOD: `POST` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:57.115731 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a0a185-3b21-4590-ac77-0add05f10f0d admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:57.116026 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a0a185-3b21-4590-ac77-0add05f10f0d admin admin] PATH_INFO: `/v3/users` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:57.116663 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a0a185-3b21-4590-ac77-0add05f10f0d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:49:57.118680 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a0a185-3b21-4590-ac77-0add05f10f0d admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:49:57.144310 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 989/1998] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 30 00:49:57 2022] POST /identity/v3/users => generated 301 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 00:49:57.145667 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a629ca0d-7a21-4046-a70e-5edb4d69d0f7 admin admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:49:57.156765 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a629ca0d-7a21-4046-a70e-5edb4d69d0f7 admin admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:49:57.161894 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6d2970-c52c-4604-b2ec-a7dfc7cb21dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:49:57.162502 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6d2970-c52c-4604-b2ec-a7dfc7cb21dc admin admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:57.162782 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6d2970-c52c-4604-b2ec-a7dfc7cb21dc admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:57.163056 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6d2970-c52c-4604-b2ec-a7dfc7cb21dc admin admin] PATH_INFO: `/v3/roles` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:57.163737 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6d2970-c52c-4604-b2ec-a7dfc7cb21dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:49:57.165523 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6d2970-c52c-4604-b2ec-a7dfc7cb21dc admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:49:57.179925 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 1010/1999] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 30 00:49:57 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 00:49:57.181365 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a0a185-3b21-4590-ac77-0add05f10f0d admin admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:49:57.192404 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a0a185-3b21-4590-ac77-0add05f10f0d admin admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:49:57.198084 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70cdff2-064a-48cc-afc6-a722b089b062 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:49:57.198618 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70cdff2-064a-48cc-afc6-a722b089b062 admin admin] REQUEST_METHOD: `PUT` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:57.198905 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70cdff2-064a-48cc-afc6-a722b089b062 admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:57.199227 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70cdff2-064a-48cc-afc6-a722b089b062 admin admin] PATH_INFO: `/v3/projects/1ba5fc1b4c6140d0ac8a7c9b5c577dbd/users/e0809e9eee2543bc96741ed9faec7e37/roles/6ccaa8c11f29456fb4e4eeccb21616c7` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:57.216003 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70cdff2-064a-48cc-afc6-a722b089b062 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1ba5fc1b4c6140d0ac8a7c9b5c577dbd, user_id=e0809e9eee2543bc96741ed9faec7e37, role_id=6ccaa8c11f29456fb4e4eeccb21616c7)` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:49:57.218651 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70cdff2-064a-48cc-afc6-a722b089b062 admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:49:57.234121 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 990/2000] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 30 00:49:57 2022] PUT /identity/v3/projects/1ba5fc1b4c6140d0ac8a7c9b5c577dbd/users/e0809e9eee2543bc96741ed9faec7e37/roles/6ccaa8c11f29456fb4e4eeccb21616c7 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 00:49:57.238434 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6d2970-c52c-4604-b2ec-a7dfc7cb21dc admin admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:49:57.249268 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6d2970-c52c-4604-b2ec-a7dfc7cb21dc admin admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:49:57.311237 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c646eb1-971f-4ce8-b5aa-f5552bb8b1d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:49:57.311886 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c646eb1-971f-4ce8-b5aa-f5552bb8b1d3 admin admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:57.312166 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c646eb1-971f-4ce8-b5aa-f5552bb8b1d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:57.312434 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c646eb1-971f-4ce8-b5aa-f5552bb8b1d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:57.313049 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c646eb1-971f-4ce8-b5aa-f5552bb8b1d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:49:57.314871 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c646eb1-971f-4ce8-b5aa-f5552bb8b1d3 admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:49:57.326098 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 1011/2001] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 30 00:49:57 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 00:49:57.330787 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70cdff2-064a-48cc-afc6-a722b089b062 admin admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:49:57.341576 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70cdff2-064a-48cc-afc6-a722b089b062 admin admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:49:57.347687 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4c1462-d8d5-401a-9f3a-1a1659fded5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:49:57.348362 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4c1462-d8d5-401a-9f3a-1a1659fded5b admin admin] REQUEST_METHOD: `PUT` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:57.348720 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4c1462-d8d5-401a-9f3a-1a1659fded5b admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:57.349014 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4c1462-d8d5-401a-9f3a-1a1659fded5b admin admin] PATH_INFO: `/v3/projects/1ba5fc1b4c6140d0ac8a7c9b5c577dbd/users/e0809e9eee2543bc96741ed9faec7e37/roles/6ccaa8c11f29456fb4e4eeccb21616c7` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:57.351060 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4c1462-d8d5-401a-9f3a-1a1659fded5b admin admin] RBAC: Authorizing `identity:create_grant(project_id=1ba5fc1b4c6140d0ac8a7c9b5c577dbd, user_id=e0809e9eee2543bc96741ed9faec7e37, role_id=6ccaa8c11f29456fb4e4eeccb21616c7)` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:49:57.353955 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4c1462-d8d5-401a-9f3a-1a1659fded5b admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:49:57.366653 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 991/2002] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 30 00:49:57 2022] PUT /identity/v3/projects/1ba5fc1b4c6140d0ac8a7c9b5c577dbd/users/e0809e9eee2543bc96741ed9faec7e37/roles/6ccaa8c11f29456fb4e4eeccb21616c7 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 00:49:57.378185 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4761ad3-1996-481e-8827-4e2da92df8f6 None None] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:57.378471 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4761ad3-1996-481e-8827-4e2da92df8f6 None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:57.378743 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4761ad3-1996-481e-8827-4e2da92df8f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:57.410373 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.auth.core [None req-d4761ad3-1996-481e-8827-4e2da92df8f6 None None] MFA Rules not processed for user `e0809e9eee2543bc96741ed9faec7e37`. Rule list: `[]` (Enabled: `True`). {{(pid=87956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:49:57.411566 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-d4761ad3-1996-481e-8827-4e2da92df8f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:49:57.457543 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:49:57.495158 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 1012/2003] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 30 00:49:57 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 30 00:49:57.505920 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4c1462-d8d5-401a-9f3a-1a1659fded5b admin admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:49:57.507688 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-5f4c1462-d8d5-401a-9f3a-1a1659fded5b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:49:57.568476 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4c1462-d8d5-401a-9f3a-1a1659fded5b admin admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:49:57.572715 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227d2bc7-5934-4e3d-b8a5-12850f08d567 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48d928ff7fe24348ac900f09c56acc20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d2387fdf794d4eaef07bbcd7b39f2a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:49:57.573313 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227d2bc7-5934-4e3d-b8a5-12850f08d567 service cinder] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:57.573586 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227d2bc7-5934-4e3d-b8a5-12850f08d567 service cinder] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:57.573858 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227d2bc7-5934-4e3d-b8a5-12850f08d567 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:57.584311 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227d2bc7-5934-4e3d-b8a5-12850f08d567 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:49:57.586207 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227d2bc7-5934-4e3d-b8a5-12850f08d567 service cinder] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:49:57.598976 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 992/2004] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 30 00:49:57 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 00:49:57.666826 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4761ad3-1996-481e-8827-4e2da92df8f6 None None] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:49:57.676870 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4761ad3-1996-481e-8827-4e2da92df8f6 None None] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:49:57.685503 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c48855e-329b-4f20-a48a-6f1360ce5172 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48d928ff7fe24348ac900f09c56acc20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d2387fdf794d4eaef07bbcd7b39f2a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:49:57.686142 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c48855e-329b-4f20-a48a-6f1360ce5172 service cinder] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:57.686745 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c48855e-329b-4f20-a48a-6f1360ce5172 service cinder] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:57.687055 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c48855e-329b-4f20-a48a-6f1360ce5172 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:57.764727 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c48855e-329b-4f20-a48a-6f1360ce5172 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:49:57.766174 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c48855e-329b-4f20-a48a-6f1360ce5172 service cinder] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:49:57.778354 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 1013/2005] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 30 00:49:57 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 00:49:59.218825 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227d2bc7-5934-4e3d-b8a5-12850f08d567 service cinder] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:49:59.220365 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-227d2bc7-5934-4e3d-b8a5-12850f08d567 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:49:59.288536 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227d2bc7-5934-4e3d-b8a5-12850f08d567 service cinder] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:49:59.293119 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e320a472-472f-40f2-8ed0-07af4af80149 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:49:59.293938 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e320a472-472f-40f2-8ed0-07af4af80149 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:59.294368 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e320a472-472f-40f2-8ed0-07af4af80149 admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:59.294649 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e320a472-472f-40f2-8ed0-07af4af80149 admin admin] PATH_INFO: `/v3/users/58d1fc4ac62e4d59845baea6c3592763` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:59.295865 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e320a472-472f-40f2-8ed0-07af4af80149 admin admin] RBAC: Authorizing `identity:delete_user(user_id=58d1fc4ac62e4d59845baea6c3592763)` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:49:59.297700 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e320a472-472f-40f2-8ed0-07af4af80149 admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:49:59.333693 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=90,keystone:INSERT=5,keystone:DELETE=5 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:49:59.348333 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-e320a472-472f-40f2-8ed0-07af4af80149 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '58d1fc4ac62e4d59845baea6c3592763'} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:49:59.348962 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-e320a472-472f-40f2-8ed0-07af4af80149 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '58d1fc4ac62e4d59845baea6c3592763'} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:49:59.355808 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-e320a472-472f-40f2-8ed0-07af4af80149 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '58d1fc4ac62e4d59845baea6c3592763'} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:49:59.356453 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-e320a472-472f-40f2-8ed0-07af4af80149 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '58d1fc4ac62e4d59845baea6c3592763'} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:49:59.369171 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-e320a472-472f-40f2-8ed0-07af4af80149 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '58d1fc4ac62e4d59845baea6c3592763'} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:49:59.389385 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 993/2006] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 30 00:49:59 2022] DELETE /identity/v3/users/58d1fc4ac62e4d59845baea6c3592763 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 00:49:59.391092 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb06c215-3dc3-4399-8362-144cebb8b9ab None None] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:59.391647 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb06c215-3dc3-4399-8362-144cebb8b9ab None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:59.391727 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb06c215-3dc3-4399-8362-144cebb8b9ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:59.412228 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.auth.core [None req-fb06c215-3dc3-4399-8362-144cebb8b9ab None None] MFA Rules not processed for user `eb55b6cbca4945abb21b0e49eb745e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=87956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:49:59.413433 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-fb06c215-3dc3-4399-8362-144cebb8b9ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:49:59.473837 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 1014/2007] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 30 00:49:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:49:59.483790 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e320a472-472f-40f2-8ed0-07af4af80149 admin admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:49:59.485171 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-e320a472-472f-40f2-8ed0-07af4af80149 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:49:59.567058 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e320a472-472f-40f2-8ed0-07af4af80149 admin admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:49:59.571460 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc568ceb-d017-4bdb-845a-79afd42cfb4b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5693f186c6ad4d9394f02ee3477cdcd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d2387fdf794d4eaef07bbcd7b39f2a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:49:59.572127 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc568ceb-d017-4bdb-845a-79afd42cfb4b service neutron] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:59.572438 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc568ceb-d017-4bdb-845a-79afd42cfb4b service neutron] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:59.572766 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc568ceb-d017-4bdb-845a-79afd42cfb4b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:59.582944 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc568ceb-d017-4bdb-845a-79afd42cfb4b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:49:59.584427 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc568ceb-d017-4bdb-845a-79afd42cfb4b service neutron] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:49:59.595444 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 994/2008] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 30 00:49:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 00:49:59.935092 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb06c215-3dc3-4399-8362-144cebb8b9ab None None] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:49:59.937742 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-fb06c215-3dc3-4399-8362-144cebb8b9ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:49:59.953818 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb06c215-3dc3-4399-8362-144cebb8b9ab None None] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:49:59.962144 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e66605-aefb-4033-b3b0-f043d7b3831d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:49:59.962144 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e66605-aefb-4033-b3b0-f043d7b3831d admin admin] REQUEST_METHOD: `DELETE` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:49:59.962144 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e66605-aefb-4033-b3b0-f043d7b3831d admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:49:59.962932 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e66605-aefb-4033-b3b0-f043d7b3831d admin admin] PATH_INFO: `/v3/projects/3fd90f60d6324c58803da77dbf01f240` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:49:59.975233 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e66605-aefb-4033-b3b0-f043d7b3831d admin admin] RBAC: Authorizing `identity:delete_project(project_id=3fd90f60d6324c58803da77dbf01f240)` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:49:59.979003 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e66605-aefb-4033-b3b0-f043d7b3831d admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:50:00.027292 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-c7e66605-aefb-4033-b3b0-f043d7b3831d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3fd90f60d6324c58803da77dbf01f240', 'request_id': 'req-c7e66605-aefb-4033-b3b0-f043d7b3831d'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:50:00.035721 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-c7e66605-aefb-4033-b3b0-f043d7b3831d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3fd90f60d6324c58803da77dbf01f240', 'request_id': 'req-c7e66605-aefb-4033-b3b0-f043d7b3831d'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:50:00.042674 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-c7e66605-aefb-4033-b3b0-f043d7b3831d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3fd90f60d6324c58803da77dbf01f240', 'request_id': 'req-c7e66605-aefb-4033-b3b0-f043d7b3831d'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:50:00.049336 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:50:00.054956 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-c7e66605-aefb-4033-b3b0-f043d7b3831d admin admin] The token cache is being invalidate because project 3fd90f60d6324c58803da77dbf01f240 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87956) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 00:50:00.055347 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-c7e66605-aefb-4033-b3b0-f043d7b3831d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:50:00.056155 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-c7e66605-aefb-4033-b3b0-f043d7b3831d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:50:00.058069 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 1015/2009] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 30 00:49:59 2022] DELETE /identity/v3/projects/3fd90f60d6324c58803da77dbf01f240 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 00:50:01.275545 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc568ceb-d017-4bdb-845a-79afd42cfb4b service neutron] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:50:01.277138 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-dc568ceb-d017-4bdb-845a-79afd42cfb4b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:50:01.290886 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc568ceb-d017-4bdb-845a-79afd42cfb4b service neutron] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:50:01.348917 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d214b9f9-fa2f-4c8a-8fd9-4cccc7f0a575 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:50:01.349548 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d214b9f9-fa2f-4c8a-8fd9-4cccc7f0a575 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:50:01.349823 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d214b9f9-fa2f-4c8a-8fd9-4cccc7f0a575 admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:50:01.350104 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d214b9f9-fa2f-4c8a-8fd9-4cccc7f0a575 admin admin] PATH_INFO: `/v3/users/33d65f96966544029ce7a2c94bee1065` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:50:01.351751 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d214b9f9-fa2f-4c8a-8fd9-4cccc7f0a575 admin admin] RBAC: Authorizing `identity:delete_user(user_id=33d65f96966544029ce7a2c94bee1065)` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:50:01.353787 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d214b9f9-fa2f-4c8a-8fd9-4cccc7f0a575 admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:50:01.408855 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-d214b9f9-fa2f-4c8a-8fd9-4cccc7f0a575 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '33d65f96966544029ce7a2c94bee1065'} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:50:01.409608 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-d214b9f9-fa2f-4c8a-8fd9-4cccc7f0a575 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '33d65f96966544029ce7a2c94bee1065'} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:50:01.416029 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:50:01.419090 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-d214b9f9-fa2f-4c8a-8fd9-4cccc7f0a575 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '33d65f96966544029ce7a2c94bee1065'} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:50:01.419907 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-d214b9f9-fa2f-4c8a-8fd9-4cccc7f0a575 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '33d65f96966544029ce7a2c94bee1065'} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:50:01.432772 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-d214b9f9-fa2f-4c8a-8fd9-4cccc7f0a575 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '33d65f96966544029ce7a2c94bee1065'} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:50:01.447802 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 995/2010] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 30 00:50:01 2022] DELETE /identity/v3/users/33d65f96966544029ce7a2c94bee1065 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 00:50:01.452388 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199452ae-9e1b-4a8f-82e6-3368bacdcf3f None None] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:50:01.453727 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199452ae-9e1b-4a8f-82e6-3368bacdcf3f None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:50:01.453727 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199452ae-9e1b-4a8f-82e6-3368bacdcf3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:50:01.472587 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.auth.core [None req-199452ae-9e1b-4a8f-82e6-3368bacdcf3f None None] MFA Rules not processed for user `eb55b6cbca4945abb21b0e49eb745e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=87956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:50:01.473784 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-199452ae-9e1b-4a8f-82e6-3368bacdcf3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:50:01.545496 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 1016/2011] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 30 00:50:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:50:01.555996 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d214b9f9-fa2f-4c8a-8fd9-4cccc7f0a575 admin admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:50:01.557574 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-d214b9f9-fa2f-4c8a-8fd9-4cccc7f0a575 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:50:01.621640 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d214b9f9-fa2f-4c8a-8fd9-4cccc7f0a575 admin admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:50:01.625269 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14a65ca-ce92-4f2c-ae5a-f9f4c2be2fdf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5693f186c6ad4d9394f02ee3477cdcd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d2387fdf794d4eaef07bbcd7b39f2a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:50:01.625894 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14a65ca-ce92-4f2c-ae5a-f9f4c2be2fdf service neutron] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:50:01.626166 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14a65ca-ce92-4f2c-ae5a-f9f4c2be2fdf service neutron] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:50:01.626434 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14a65ca-ce92-4f2c-ae5a-f9f4c2be2fdf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:50:01.635250 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14a65ca-ce92-4f2c-ae5a-f9f4c2be2fdf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:50:01.636689 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14a65ca-ce92-4f2c-ae5a-f9f4c2be2fdf service neutron] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:50:01.645902 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 996/2012] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 30 00:50:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 00:50:01.923903 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199452ae-9e1b-4a8f-82e6-3368bacdcf3f None None] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:50:01.925466 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-199452ae-9e1b-4a8f-82e6-3368bacdcf3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:50:01.939336 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199452ae-9e1b-4a8f-82e6-3368bacdcf3f None None] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:50:01.944948 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58c2cd4-b290-45a9-a170-b5e7756df25e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:50:01.946125 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58c2cd4-b290-45a9-a170-b5e7756df25e admin admin] REQUEST_METHOD: `DELETE` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:50:01.946411 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58c2cd4-b290-45a9-a170-b5e7756df25e admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:50:01.946683 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58c2cd4-b290-45a9-a170-b5e7756df25e admin admin] PATH_INFO: `/v3/projects/9b64ddd4ee374ddd8d76d5f09e272cc8` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:50:01.948092 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58c2cd4-b290-45a9-a170-b5e7756df25e admin admin] RBAC: Authorizing `identity:delete_project(project_id=9b64ddd4ee374ddd8d76d5f09e272cc8)` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:50:01.950049 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58c2cd4-b290-45a9-a170-b5e7756df25e admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:50:02.006856 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-e58c2cd4-b290-45a9-a170-b5e7756df25e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9b64ddd4ee374ddd8d76d5f09e272cc8', 'request_id': 'req-e58c2cd4-b290-45a9-a170-b5e7756df25e'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:50:02.016191 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-e58c2cd4-b290-45a9-a170-b5e7756df25e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9b64ddd4ee374ddd8d76d5f09e272cc8', 'request_id': 'req-e58c2cd4-b290-45a9-a170-b5e7756df25e'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:50:02.022807 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-e58c2cd4-b290-45a9-a170-b5e7756df25e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9b64ddd4ee374ddd8d76d5f09e272cc8', 'request_id': 'req-e58c2cd4-b290-45a9-a170-b5e7756df25e'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:50:02.034436 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-e58c2cd4-b290-45a9-a170-b5e7756df25e admin admin] The token cache is being invalidate because project 9b64ddd4ee374ddd8d76d5f09e272cc8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87956) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 00:50:02.034658 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-e58c2cd4-b290-45a9-a170-b5e7756df25e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:50:02.035336 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-e58c2cd4-b290-45a9-a170-b5e7756df25e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:50:02.037223 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 1017/2013] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 30 00:50:01 2022] DELETE /identity/v3/projects/9b64ddd4ee374ddd8d76d5f09e272cc8 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 00:50:02.041435 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14a65ca-ce92-4f2c-ae5a-f9f4c2be2fdf service neutron] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:50:02.051407 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14a65ca-ce92-4f2c-ae5a-f9f4c2be2fdf service neutron] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:50:02.117422 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e81c1bd-4ba4-487b-9995-5ddddc4a349a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:50:02.118076 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e81c1bd-4ba4-487b-9995-5ddddc4a349a admin admin] REQUEST_METHOD: `DELETE` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:50:02.118404 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e81c1bd-4ba4-487b-9995-5ddddc4a349a admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:50:02.118715 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e81c1bd-4ba4-487b-9995-5ddddc4a349a admin admin] PATH_INFO: `/v3/users/e0809e9eee2543bc96741ed9faec7e37` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:50:02.119967 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e81c1bd-4ba4-487b-9995-5ddddc4a349a admin admin] RBAC: Authorizing `identity:delete_user(user_id=e0809e9eee2543bc96741ed9faec7e37)` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:50:02.121897 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e81c1bd-4ba4-487b-9995-5ddddc4a349a admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:50:02.182905 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-1e81c1bd-4ba4-487b-9995-5ddddc4a349a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e0809e9eee2543bc96741ed9faec7e37'} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:50:02.183662 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-1e81c1bd-4ba4-487b-9995-5ddddc4a349a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e0809e9eee2543bc96741ed9faec7e37'} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:50:02.192149 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-1e81c1bd-4ba4-487b-9995-5ddddc4a349a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e0809e9eee2543bc96741ed9faec7e37'} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:50:02.192886 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-1e81c1bd-4ba4-487b-9995-5ddddc4a349a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e0809e9eee2543bc96741ed9faec7e37'} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:50:02.208954 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-1e81c1bd-4ba4-487b-9995-5ddddc4a349a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e0809e9eee2543bc96741ed9faec7e37'} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:50:02.210670 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:50:02.229278 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 997/2014] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 30 00:50:02 2022] DELETE /identity/v3/users/e0809e9eee2543bc96741ed9faec7e37 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 00:50:02.541588 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58c2cd4-b290-45a9-a170-b5e7756df25e admin admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:50:02.543400 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-e58c2cd4-b290-45a9-a170-b5e7756df25e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:50:02.559749 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58c2cd4-b290-45a9-a170-b5e7756df25e admin admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:50:02.620108 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6725bb53-10f9-43de-81d7-3bc309e885b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:50:02.620743 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6725bb53-10f9-43de-81d7-3bc309e885b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:50:02.621024 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6725bb53-10f9-43de-81d7-3bc309e885b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:50:02.621294 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6725bb53-10f9-43de-81d7-3bc309e885b3 admin admin] PATH_INFO: `/v3/projects/1ba5fc1b4c6140d0ac8a7c9b5c577dbd` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:50:02.622402 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6725bb53-10f9-43de-81d7-3bc309e885b3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1ba5fc1b4c6140d0ac8a7c9b5c577dbd)` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:50:02.624369 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6725bb53-10f9-43de-81d7-3bc309e885b3 admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:50:02.654229 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:50:02.689320 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-6725bb53-10f9-43de-81d7-3bc309e885b3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1ba5fc1b4c6140d0ac8a7c9b5c577dbd', 'request_id': 'req-6725bb53-10f9-43de-81d7-3bc309e885b3'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:50:02.699294 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-6725bb53-10f9-43de-81d7-3bc309e885b3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1ba5fc1b4c6140d0ac8a7c9b5c577dbd', 'request_id': 'req-6725bb53-10f9-43de-81d7-3bc309e885b3'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:50:02.706725 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-6725bb53-10f9-43de-81d7-3bc309e885b3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1ba5fc1b4c6140d0ac8a7c9b5c577dbd', 'request_id': 'req-6725bb53-10f9-43de-81d7-3bc309e885b3'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:50:02.717342 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-6725bb53-10f9-43de-81d7-3bc309e885b3 admin admin] The token cache is being invalidate because project 1ba5fc1b4c6140d0ac8a7c9b5c577dbd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87956) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 00:50:02.717625 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-6725bb53-10f9-43de-81d7-3bc309e885b3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:50:02.718342 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-6725bb53-10f9-43de-81d7-3bc309e885b3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:50:02.719922 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 1018/2015] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 30 00:50:02 2022] DELETE /identity/v3/projects/1ba5fc1b4c6140d0ac8a7c9b5c577dbd => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 00:50:02.726727 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18388350-f558-4296-8755-3a518a4cfcd4 None None] REQUEST_METHOD: `POST` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:50:02.727274 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18388350-f558-4296-8755-3a518a4cfcd4 None None] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:50:02.727415 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18388350-f558-4296-8755-3a518a4cfcd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:50:02.750088 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.auth.core [None req-18388350-f558-4296-8755-3a518a4cfcd4 None None] MFA Rules not processed for user `eb55b6cbca4945abb21b0e49eb745e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=87955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:50:02.751328 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-18388350-f558-4296-8755-3a518a4cfcd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:50:02.815527 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 998/2016] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 30 00:50:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:50:02.824768 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86116f09-6826-4ba6-90d9-ef3a29048abc None None] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:50:02.825050 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86116f09-6826-4ba6-90d9-ef3a29048abc None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:50:02.825321 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86116f09-6826-4ba6-90d9-ef3a29048abc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:50:02.845424 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.auth.core [None req-86116f09-6826-4ba6-90d9-ef3a29048abc None None] MFA Rules not processed for user `eb55b6cbca4945abb21b0e49eb745e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=87956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:50:02.846619 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-86116f09-6826-4ba6-90d9-ef3a29048abc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:50:02.855604 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 1019/2017] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 30 00:50:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:50:02.860911 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18388350-f558-4296-8755-3a518a4cfcd4 None None] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:50:02.877695 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18388350-f558-4296-8755-3a518a4cfcd4 None None] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:50:02.883958 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9f70df-a623-40cf-8682-2ab7f887d431 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:50:02.884563 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9f70df-a623-40cf-8682-2ab7f887d431 admin admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:50:02.884841 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9f70df-a623-40cf-8682-2ab7f887d431 admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:50:02.885109 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9f70df-a623-40cf-8682-2ab7f887d431 admin admin] PATH_INFO: `/v3/domains` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:50:02.885761 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9f70df-a623-40cf-8682-2ab7f887d431 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:50:02.886061 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9f70df-a623-40cf-8682-2ab7f887d431 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:50:02.887819 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9f70df-a623-40cf-8682-2ab7f887d431 admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:50:02.899973 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 999/2018] 10.222.0.42 () {58 vars in 1153 bytes} [Sun Oct 30 00:50:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:50:02.902874 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86116f09-6826-4ba6-90d9-ef3a29048abc None None] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:50:02.904339 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9f70df-a623-40cf-8682-2ab7f887d431 admin admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:50:02.904489 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-86116f09-6826-4ba6-90d9-ef3a29048abc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:50:02.916663 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86116f09-6826-4ba6-90d9-ef3a29048abc None None] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:50:02.921841 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeaada6d-ad76-4b2e-b320-9f57fb010c1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:50:02.922478 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeaada6d-ad76-4b2e-b320-9f57fb010c1e admin admin] REQUEST_METHOD: `DELETE` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:50:02.922757 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeaada6d-ad76-4b2e-b320-9f57fb010c1e admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:50:02.922913 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9f70df-a623-40cf-8682-2ab7f887d431 admin admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:50:02.923023 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeaada6d-ad76-4b2e-b320-9f57fb010c1e admin admin] PATH_INFO: `/v3/users/a61d514217dc465db13024bf6458996b` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:50:02.924314 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeaada6d-ad76-4b2e-b320-9f57fb010c1e admin admin] RBAC: Authorizing `identity:delete_user(user_id=a61d514217dc465db13024bf6458996b)` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:50:02.926270 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeaada6d-ad76-4b2e-b320-9f57fb010c1e admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:50:02.931105 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9a729e-34b8-46ee-8291-f058049cfe9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:50:02.931808 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9a729e-34b8-46ee-8291-f058049cfe9a admin admin] REQUEST_METHOD: `POST` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:50:02.932075 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9a729e-34b8-46ee-8291-f058049cfe9a admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:50:02.932338 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9a729e-34b8-46ee-8291-f058049cfe9a admin admin] PATH_INFO: `/v3/projects` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:50:02.933141 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9a729e-34b8-46ee-8291-f058049cfe9a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:50:02.935120 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9a729e-34b8-46ee-8291-f058049cfe9a admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:50:02.965381 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 1000/2019] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 30 00:50:02 2022] POST /identity/v3/projects => generated 373 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 00:50:02.969509 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9a729e-34b8-46ee-8291-f058049cfe9a admin admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:50:02.983602 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-eeaada6d-ad76-4b2e-b320-9f57fb010c1e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a61d514217dc465db13024bf6458996b'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:50:02.984640 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-eeaada6d-ad76-4b2e-b320-9f57fb010c1e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a61d514217dc465db13024bf6458996b'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:50:02.998799 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-eeaada6d-ad76-4b2e-b320-9f57fb010c1e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a61d514217dc465db13024bf6458996b'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:50:03.008247 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-eeaada6d-ad76-4b2e-b320-9f57fb010c1e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a61d514217dc465db13024bf6458996b'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:50:03.015413 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-eeaada6d-ad76-4b2e-b320-9f57fb010c1e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a61d514217dc465db13024bf6458996b'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:50:03.021820 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 1020/2020] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 30 00:50:02 2022] DELETE /identity/v3/users/a61d514217dc465db13024bf6458996b => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 00:50:03.026505 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03528b9-42f8-4e74-b410-35d83fb2c184 None None] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:50:03.026782 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03528b9-42f8-4e74-b410-35d83fb2c184 None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:50:03.027048 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03528b9-42f8-4e74-b410-35d83fb2c184 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:50:03.032382 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9a729e-34b8-46ee-8291-f058049cfe9a admin admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:50:03.045197 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.auth.core [None req-d03528b9-42f8-4e74-b410-35d83fb2c184 None None] MFA Rules not processed for user `eb55b6cbca4945abb21b0e49eb745e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=87956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:50:03.046460 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-d03528b9-42f8-4e74-b410-35d83fb2c184 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:50:03.104017 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af895949-ee90-4f6a-b4ad-b19964c762e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:50:03.104631 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af895949-ee90-4f6a-b4ad-b19964c762e7 admin admin] REQUEST_METHOD: `POST` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:50:03.105126 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af895949-ee90-4f6a-b4ad-b19964c762e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:50:03.105270 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 1021/2021] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 30 00:50:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 30 00:50:03.105363 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af895949-ee90-4f6a-b4ad-b19964c762e7 admin admin] PATH_INFO: `/v3/users` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:50:03.105806 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af895949-ee90-4f6a-b4ad-b19964c762e7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:50:03.107758 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af895949-ee90-4f6a-b4ad-b19964c762e7 admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:50:03.114807 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03528b9-42f8-4e74-b410-35d83fb2c184 None None] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:50:03.116162 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-d03528b9-42f8-4e74-b410-35d83fb2c184 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:50:03.118560 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:INSERT=4,keystone:DELETE=1,keystone:SELECT=95 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:50:03.136531 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 1001/2022] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 30 00:50:02 2022] POST /identity/v3/users => generated 287 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 00:50:03.136742 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:50:03.138286 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af895949-ee90-4f6a-b4ad-b19964c762e7 admin admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:50:03.140116 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-af895949-ee90-4f6a-b4ad-b19964c762e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:50:03.152112 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af895949-ee90-4f6a-b4ad-b19964c762e7 admin admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:50:03.157738 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d319d82c-fe7f-4ab0-b4b7-307895ceb48f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:50:03.158759 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d319d82c-fe7f-4ab0-b4b7-307895ceb48f admin admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:50:03.159046 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d319d82c-fe7f-4ab0-b4b7-307895ceb48f admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:50:03.159363 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d319d82c-fe7f-4ab0-b4b7-307895ceb48f admin admin] PATH_INFO: `/v3/roles` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:50:03.160014 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d319d82c-fe7f-4ab0-b4b7-307895ceb48f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:50:03.162322 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d319d82c-fe7f-4ab0-b4b7-307895ceb48f admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:50:03.174655 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 1002/2023] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 30 00:50:03 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 00:50:03.178905 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d319d82c-fe7f-4ab0-b4b7-307895ceb48f admin admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:50:03.187910 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03528b9-42f8-4e74-b410-35d83fb2c184 None None] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:50:03.191436 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d319d82c-fe7f-4ab0-b4b7-307895ceb48f admin admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:50:03.193265 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9c0e96-84ac-4e29-b0bd-c9e3fca1239e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5693f186c6ad4d9394f02ee3477cdcd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d2387fdf794d4eaef07bbcd7b39f2a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:50:03.194093 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9c0e96-84ac-4e29-b0bd-c9e3fca1239e service neutron] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:50:03.194363 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9c0e96-84ac-4e29-b0bd-c9e3fca1239e service neutron] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:50:03.194786 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9c0e96-84ac-4e29-b0bd-c9e3fca1239e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:50:03.199232 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ac7e92-675b-4acc-b996-25e9614bb3fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:50:03.199860 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ac7e92-675b-4acc-b996-25e9614bb3fe admin admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:50:03.200143 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ac7e92-675b-4acc-b996-25e9614bb3fe admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:50:03.200412 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ac7e92-675b-4acc-b996-25e9614bb3fe admin admin] PATH_INFO: `/v3/roles` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:50:03.201159 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ac7e92-675b-4acc-b996-25e9614bb3fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:50:03.202947 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ac7e92-675b-4acc-b996-25e9614bb3fe admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:50:03.206411 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9c0e96-84ac-4e29-b0bd-c9e3fca1239e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:50:03.207879 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9c0e96-84ac-4e29-b0bd-c9e3fca1239e service neutron] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:50:03.215891 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 1003/2024] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 30 00:50:03 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 30 00:50:03.223267 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 1022/2025] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 30 00:50:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 30 00:50:03.224088 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ac7e92-675b-4acc-b996-25e9614bb3fe admin admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:50:03.233941 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ac7e92-675b-4acc-b996-25e9614bb3fe admin admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:50:03.238813 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa352c5-ea92-40ba-b75b-409c038761f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:50:03.239605 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa352c5-ea92-40ba-b75b-409c038761f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:50:03.239940 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa352c5-ea92-40ba-b75b-409c038761f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:50:03.240272 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa352c5-ea92-40ba-b75b-409c038761f6 admin admin] PATH_INFO: `/v3/projects/5104b467c19e4b9a9d2b4e44df656fb0/users/a5f83b66441c437fadca67127c03797b/roles/1c93019874174c4b91118d9ce2347e47` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:50:03.254965 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa352c5-ea92-40ba-b75b-409c038761f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5104b467c19e4b9a9d2b4e44df656fb0, user_id=a5f83b66441c437fadca67127c03797b, role_id=1c93019874174c4b91118d9ce2347e47)` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:50:03.257829 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa352c5-ea92-40ba-b75b-409c038761f6 admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:50:03.271944 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 1004/2026] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 30 00:50:03 2022] PUT /identity/v3/projects/5104b467c19e4b9a9d2b4e44df656fb0/users/a5f83b66441c437fadca67127c03797b/roles/1c93019874174c4b91118d9ce2347e47 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 00:50:03.277239 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2df8c24-4835-49d7-960e-038edb8b9ba0 None None] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:50:03.277502 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2df8c24-4835-49d7-960e-038edb8b9ba0 None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:50:03.277792 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2df8c24-4835-49d7-960e-038edb8b9ba0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:50:03.297037 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.auth.core [None req-e2df8c24-4835-49d7-960e-038edb8b9ba0 None None] MFA Rules not processed for user `eb55b6cbca4945abb21b0e49eb745e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=87956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:50:03.298282 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-e2df8c24-4835-49d7-960e-038edb8b9ba0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:50:03.372895 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 1023/2027] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 30 00:50:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:50:03.380496 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa352c5-ea92-40ba-b75b-409c038761f6 admin admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:50:03.437496 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa352c5-ea92-40ba-b75b-409c038761f6 admin admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:50:03.441421 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92a53ed-2cd1-4996-a0d2-ce10f3fd5331 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5693f186c6ad4d9394f02ee3477cdcd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d2387fdf794d4eaef07bbcd7b39f2a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:50:03.442023 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92a53ed-2cd1-4996-a0d2-ce10f3fd5331 service neutron] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:50:03.442308 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92a53ed-2cd1-4996-a0d2-ce10f3fd5331 service neutron] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:50:03.442579 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92a53ed-2cd1-4996-a0d2-ce10f3fd5331 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:50:03.460130 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92a53ed-2cd1-4996-a0d2-ce10f3fd5331 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:50:03.461609 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92a53ed-2cd1-4996-a0d2-ce10f3fd5331 service neutron] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:50:03.474468 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 1005/2028] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 30 00:50:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 00:50:03.589555 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2df8c24-4835-49d7-960e-038edb8b9ba0 None None] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:50:03.591698 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-e2df8c24-4835-49d7-960e-038edb8b9ba0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:50:03.604582 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2df8c24-4835-49d7-960e-038edb8b9ba0 None None] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:50:03.610343 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e97fe7-9b54-418c-9b40-117704394951 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:50:03.611267 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e97fe7-9b54-418c-9b40-117704394951 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:50:03.611530 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e97fe7-9b54-418c-9b40-117704394951 admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:50:03.611805 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e97fe7-9b54-418c-9b40-117704394951 admin admin] PATH_INFO: `/v3/projects/901fd7b6d41e4592ad26f087d0bfc866` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:50:03.616087 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e97fe7-9b54-418c-9b40-117704394951 admin admin] RBAC: Authorizing `identity:delete_project(project_id=901fd7b6d41e4592ad26f087d0bfc866)` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:50:03.619235 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e97fe7-9b54-418c-9b40-117704394951 admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:50:03.706549 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-d6e97fe7-9b54-418c-9b40-117704394951 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '901fd7b6d41e4592ad26f087d0bfc866', 'request_id': 'req-d6e97fe7-9b54-418c-9b40-117704394951'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:50:03.715305 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-d6e97fe7-9b54-418c-9b40-117704394951 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '901fd7b6d41e4592ad26f087d0bfc866', 'request_id': 'req-d6e97fe7-9b54-418c-9b40-117704394951'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:50:03.723340 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-d6e97fe7-9b54-418c-9b40-117704394951 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '901fd7b6d41e4592ad26f087d0bfc866', 'request_id': 'req-d6e97fe7-9b54-418c-9b40-117704394951'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:50:03.739058 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-d6e97fe7-9b54-418c-9b40-117704394951 admin admin] The token cache is being invalidate because project 901fd7b6d41e4592ad26f087d0bfc866 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87956) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 00:50:03.739406 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-d6e97fe7-9b54-418c-9b40-117704394951 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:50:03.740052 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-d6e97fe7-9b54-418c-9b40-117704394951 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:50:03.741762 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 1024/2029] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 30 00:50:03 2022] DELETE /identity/v3/projects/901fd7b6d41e4592ad26f087d0bfc866 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 00:50:04.159655 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b2e359-0779-47cb-8233-d1d4fe118748 None None] REQUEST_METHOD: `POST` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:50:04.160184 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b2e359-0779-47cb-8233-d1d4fe118748 None None] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:50:04.160287 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b2e359-0779-47cb-8233-d1d4fe118748 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:50:04.187829 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.auth.core [None req-87b2e359-0779-47cb-8233-d1d4fe118748 None None] MFA Rules not processed for user `a5f83b66441c437fadca67127c03797b`. Rule list: `[]` (Enabled: `True`). {{(pid=87955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:50:04.189058 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-87b2e359-0779-47cb-8233-d1d4fe118748 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:50:04.257421 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 1006/2030] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 30 00:50:04 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:50:04.268670 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e97fe7-9b54-418c-9b40-117704394951 admin admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:50:04.270260 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-d6e97fe7-9b54-418c-9b40-117704394951 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:50:04.319179 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:50:04.332467 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e97fe7-9b54-418c-9b40-117704394951 admin admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:50:04.337370 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb90c433-775a-499d-8258-4f77ffb0ac89 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48d928ff7fe24348ac900f09c56acc20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d2387fdf794d4eaef07bbcd7b39f2a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:50:04.338012 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb90c433-775a-499d-8258-4f77ffb0ac89 service cinder] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:50:04.338288 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb90c433-775a-499d-8258-4f77ffb0ac89 service cinder] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:50:04.338592 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb90c433-775a-499d-8258-4f77ffb0ac89 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:50:04.348721 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb90c433-775a-499d-8258-4f77ffb0ac89 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:50:04.350168 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb90c433-775a-499d-8258-4f77ffb0ac89 service cinder] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:50:04.359493 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 1025/2031] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 30 00:50:04 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 00:50:05.738884 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f680ba-6c7d-418d-b64a-c91d8f8d154a None None] REQUEST_METHOD: `POST` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:50:05.739410 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f680ba-6c7d-418d-b64a-c91d8f8d154a None None] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:50:05.739410 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f680ba-6c7d-418d-b64a-c91d8f8d154a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:50:05.760081 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.auth.core [None req-b4f680ba-6c7d-418d-b64a-c91d8f8d154a None None] MFA Rules not processed for user `a5f83b66441c437fadca67127c03797b`. Rule list: `[]` (Enabled: `True`). {{(pid=87955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:50:05.761450 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-b4f680ba-6c7d-418d-b64a-c91d8f8d154a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:50:05.784674 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 1007/2032] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 30 00:50:05 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:50:14.355392 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=6 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:50:15.753365 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:INSERT=2,keystone:SELECT=83 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:50:24.845653 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b16853-235e-4a00-906f-0a2a72ce1f06 None None] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:50:24.846175 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b16853-235e-4a00-906f-0a2a72ce1f06 None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:50:24.846288 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b16853-235e-4a00-906f-0a2a72ce1f06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:50:24.885466 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.auth.core [None req-f8b16853-235e-4a00-906f-0a2a72ce1f06 None None] MFA Rules not processed for user `861d1145dd48414c9388bed57e993493`. Rule list: `[]` (Enabled: `True`). {{(pid=87956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:50:24.888825 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-f8b16853-235e-4a00-906f-0a2a72ce1f06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:50:25.033762 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 1026/2033] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 30 00:50:24 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:50:25.951840 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63845a0-268e-4ac2-8192-724226ecc2dd None None] REQUEST_METHOD: `POST` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:50:25.952422 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63845a0-268e-4ac2-8192-724226ecc2dd None None] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:50:25.952663 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63845a0-268e-4ac2-8192-724226ecc2dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:50:25.977500 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.auth.core [None req-b63845a0-268e-4ac2-8192-724226ecc2dd None None] MFA Rules not processed for user `eb55b6cbca4945abb21b0e49eb745e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=87955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:50:25.979768 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-b63845a0-268e-4ac2-8192-724226ecc2dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:50:26.084636 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 1008/2034] 10.222.0.45 () {58 vars in 1016 bytes} [Sun Oct 30 00:50:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 30 00:50:26.112075 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b16853-235e-4a00-906f-0a2a72ce1f06 None None] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:50:26.114500 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-f8b16853-235e-4a00-906f-0a2a72ce1f06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:50:26.241671 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b16853-235e-4a00-906f-0a2a72ce1f06 None None] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:50:26.248449 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c52cdd-887c-4a4d-996f-1b9f08fdba6e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fde877b6ddc74f4a87baf21471eb31d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d2387fdf794d4eaef07bbcd7b39f2a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:50:26.250203 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c52cdd-887c-4a4d-996f-1b9f08fdba6e service nova] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:50:26.250739 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c52cdd-887c-4a4d-996f-1b9f08fdba6e service nova] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:50:26.251171 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c52cdd-887c-4a4d-996f-1b9f08fdba6e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:50:26.262887 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c52cdd-887c-4a4d-996f-1b9f08fdba6e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:50:26.265584 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c52cdd-887c-4a4d-996f-1b9f08fdba6e service nova] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:50:26.280912 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 1027/2035] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 30 00:50:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 00:50:27.033679 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0736f8-515c-4de2-b5c9-653e026453a0 None None] REQUEST_METHOD: `POST` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:50:27.034203 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0736f8-515c-4de2-b5c9-653e026453a0 None None] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:50:27.034431 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0736f8-515c-4de2-b5c9-653e026453a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:50:27.062498 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.auth.core [None req-5d0736f8-515c-4de2-b5c9-653e026453a0 None None] MFA Rules not processed for user `6215c75145174a63b88110843e7c29c7`. Rule list: `[]` (Enabled: `True`). {{(pid=87955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:50:27.064203 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-5d0736f8-515c-4de2-b5c9-653e026453a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:50:27.134585 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 1009/2036] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 30 00:50:27 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:50:30.124382 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdd3e8b-b2a9-446c-b87a-285b0cdcf8fb None None] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:50:30.124844 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdd3e8b-b2a9-446c-b87a-285b0cdcf8fb None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:50:30.124942 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdd3e8b-b2a9-446c-b87a-285b0cdcf8fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:50:30.150723 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.auth.core [None req-bbdd3e8b-b2a9-446c-b87a-285b0cdcf8fb None None] MFA Rules not processed for user `eb55b6cbca4945abb21b0e49eb745e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=87956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:50:30.152299 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-bbdd3e8b-b2a9-446c-b87a-285b0cdcf8fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:50:30.167616 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 1028/2037] 10.222.0.45 () {58 vars in 1016 bytes} [Sun Oct 30 00:50:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:50:30.313683 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0736f8-515c-4de2-b5c9-653e026453a0 None None] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:50:30.316117 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-5d0736f8-515c-4de2-b5c9-653e026453a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:50:30.336555 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0736f8-515c-4de2-b5c9-653e026453a0 None None] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:50:30.344996 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a24ad7-0354-46de-8da8-6ff792eda45c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fde877b6ddc74f4a87baf21471eb31d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d2387fdf794d4eaef07bbcd7b39f2a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:50:30.345644 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a24ad7-0354-46de-8da8-6ff792eda45c service nova] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:50:30.345916 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a24ad7-0354-46de-8da8-6ff792eda45c service nova] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:50:30.346179 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a24ad7-0354-46de-8da8-6ff792eda45c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:50:30.355068 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a24ad7-0354-46de-8da8-6ff792eda45c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:50:30.356622 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a24ad7-0354-46de-8da8-6ff792eda45c service nova] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:50:30.366972 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 1010/2038] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 30 00:50:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 00:50:30.966939 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdd3e8b-b2a9-446c-b87a-285b0cdcf8fb None None] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:50:30.968417 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-bbdd3e8b-b2a9-446c-b87a-285b0cdcf8fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:50:30.980479 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdd3e8b-b2a9-446c-b87a-285b0cdcf8fb None None] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:50:30.985655 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ed1406-b1cf-41cf-83c1-a017d396bc9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:50:30.986280 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ed1406-b1cf-41cf-83c1-a017d396bc9c admin admin] REQUEST_METHOD: `DELETE` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:50:30.986555 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ed1406-b1cf-41cf-83c1-a017d396bc9c admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:50:30.986820 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ed1406-b1cf-41cf-83c1-a017d396bc9c admin admin] PATH_INFO: `/v3/users/71fa0f9151e143dc876d60bf975c2eb9` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:50:30.988062 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ed1406-b1cf-41cf-83c1-a017d396bc9c admin admin] RBAC: Authorizing `identity:delete_user(user_id=71fa0f9151e143dc876d60bf975c2eb9)` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:50:30.990039 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ed1406-b1cf-41cf-83c1-a017d396bc9c admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:50:31.040281 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-b1ed1406-b1cf-41cf-83c1-a017d396bc9c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '71fa0f9151e143dc876d60bf975c2eb9'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:50:31.040929 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-b1ed1406-b1cf-41cf-83c1-a017d396bc9c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '71fa0f9151e143dc876d60bf975c2eb9'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:50:31.053670 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-b1ed1406-b1cf-41cf-83c1-a017d396bc9c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '71fa0f9151e143dc876d60bf975c2eb9'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:50:31.063249 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-b1ed1406-b1cf-41cf-83c1-a017d396bc9c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '71fa0f9151e143dc876d60bf975c2eb9'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:50:31.070772 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:50:31.073678 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-b1ed1406-b1cf-41cf-83c1-a017d396bc9c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '71fa0f9151e143dc876d60bf975c2eb9'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:50:31.081372 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 1029/2039] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 30 00:50:30 2022] DELETE /identity/v3/users/71fa0f9151e143dc876d60bf975c2eb9 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 00:50:31.087340 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a66f7a7-dfef-41f3-b045-cea0b3c4b239 None None] REQUEST_METHOD: `POST` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:50:31.087815 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a66f7a7-dfef-41f3-b045-cea0b3c4b239 None None] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:50:31.088284 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a66f7a7-dfef-41f3-b045-cea0b3c4b239 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:50:31.113292 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.auth.core [None req-0a66f7a7-dfef-41f3-b045-cea0b3c4b239 None None] MFA Rules not processed for user `eb55b6cbca4945abb21b0e49eb745e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=87955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:50:31.114470 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-0a66f7a7-dfef-41f3-b045-cea0b3c4b239 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:50:31.181905 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 1011/2040] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 30 00:50:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:50:31.192043 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ed1406-b1cf-41cf-83c1-a017d396bc9c admin admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:50:31.194105 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-b1ed1406-b1cf-41cf-83c1-a017d396bc9c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:50:31.253327 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ed1406-b1cf-41cf-83c1-a017d396bc9c admin admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:50:31.257302 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bb3199-2b06-4703-9d35-f2d6c9f8846e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5693f186c6ad4d9394f02ee3477cdcd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d2387fdf794d4eaef07bbcd7b39f2a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:50:31.257898 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bb3199-2b06-4703-9d35-f2d6c9f8846e service neutron] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:50:31.258129 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bb3199-2b06-4703-9d35-f2d6c9f8846e service neutron] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:50:31.258420 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bb3199-2b06-4703-9d35-f2d6c9f8846e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:50:31.272445 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3bb3199-2b06-4703-9d35-f2d6c9f8846e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:50:31.274604 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3bb3199-2b06-4703-9d35-f2d6c9f8846e service neutron] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:50:31.288906 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 1030/2041] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 30 00:50:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 00:50:31.760710 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a66f7a7-dfef-41f3-b045-cea0b3c4b239 None None] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:50:31.762297 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-0a66f7a7-dfef-41f3-b045-cea0b3c4b239 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:50:31.777204 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a66f7a7-dfef-41f3-b045-cea0b3c4b239 None None] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:50:31.782324 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddfe419-a059-46aa-9c57-173c7bda0710 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:50:31.782965 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddfe419-a059-46aa-9c57-173c7bda0710 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:50:31.783509 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddfe419-a059-46aa-9c57-173c7bda0710 admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:50:31.783678 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddfe419-a059-46aa-9c57-173c7bda0710 admin admin] PATH_INFO: `/v3/projects/bfa5fff67fe64dee90c6efdcc489cd0f` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:50:31.784867 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddfe419-a059-46aa-9c57-173c7bda0710 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bfa5fff67fe64dee90c6efdcc489cd0f)` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:50:31.786742 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddfe419-a059-46aa-9c57-173c7bda0710 admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:50:31.819742 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:50:31.835106 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-fddfe419-a059-46aa-9c57-173c7bda0710 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bfa5fff67fe64dee90c6efdcc489cd0f', 'request_id': 'req-fddfe419-a059-46aa-9c57-173c7bda0710'} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:50:31.840674 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-fddfe419-a059-46aa-9c57-173c7bda0710 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bfa5fff67fe64dee90c6efdcc489cd0f', 'request_id': 'req-fddfe419-a059-46aa-9c57-173c7bda0710'} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:50:31.849365 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-fddfe419-a059-46aa-9c57-173c7bda0710 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bfa5fff67fe64dee90c6efdcc489cd0f', 'request_id': 'req-fddfe419-a059-46aa-9c57-173c7bda0710'} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:50:31.861181 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-fddfe419-a059-46aa-9c57-173c7bda0710 admin admin] The token cache is being invalidate because project bfa5fff67fe64dee90c6efdcc489cd0f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87955) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 00:50:31.861467 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-fddfe419-a059-46aa-9c57-173c7bda0710 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:50:31.862166 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-fddfe419-a059-46aa-9c57-173c7bda0710 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:50:31.863802 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 1012/2042] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 30 00:50:31 2022] DELETE /identity/v3/projects/bfa5fff67fe64dee90c6efdcc489cd0f => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 00:50:31.868994 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7da72ba-9bd3-4204-ba66-998e4b26bf18 None None] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:50:31.869297 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7da72ba-9bd3-4204-ba66-998e4b26bf18 None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:50:31.869566 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7da72ba-9bd3-4204-ba66-998e4b26bf18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:50:31.892756 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.auth.core [None req-a7da72ba-9bd3-4204-ba66-998e4b26bf18 None None] MFA Rules not processed for user `eb55b6cbca4945abb21b0e49eb745e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=87956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:50:31.894510 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-a7da72ba-9bd3-4204-ba66-998e4b26bf18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:50:31.974519 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 1031/2043] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 30 00:50:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:50:31.982842 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6f480b-7dae-4189-acb1-86f7deed1217 None None] REQUEST_METHOD: `POST` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:50:31.983221 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6f480b-7dae-4189-acb1-86f7deed1217 None None] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:50:31.983513 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6f480b-7dae-4189-acb1-86f7deed1217 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:50:32.003148 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.auth.core [None req-2c6f480b-7dae-4189-acb1-86f7deed1217 None None] MFA Rules not processed for user `eb55b6cbca4945abb21b0e49eb745e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=87955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:50:32.004479 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-2c6f480b-7dae-4189-acb1-86f7deed1217 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:50:32.012801 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 1013/2044] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 30 00:50:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:50:32.017190 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7da72ba-9bd3-4204-ba66-998e4b26bf18 None None] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:50:32.028152 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7da72ba-9bd3-4204-ba66-998e4b26bf18 None None] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:50:32.033401 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd0ac67-0adc-48df-99de-8341dd54027a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:50:32.034118 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd0ac67-0adc-48df-99de-8341dd54027a admin admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:50:32.034576 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd0ac67-0adc-48df-99de-8341dd54027a admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:50:32.034803 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd0ac67-0adc-48df-99de-8341dd54027a admin admin] PATH_INFO: `/v3/domains` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:50:32.035741 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd0ac67-0adc-48df-99de-8341dd54027a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87956) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:50:32.036071 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd0ac67-0adc-48df-99de-8341dd54027a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:50:32.037830 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd0ac67-0adc-48df-99de-8341dd54027a admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:50:32.051253 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 1032/2045] 10.222.0.42 () {58 vars in 1153 bytes} [Sun Oct 30 00:50:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:50:32.056445 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6f480b-7dae-4189-acb1-86f7deed1217 None None] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:50:32.065505 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6f480b-7dae-4189-acb1-86f7deed1217 None None] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:50:32.071179 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2a99ac-d8c4-4b18-94d7-b2f68191ab3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:50:32.071911 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2a99ac-d8c4-4b18-94d7-b2f68191ab3d admin admin] REQUEST_METHOD: `POST` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:50:32.072149 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2a99ac-d8c4-4b18-94d7-b2f68191ab3d admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:50:32.072492 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2a99ac-d8c4-4b18-94d7-b2f68191ab3d admin admin] PATH_INFO: `/v3/projects` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:50:32.073417 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2a99ac-d8c4-4b18-94d7-b2f68191ab3d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:50:32.075117 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2a99ac-d8c4-4b18-94d7-b2f68191ab3d admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:50:32.102568 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 1014/2046] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 30 00:50:32 2022] POST /identity/v3/projects => generated 365 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 00:50:32.107133 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd0ac67-0adc-48df-99de-8341dd54027a admin admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:50:32.117922 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd0ac67-0adc-48df-99de-8341dd54027a admin admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:50:32.175761 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09120947-0cc2-42bc-acfe-6452add6dc0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:50:32.176382 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09120947-0cc2-42bc-acfe-6452add6dc0a admin admin] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:50:32.176660 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09120947-0cc2-42bc-acfe-6452add6dc0a admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:50:32.176931 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09120947-0cc2-42bc-acfe-6452add6dc0a admin admin] PATH_INFO: `/v3/users` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:50:32.177572 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09120947-0cc2-42bc-acfe-6452add6dc0a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:50:32.180073 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09120947-0cc2-42bc-acfe-6452add6dc0a admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:50:32.206665 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 1033/2047] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 30 00:50:32 2022] POST /identity/v3/users => generated 283 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 30 00:50:32.207941 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2a99ac-d8c4-4b18-94d7-b2f68191ab3d admin admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:50:32.218275 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2a99ac-d8c4-4b18-94d7-b2f68191ab3d admin admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:50:32.223735 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6e19bb-b907-4bd0-bb7c-f58f3f1f32bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:50:32.224361 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6e19bb-b907-4bd0-bb7c-f58f3f1f32bc admin admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:50:32.224655 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6e19bb-b907-4bd0-bb7c-f58f3f1f32bc admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:50:32.224954 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6e19bb-b907-4bd0-bb7c-f58f3f1f32bc admin admin] PATH_INFO: `/v3/roles` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:50:32.225605 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6e19bb-b907-4bd0-bb7c-f58f3f1f32bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:50:32.227211 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6e19bb-b907-4bd0-bb7c-f58f3f1f32bc admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:50:32.237562 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 1015/2048] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 30 00:50:32 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 00:50:32.241600 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09120947-0cc2-42bc-acfe-6452add6dc0a admin admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:50:32.251674 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09120947-0cc2-42bc-acfe-6452add6dc0a admin admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:50:32.256861 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18a6d69-e050-4d45-ab98-e4febef2381e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:50:32.257455 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18a6d69-e050-4d45-ab98-e4febef2381e admin admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:50:32.257732 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18a6d69-e050-4d45-ab98-e4febef2381e admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:50:32.258001 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18a6d69-e050-4d45-ab98-e4febef2381e admin admin] PATH_INFO: `/v3/roles` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:50:32.258769 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18a6d69-e050-4d45-ab98-e4febef2381e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:50:32.260383 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18a6d69-e050-4d45-ab98-e4febef2381e admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:50:32.271770 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 1034/2049] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 30 00:50:32 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 30 00:50:32.275709 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6e19bb-b907-4bd0-bb7c-f58f3f1f32bc admin admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:50:32.285707 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6e19bb-b907-4bd0-bb7c-f58f3f1f32bc admin admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:50:32.290326 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e47e55-4fbe-424e-8164-e06a393f6058 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:50:32.290978 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e47e55-4fbe-424e-8164-e06a393f6058 admin admin] REQUEST_METHOD: `PUT` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:50:32.291279 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e47e55-4fbe-424e-8164-e06a393f6058 admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:50:32.291551 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e47e55-4fbe-424e-8164-e06a393f6058 admin admin] PATH_INFO: `/v3/projects/95dd96c181a14d6fa4a15de9ad1a69cd/users/349aa7297b5f45349e6d64fbc2536714/roles/1c93019874174c4b91118d9ce2347e47` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:50:32.306360 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e47e55-4fbe-424e-8164-e06a393f6058 admin admin] RBAC: Authorizing `identity:create_grant(project_id=95dd96c181a14d6fa4a15de9ad1a69cd, user_id=349aa7297b5f45349e6d64fbc2536714, role_id=1c93019874174c4b91118d9ce2347e47)` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:50:32.309036 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e47e55-4fbe-424e-8164-e06a393f6058 admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:50:32.321937 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 1016/2050] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 30 00:50:32 2022] PUT /identity/v3/projects/95dd96c181a14d6fa4a15de9ad1a69cd/users/349aa7297b5f45349e6d64fbc2536714/roles/1c93019874174c4b91118d9ce2347e47 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 00:50:32.332380 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4518a5c-1018-4c77-8cd5-83858f8e1372 None None] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:50:32.332733 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4518a5c-1018-4c77-8cd5-83858f8e1372 None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:50:32.333073 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4518a5c-1018-4c77-8cd5-83858f8e1372 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:50:32.341941 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:50:32.364464 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.auth.core [None req-c4518a5c-1018-4c77-8cd5-83858f8e1372 None None] MFA Rules not processed for user `349aa7297b5f45349e6d64fbc2536714`. Rule list: `[]` (Enabled: `True`). {{(pid=87956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:50:32.365737 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-c4518a5c-1018-4c77-8cd5-83858f8e1372 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:50:32.443571 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 1035/2051] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 30 00:50:32 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:50:32.458093 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e47e55-4fbe-424e-8164-e06a393f6058 admin admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:50:32.459940 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-b1e47e55-4fbe-424e-8164-e06a393f6058 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:50:32.533431 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e47e55-4fbe-424e-8164-e06a393f6058 admin admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:50:32.552009 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6edeeea-856d-4ef2-b4c6-eb9651669d86 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48d928ff7fe24348ac900f09c56acc20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d2387fdf794d4eaef07bbcd7b39f2a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:50:32.552652 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6edeeea-856d-4ef2-b4c6-eb9651669d86 service cinder] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:50:32.553009 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6edeeea-856d-4ef2-b4c6-eb9651669d86 service cinder] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:50:32.553287 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6edeeea-856d-4ef2-b4c6-eb9651669d86 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:50:32.576002 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6edeeea-856d-4ef2-b4c6-eb9651669d86 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:50:32.577625 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6edeeea-856d-4ef2-b4c6-eb9651669d86 service cinder] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:50:32.606500 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 1017/2052] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 30 00:50:32 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 00:50:34.558138 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deae5e9e-18e1-4018-b892-3fb687820dd4 None None] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:50:34.558625 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deae5e9e-18e1-4018-b892-3fb687820dd4 None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:50:34.558850 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deae5e9e-18e1-4018-b892-3fb687820dd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:50:34.579432 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.auth.core [None req-deae5e9e-18e1-4018-b892-3fb687820dd4 None None] MFA Rules not processed for user `eb55b6cbca4945abb21b0e49eb745e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=87956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:50:34.580677 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-deae5e9e-18e1-4018-b892-3fb687820dd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:50:34.651309 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 1036/2053] 10.222.0.45 () {58 vars in 1016 bytes} [Sun Oct 30 00:50:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:50:34.679966 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6edeeea-856d-4ef2-b4c6-eb9651669d86 service cinder] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:50:34.681413 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-d6edeeea-856d-4ef2-b4c6-eb9651669d86 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:50:34.750128 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:50:34.776413 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6edeeea-856d-4ef2-b4c6-eb9651669d86 service cinder] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:50:34.782334 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe5724d-b18c-4ded-93f7-1dab37809979 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fde877b6ddc74f4a87baf21471eb31d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d2387fdf794d4eaef07bbcd7b39f2a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:50:34.782954 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe5724d-b18c-4ded-93f7-1dab37809979 service nova] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:50:34.783254 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe5724d-b18c-4ded-93f7-1dab37809979 service nova] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:50:34.783763 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe5724d-b18c-4ded-93f7-1dab37809979 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:50:34.792828 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe5724d-b18c-4ded-93f7-1dab37809979 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:50:34.794569 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe5724d-b18c-4ded-93f7-1dab37809979 service nova] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:50:34.805591 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 1018/2054] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 30 00:50:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 00:50:39.057251 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a8c531-779d-440a-bba6-6149e92c919b None None] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:50:39.057775 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a8c531-779d-440a-bba6-6149e92c919b None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:50:39.057775 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a8c531-779d-440a-bba6-6149e92c919b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:50:39.082804 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.auth.core [None req-67a8c531-779d-440a-bba6-6149e92c919b None None] MFA Rules not processed for user `3e7b21b55fb84a6cad507a8954492d48`. Rule list: `[]` (Enabled: `True`). {{(pid=87956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:50:39.084260 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-67a8c531-779d-440a-bba6-6149e92c919b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:50:39.161987 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 1037/2055] 10.222.0.42 () {58 vars in 1009 bytes} [Sun Oct 30 00:50:39 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:50:39.176249 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe5724d-b18c-4ded-93f7-1dab37809979 service nova] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:50:39.177903 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-cfe5724d-b18c-4ded-93f7-1dab37809979 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:50:39.281118 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe5724d-b18c-4ded-93f7-1dab37809979 service nova] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:50:39.286105 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc811ce1-52bf-449b-b447-195fb4c42edc service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6d6e884a8104a428e4de6be1cfa467c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d2387fdf794d4eaef07bbcd7b39f2a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:50:39.286740 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc811ce1-52bf-449b-b447-195fb4c42edc service swift] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:50:39.287152 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc811ce1-52bf-449b-b447-195fb4c42edc service swift] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:50:39.287459 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc811ce1-52bf-449b-b447-195fb4c42edc service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:50:39.295825 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc811ce1-52bf-449b-b447-195fb4c42edc service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:50:39.297366 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc811ce1-52bf-449b-b447-195fb4c42edc service swift] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:50:39.305925 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 1019/2056] 10.222.0.42 () {60 vars in 1384 bytes} [Sun Oct 30 00:50:39 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 30 00:50:39.767653 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9068a42-4116-446a-acf5-491762d2be60 None None] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:50:39.767936 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9068a42-4116-446a-acf5-491762d2be60 None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:50:39.768390 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9068a42-4116-446a-acf5-491762d2be60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:50:39.801985 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.auth.core [None req-e9068a42-4116-446a-acf5-491762d2be60 None None] MFA Rules not processed for user `eb55b6cbca4945abb21b0e49eb745e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=87956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:50:39.803775 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-e9068a42-4116-446a-acf5-491762d2be60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:50:39.816276 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 1038/2057] 10.222.0.45 () {58 vars in 1016 bytes} [Sun Oct 30 00:50:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:50:39.851041 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc811ce1-52bf-449b-b447-195fb4c42edc service swift] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:50:39.863650 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc811ce1-52bf-449b-b447-195fb4c42edc service swift] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:50:39.870859 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e939bc-b25c-44e8-9c03-8673779746c5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fde877b6ddc74f4a87baf21471eb31d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d2387fdf794d4eaef07bbcd7b39f2a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:50:39.871851 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e939bc-b25c-44e8-9c03-8673779746c5 service nova] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:50:39.872137 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e939bc-b25c-44e8-9c03-8673779746c5 service nova] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:50:39.872413 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e939bc-b25c-44e8-9c03-8673779746c5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:50:39.882370 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e939bc-b25c-44e8-9c03-8673779746c5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:50:39.884178 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e939bc-b25c-44e8-9c03-8673779746c5 service nova] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:50:39.896373 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 1020/2058] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 30 00:50:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 00:50:43.438665 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3e7033-666e-467f-85a7-a46c194bb00e None None] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:50:43.439583 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3e7033-666e-467f-85a7-a46c194bb00e None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:50:43.440013 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3e7033-666e-467f-85a7-a46c194bb00e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:50:43.469475 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.auth.core [None req-db3e7033-666e-467f-85a7-a46c194bb00e None None] MFA Rules not processed for user `a5f83b66441c437fadca67127c03797b`. Rule list: `[]` (Enabled: `True`). {{(pid=87956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:50:43.470778 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-db3e7033-666e-467f-85a7-a46c194bb00e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:50:43.501927 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=100 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:50:43.532500 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 1039/2059] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 30 00:50:43 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:50:44.038815 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2402be-3369-49ec-b8e0-450de6506c87 None None] REQUEST_METHOD: `POST` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:50:44.039458 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2402be-3369-49ec-b8e0-450de6506c87 None None] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:50:44.039458 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2402be-3369-49ec-b8e0-450de6506c87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:50:44.082229 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.auth.core [None req-fe2402be-3369-49ec-b8e0-450de6506c87 None None] MFA Rules not processed for user `eb55b6cbca4945abb21b0e49eb745e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=87955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:50:44.083632 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-fe2402be-3369-49ec-b8e0-450de6506c87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:50:44.092044 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 1021/2060] 10.222.0.45 () {58 vars in 1016 bytes} [Sun Oct 30 00:50:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:50:44.114735 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3e7033-666e-467f-85a7-a46c194bb00e None None] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:50:44.116367 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-db3e7033-666e-467f-85a7-a46c194bb00e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:50:44.139690 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3e7033-666e-467f-85a7-a46c194bb00e None None] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:50:44.145208 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55ca543-1694-4dda-8546-bbe6613aed49 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fde877b6ddc74f4a87baf21471eb31d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d2387fdf794d4eaef07bbcd7b39f2a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:50:44.146105 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55ca543-1694-4dda-8546-bbe6613aed49 service nova] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:50:44.146522 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55ca543-1694-4dda-8546-bbe6613aed49 service nova] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:50:44.146837 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55ca543-1694-4dda-8546-bbe6613aed49 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:50:44.161084 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55ca543-1694-4dda-8546-bbe6613aed49 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:50:44.162998 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55ca543-1694-4dda-8546-bbe6613aed49 service nova] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:50:44.174423 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 1040/2061] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 30 00:50:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 00:50:48.289837 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df0af57-6607-4ce3-acc9-b26ac0446214 None None] REQUEST_METHOD: `POST` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:50:48.292120 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df0af57-6607-4ce3-acc9-b26ac0446214 None None] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:50:48.293164 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df0af57-6607-4ce3-acc9-b26ac0446214 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:50:48.343832 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.auth.core [None req-0df0af57-6607-4ce3-acc9-b26ac0446214 None None] MFA Rules not processed for user `eb55b6cbca4945abb21b0e49eb745e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=87955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:50:48.345808 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-0df0af57-6607-4ce3-acc9-b26ac0446214 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:50:48.373844 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 1022/2062] 10.222.0.45 () {58 vars in 1016 bytes} [Sun Oct 30 00:50:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:50:48.466325 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55ca543-1694-4dda-8546-bbe6613aed49 service nova] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:50:48.483495 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55ca543-1694-4dda-8546-bbe6613aed49 service nova] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:50:48.496810 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c75d53d-926d-475d-81cc-15b9ef8e99b1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fde877b6ddc74f4a87baf21471eb31d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d2387fdf794d4eaef07bbcd7b39f2a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:50:48.497438 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c75d53d-926d-475d-81cc-15b9ef8e99b1 service nova] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:50:48.498242 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c75d53d-926d-475d-81cc-15b9ef8e99b1 service nova] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:50:48.498588 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c75d53d-926d-475d-81cc-15b9ef8e99b1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:50:48.521130 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c75d53d-926d-475d-81cc-15b9ef8e99b1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:50:48.524919 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c75d53d-926d-475d-81cc-15b9ef8e99b1 service nova] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:50:48.561872 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 1041/2063] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 30 00:50:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 00:50:58.323116 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=53 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:50:58.549306 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=22 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:51:04.339535 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb69f9e-feb4-4233-950e-831d49a6e0e9 None None] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:51:04.340164 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb69f9e-feb4-4233-950e-831d49a6e0e9 None None] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:51:04.340164 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb69f9e-feb4-4233-950e-831d49a6e0e9 None None] PATH_INFO: `/` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:51:04.342369 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 1023/2064] 10.222.0.42 () {54 vars in 921 bytes} [Sun Oct 30 00:51:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:51:04.348582 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b12187-1bee-4a64-b7cb-1982dc8acf66 None None] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:51:04.349122 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b12187-1bee-4a64-b7cb-1982dc8acf66 None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:51:04.354389 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b12187-1bee-4a64-b7cb-1982dc8acf66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:51:04.392036 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.auth.core [None req-68b12187-1bee-4a64-b7cb-1982dc8acf66 None None] MFA Rules not processed for user `fde877b6ddc74f4a87baf21471eb31d2`. Rule list: `[]` (Enabled: `True`). {{(pid=87956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:51:04.393410 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-68b12187-1bee-4a64-b7cb-1982dc8acf66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:51:04.408331 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 1042/2065] 10.222.0.42 () {58 vars in 1018 bytes} [Sun Oct 30 00:51:04 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:51:04.416941 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb69f9e-feb4-4233-950e-831d49a6e0e9 None None] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:51:04.418993 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-7cb69f9e-feb4-4233-950e-831d49a6e0e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:51:04.479215 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb69f9e-feb4-4233-950e-831d49a6e0e9 None None] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:51:04.482956 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542af076-c9e4-4781-a727-0db82359adfa service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36a86cf3eaf24b369737b65046142593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d2387fdf794d4eaef07bbcd7b39f2a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:51:04.483596 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542af076-c9e4-4781-a727-0db82359adfa service glance] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:51:04.483870 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542af076-c9e4-4781-a727-0db82359adfa service glance] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:51:04.484143 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542af076-c9e4-4781-a727-0db82359adfa service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:51:04.495385 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542af076-c9e4-4781-a727-0db82359adfa service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:51:04.496986 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542af076-c9e4-4781-a727-0db82359adfa service glance] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:51:04.507842 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 1024/2066] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 30 00:51:04 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 30 00:51:04.579406 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4731ece-50f0-4d1d-a4a1-2baf5024dbf1 None None] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:51:04.579692 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4731ece-50f0-4d1d-a4a1-2baf5024dbf1 None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:51:04.579962 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4731ece-50f0-4d1d-a4a1-2baf5024dbf1 None None] PATH_INFO: `/` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:51:04.581360 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 1043/2067] 10.222.0.42 () {54 vars in 921 bytes} [Sun Oct 30 00:51:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:51:04.586675 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4a1ffd-c7b8-4a20-a59f-1aa7cf34c954 None None] REQUEST_METHOD: `POST` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:51:04.586962 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4a1ffd-c7b8-4a20-a59f-1aa7cf34c954 None None] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:51:04.587284 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4a1ffd-c7b8-4a20-a59f-1aa7cf34c954 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:51:04.608188 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.auth.core [None req-8b4a1ffd-c7b8-4a20-a59f-1aa7cf34c954 None None] MFA Rules not processed for user `5693f186c6ad4d9394f02ee3477cdcd3`. Rule list: `[]` (Enabled: `True`). {{(pid=87955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:51:04.609413 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-8b4a1ffd-c7b8-4a20-a59f-1aa7cf34c954 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:51:04.670826 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 1025/2068] 10.222.0.42 () {58 vars in 1018 bytes} [Sun Oct 30 00:51:04 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:51:04.684719 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4731ece-50f0-4d1d-a4a1-2baf5024dbf1 None None] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:51:04.686695 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-b4731ece-50f0-4d1d-a4a1-2baf5024dbf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:51:04.700861 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4731ece-50f0-4d1d-a4a1-2baf5024dbf1 None None] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:51:04.705127 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e15b701-6d72-427f-988b-b07c3cbceb4c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5693f186c6ad4d9394f02ee3477cdcd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d2387fdf794d4eaef07bbcd7b39f2a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:51:04.705724 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e15b701-6d72-427f-988b-b07c3cbceb4c service neutron] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:51:04.705998 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e15b701-6d72-427f-988b-b07c3cbceb4c service neutron] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:51:04.706292 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e15b701-6d72-427f-988b-b07c3cbceb4c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:51:04.714325 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e15b701-6d72-427f-988b-b07c3cbceb4c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:51:04.715776 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e15b701-6d72-427f-988b-b07c3cbceb4c service neutron] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:51:04.724606 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 1044/2069] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 30 00:51:04 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 00:51:04.837142 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785080e3-ddb5-4214-add9-259d0d43a54f None None] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:51:04.837456 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785080e3-ddb5-4214-add9-259d0d43a54f None None] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:51:04.837733 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785080e3-ddb5-4214-add9-259d0d43a54f None None] PATH_INFO: `/` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:51:04.839326 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 1026/2070] 10.222.0.42 () {54 vars in 921 bytes} [Sun Oct 30 00:51:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:51:04.845116 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9035cc35-27cd-419e-9440-40cf21f5b844 None None] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:51:04.845509 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9035cc35-27cd-419e-9440-40cf21f5b844 None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:51:04.845844 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9035cc35-27cd-419e-9440-40cf21f5b844 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:51:04.868502 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.auth.core [None req-9035cc35-27cd-419e-9440-40cf21f5b844 None None] MFA Rules not processed for user `fde877b6ddc74f4a87baf21471eb31d2`. Rule list: `[]` (Enabled: `True`). {{(pid=87956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:51:04.870031 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-9035cc35-27cd-419e-9440-40cf21f5b844 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:51:04.881879 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 1045/2071] 10.222.0.42 () {58 vars in 1018 bytes} [Sun Oct 30 00:51:04 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 30 00:51:04.893085 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785080e3-ddb5-4214-add9-259d0d43a54f None None] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:51:04.894939 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-785080e3-ddb5-4214-add9-259d0d43a54f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:51:04.918471 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785080e3-ddb5-4214-add9-259d0d43a54f None None] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:51:04.922262 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a065b579-5798-4134-84ed-5a8f2bb92725 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5693f186c6ad4d9394f02ee3477cdcd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d2387fdf794d4eaef07bbcd7b39f2a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:51:04.922976 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a065b579-5798-4134-84ed-5a8f2bb92725 service neutron] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:51:04.923356 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a065b579-5798-4134-84ed-5a8f2bb92725 service neutron] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:51:04.923700 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a065b579-5798-4134-84ed-5a8f2bb92725 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:51:04.935921 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a065b579-5798-4134-84ed-5a8f2bb92725 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:51:04.936847 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a065b579-5798-4134-84ed-5a8f2bb92725 service neutron] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:51:04.950232 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 1027/2072] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 30 00:51:04 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 00:51:06.355728 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9035cc35-27cd-419e-9440-40cf21f5b844 None None] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:51:06.369081 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9035cc35-27cd-419e-9440-40cf21f5b844 None None] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:51:06.383007 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63948e74-e39a-4aac-a67f-3540dad1ccb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:51:06.383707 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63948e74-e39a-4aac-a67f-3540dad1ccb4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:51:06.383986 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63948e74-e39a-4aac-a67f-3540dad1ccb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:51:06.384246 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63948e74-e39a-4aac-a67f-3540dad1ccb4 admin admin] PATH_INFO: `/v3/users/349aa7297b5f45349e6d64fbc2536714` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:51:06.385377 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63948e74-e39a-4aac-a67f-3540dad1ccb4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=349aa7297b5f45349e6d64fbc2536714)` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:51:06.387329 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63948e74-e39a-4aac-a67f-3540dad1ccb4 admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:51:06.452014 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-63948e74-e39a-4aac-a67f-3540dad1ccb4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '349aa7297b5f45349e6d64fbc2536714'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:51:06.452699 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-63948e74-e39a-4aac-a67f-3540dad1ccb4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '349aa7297b5f45349e6d64fbc2536714'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:51:06.465004 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-63948e74-e39a-4aac-a67f-3540dad1ccb4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '349aa7297b5f45349e6d64fbc2536714'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:51:06.474383 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-63948e74-e39a-4aac-a67f-3540dad1ccb4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '349aa7297b5f45349e6d64fbc2536714'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:51:06.481726 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-63948e74-e39a-4aac-a67f-3540dad1ccb4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '349aa7297b5f45349e6d64fbc2536714'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:51:06.487978 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 1046/2073] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 30 00:51:06 2022] DELETE /identity/v3/users/349aa7297b5f45349e6d64fbc2536714 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 00:51:06.492564 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0c6de5-5b44-46f4-9406-e4f0b392ed22 None None] REQUEST_METHOD: `POST` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:51:06.493065 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0c6de5-5b44-46f4-9406-e4f0b392ed22 None None] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:51:06.493160 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0c6de5-5b44-46f4-9406-e4f0b392ed22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:51:06.512729 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.auth.core [None req-bb0c6de5-5b44-46f4-9406-e4f0b392ed22 None None] MFA Rules not processed for user `eb55b6cbca4945abb21b0e49eb745e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=87955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:51:06.514059 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-bb0c6de5-5b44-46f4-9406-e4f0b392ed22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:51:06.575602 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 1028/2074] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 30 00:51:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:51:06.585497 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63948e74-e39a-4aac-a67f-3540dad1ccb4 admin admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:51:06.586931 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-63948e74-e39a-4aac-a67f-3540dad1ccb4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:51:06.643677 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63948e74-e39a-4aac-a67f-3540dad1ccb4 admin admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:51:06.648227 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2880f01f-a26d-40dc-a63d-bf497e6bd3a8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5693f186c6ad4d9394f02ee3477cdcd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d2387fdf794d4eaef07bbcd7b39f2a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:51:06.648811 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2880f01f-a26d-40dc-a63d-bf497e6bd3a8 service neutron] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:51:06.649086 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2880f01f-a26d-40dc-a63d-bf497e6bd3a8 service neutron] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:51:06.649375 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2880f01f-a26d-40dc-a63d-bf497e6bd3a8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:51:06.660238 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2880f01f-a26d-40dc-a63d-bf497e6bd3a8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:51:06.661790 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2880f01f-a26d-40dc-a63d-bf497e6bd3a8 service neutron] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:51:06.674259 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 1047/2075] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 30 00:51:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 00:51:07.013850 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0c6de5-5b44-46f4-9406-e4f0b392ed22 None None] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:51:07.015423 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-bb0c6de5-5b44-46f4-9406-e4f0b392ed22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:51:07.032426 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0c6de5-5b44-46f4-9406-e4f0b392ed22 None None] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:51:07.037996 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ff1e14-cda8-4b66-9a82-c5b8b37efa94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:51:07.038945 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ff1e14-cda8-4b66-9a82-c5b8b37efa94 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:51:07.039740 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ff1e14-cda8-4b66-9a82-c5b8b37efa94 admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:51:07.040072 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ff1e14-cda8-4b66-9a82-c5b8b37efa94 admin admin] PATH_INFO: `/v3/projects/95dd96c181a14d6fa4a15de9ad1a69cd` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:51:07.042162 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ff1e14-cda8-4b66-9a82-c5b8b37efa94 admin admin] RBAC: Authorizing `identity:delete_project(project_id=95dd96c181a14d6fa4a15de9ad1a69cd)` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:51:07.044306 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ff1e14-cda8-4b66-9a82-c5b8b37efa94 admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:51:07.087939 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:51:07.099746 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-33ff1e14-cda8-4b66-9a82-c5b8b37efa94 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '95dd96c181a14d6fa4a15de9ad1a69cd', 'request_id': 'req-33ff1e14-cda8-4b66-9a82-c5b8b37efa94'} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:51:07.105941 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-33ff1e14-cda8-4b66-9a82-c5b8b37efa94 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '95dd96c181a14d6fa4a15de9ad1a69cd', 'request_id': 'req-33ff1e14-cda8-4b66-9a82-c5b8b37efa94'} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:51:07.113368 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-33ff1e14-cda8-4b66-9a82-c5b8b37efa94 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '95dd96c181a14d6fa4a15de9ad1a69cd', 'request_id': 'req-33ff1e14-cda8-4b66-9a82-c5b8b37efa94'} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:51:07.126576 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-33ff1e14-cda8-4b66-9a82-c5b8b37efa94 admin admin] The token cache is being invalidate because project 95dd96c181a14d6fa4a15de9ad1a69cd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87955) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 00:51:07.126868 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-33ff1e14-cda8-4b66-9a82-c5b8b37efa94 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:51:07.127540 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-33ff1e14-cda8-4b66-9a82-c5b8b37efa94 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:51:07.129051 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 1029/2076] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 30 00:51:07 2022] DELETE /identity/v3/projects/95dd96c181a14d6fa4a15de9ad1a69cd => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 00:51:10.072690 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12647284-d389-440c-a6b7-76c547302a86 None None] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:51:10.073230 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12647284-d389-440c-a6b7-76c547302a86 None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:51:10.073230 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12647284-d389-440c-a6b7-76c547302a86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:51:10.093531 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.auth.core [None req-12647284-d389-440c-a6b7-76c547302a86 None None] MFA Rules not processed for user `3e7b21b55fb84a6cad507a8954492d48`. Rule list: `[]` (Enabled: `True`). {{(pid=87956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:51:10.094769 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-12647284-d389-440c-a6b7-76c547302a86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:51:10.144232 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:51:10.157676 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 1048/2077] 10.222.0.42 () {58 vars in 1009 bytes} [Sun Oct 30 00:51:10 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:51:10.170379 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ff1e14-cda8-4b66-9a82-c5b8b37efa94 admin admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:51:10.171830 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-33ff1e14-cda8-4b66-9a82-c5b8b37efa94 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:51:10.245589 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ff1e14-cda8-4b66-9a82-c5b8b37efa94 admin admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:51:10.251361 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4205fbd4-2ed4-438d-ba98-4079a3692a3e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6d6e884a8104a428e4de6be1cfa467c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d2387fdf794d4eaef07bbcd7b39f2a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:51:10.251984 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4205fbd4-2ed4-438d-ba98-4079a3692a3e service swift] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:51:10.252256 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4205fbd4-2ed4-438d-ba98-4079a3692a3e service swift] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:51:10.252521 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4205fbd4-2ed4-438d-ba98-4079a3692a3e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:51:10.260502 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4205fbd4-2ed4-438d-ba98-4079a3692a3e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:51:10.262051 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4205fbd4-2ed4-438d-ba98-4079a3692a3e service swift] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:51:10.270229 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 1030/2078] 10.222.0.42 () {60 vars in 1384 bytes} [Sun Oct 30 00:51:10 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 30 00:51:10.720194 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55a1947-c8f3-4d55-8f5f-24a8bc616be5 None None] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:51:10.720690 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55a1947-c8f3-4d55-8f5f-24a8bc616be5 None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:51:10.721182 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55a1947-c8f3-4d55-8f5f-24a8bc616be5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:51:10.764190 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.auth.core [None req-b55a1947-c8f3-4d55-8f5f-24a8bc616be5 None None] MFA Rules not processed for user `565269e8445b4eb1ab215a108f6e7d85`. Rule list: `[]` (Enabled: `True`). {{(pid=87956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:51:10.766239 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-b55a1947-c8f3-4d55-8f5f-24a8bc616be5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:51:10.843785 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 1049/2079] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 30 00:51:10 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:51:11.924988 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b65a79-b0ec-4973-93e0-77dcf3dbdc72 None None] REQUEST_METHOD: `POST` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:51:11.925402 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b65a79-b0ec-4973-93e0-77dcf3dbdc72 None None] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:51:11.925653 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b65a79-b0ec-4973-93e0-77dcf3dbdc72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:51:11.951503 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.auth.core [None req-25b65a79-b0ec-4973-93e0-77dcf3dbdc72 None None] MFA Rules not processed for user `3e7b21b55fb84a6cad507a8954492d48`. Rule list: `[]` (Enabled: `True`). {{(pid=87955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:51:11.953341 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-25b65a79-b0ec-4973-93e0-77dcf3dbdc72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:51:11.963705 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 1031/2080] 10.222.0.42 () {58 vars in 1009 bytes} [Sun Oct 30 00:51:11 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 30 00:51:11.986167 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55a1947-c8f3-4d55-8f5f-24a8bc616be5 None None] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:51:11.999691 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55a1947-c8f3-4d55-8f5f-24a8bc616be5 None None] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:51:12.005514 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3565f112-4d78-476c-a2f6-752b58ac76ff service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6d6e884a8104a428e4de6be1cfa467c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d2387fdf794d4eaef07bbcd7b39f2a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:51:12.006138 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3565f112-4d78-476c-a2f6-752b58ac76ff service swift] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:51:12.006415 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3565f112-4d78-476c-a2f6-752b58ac76ff service swift] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:51:12.006685 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3565f112-4d78-476c-a2f6-752b58ac76ff service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:51:12.016651 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3565f112-4d78-476c-a2f6-752b58ac76ff service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:51:12.018481 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3565f112-4d78-476c-a2f6-752b58ac76ff service swift] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:51:12.028874 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 1050/2081] 10.222.0.42 () {60 vars in 1384 bytes} [Sun Oct 30 00:51:11 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 30 00:51:21.945169 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:DELETE=5,keystone:SELECT=46,keystone:INSERT=1 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:51:22.024679 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=34 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:51:28.189246 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee9040c-4d2a-4497-bf7e-9c70c2f72d68 None None] REQUEST_METHOD: `POST` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:51:28.189829 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee9040c-4d2a-4497-bf7e-9c70c2f72d68 None None] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:51:28.189947 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee9040c-4d2a-4497-bf7e-9c70c2f72d68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:51:28.209802 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.auth.core [None req-3ee9040c-4d2a-4497-bf7e-9c70c2f72d68 None None] MFA Rules not processed for user `3e7b21b55fb84a6cad507a8954492d48`. Rule list: `[]` (Enabled: `True`). {{(pid=87955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:51:28.211313 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-3ee9040c-4d2a-4497-bf7e-9c70c2f72d68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:51:28.218371 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 1032/2082] 10.222.0.42 () {58 vars in 967 bytes} [Sun Oct 30 00:51:28 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:51:28.231419 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3565f112-4d78-476c-a2f6-752b58ac76ff service swift] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:51:28.242147 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3565f112-4d78-476c-a2f6-752b58ac76ff service swift] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:51:28.247684 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a53113-4b5c-4d9a-beea-99d94e7a8851 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6d6e884a8104a428e4de6be1cfa467c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d2387fdf794d4eaef07bbcd7b39f2a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:51:28.248656 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a53113-4b5c-4d9a-beea-99d94e7a8851 service swift] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:51:28.249190 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a53113-4b5c-4d9a-beea-99d94e7a8851 service swift] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:51:28.249512 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a53113-4b5c-4d9a-beea-99d94e7a8851 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:51:28.258505 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a53113-4b5c-4d9a-beea-99d94e7a8851 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:51:28.260104 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a53113-4b5c-4d9a-beea-99d94e7a8851 service swift] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:51:28.268665 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 1051/2083] 10.222.0.42 () {60 vars in 1384 bytes} [Sun Oct 30 00:51:28 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 30 00:51:30.196671 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3d8740-3a2b-4a77-b59a-5ebbb469ec3a None None] REQUEST_METHOD: `POST` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:51:30.197139 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3d8740-3a2b-4a77-b59a-5ebbb469ec3a None None] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:51:30.197228 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3d8740-3a2b-4a77-b59a-5ebbb469ec3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:51:30.219430 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.auth.core [None req-cf3d8740-3a2b-4a77-b59a-5ebbb469ec3a None None] MFA Rules not processed for user `3e7b21b55fb84a6cad507a8954492d48`. Rule list: `[]` (Enabled: `True`). {{(pid=87955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:51:30.220659 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-cf3d8740-3a2b-4a77-b59a-5ebbb469ec3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:51:30.228577 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 1033/2084] 10.222.0.42 () {58 vars in 967 bytes} [Sun Oct 30 00:51:30 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:51:30.242769 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a53113-4b5c-4d9a-beea-99d94e7a8851 service swift] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:51:30.256885 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a53113-4b5c-4d9a-beea-99d94e7a8851 service swift] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:51:30.258015 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3d8740-3a2b-4a77-b59a-5ebbb469ec3a None None] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:51:30.259586 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-cf3d8740-3a2b-4a77-b59a-5ebbb469ec3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:51:30.262071 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7eb03b3-eb92-4abf-bca8-9c7f444918b0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6d6e884a8104a428e4de6be1cfa467c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d2387fdf794d4eaef07bbcd7b39f2a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:51:30.262896 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7eb03b3-eb92-4abf-bca8-9c7f444918b0 service swift] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:51:30.263177 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7eb03b3-eb92-4abf-bca8-9c7f444918b0 service swift] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:51:30.263521 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7eb03b3-eb92-4abf-bca8-9c7f444918b0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:51:30.274255 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7eb03b3-eb92-4abf-bca8-9c7f444918b0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:51:30.275882 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7eb03b3-eb92-4abf-bca8-9c7f444918b0 service swift] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:51:30.284247 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 1052/2085] 10.222.0.42 () {60 vars in 1384 bytes} [Sun Oct 30 00:51:30 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 30 00:51:30.332603 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3d8740-3a2b-4a77-b59a-5ebbb469ec3a None None] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:51:30.337380 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e12a011-52d7-4bfb-8cd5-546fbd4ae97b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:51:30.338009 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e12a011-52d7-4bfb-8cd5-546fbd4ae97b admin admin] REQUEST_METHOD: `DELETE` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:51:30.338283 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e12a011-52d7-4bfb-8cd5-546fbd4ae97b admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:51:30.338550 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e12a011-52d7-4bfb-8cd5-546fbd4ae97b admin admin] PATH_INFO: `/v3/users/a5f83b66441c437fadca67127c03797b` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:51:30.339857 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e12a011-52d7-4bfb-8cd5-546fbd4ae97b admin admin] RBAC: Authorizing `identity:delete_user(user_id=a5f83b66441c437fadca67127c03797b)` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:51:30.341658 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e12a011-52d7-4bfb-8cd5-546fbd4ae97b admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:51:30.395698 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-5e12a011-52d7-4bfb-8cd5-546fbd4ae97b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a5f83b66441c437fadca67127c03797b'} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:51:30.396553 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-5e12a011-52d7-4bfb-8cd5-546fbd4ae97b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a5f83b66441c437fadca67127c03797b'} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:51:30.404333 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-5e12a011-52d7-4bfb-8cd5-546fbd4ae97b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a5f83b66441c437fadca67127c03797b'} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:51:30.405058 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-5e12a011-52d7-4bfb-8cd5-546fbd4ae97b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a5f83b66441c437fadca67127c03797b'} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:51:30.417104 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-5e12a011-52d7-4bfb-8cd5-546fbd4ae97b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a5f83b66441c437fadca67127c03797b'} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:51:30.432233 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 1034/2086] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 30 00:51:30 2022] DELETE /identity/v3/users/a5f83b66441c437fadca67127c03797b => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 00:51:30.703653 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7eb03b3-eb92-4abf-bca8-9c7f444918b0 service swift] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:51:30.717348 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7eb03b3-eb92-4abf-bca8-9c7f444918b0 service swift] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:51:30.802214 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e55226c-82c9-40eb-a992-ffd2e533fb53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:51:30.802866 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e55226c-82c9-40eb-a992-ffd2e533fb53 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:51:30.803130 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e55226c-82c9-40eb-a992-ffd2e533fb53 admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:51:30.803431 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e55226c-82c9-40eb-a992-ffd2e533fb53 admin admin] PATH_INFO: `/v3/projects/5104b467c19e4b9a9d2b4e44df656fb0` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:51:30.804541 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e55226c-82c9-40eb-a992-ffd2e533fb53 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5104b467c19e4b9a9d2b4e44df656fb0)` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:51:30.806856 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e55226c-82c9-40eb-a992-ffd2e533fb53 admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:51:30.855970 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-0e55226c-82c9-40eb-a992-ffd2e533fb53 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5104b467c19e4b9a9d2b4e44df656fb0', 'request_id': 'req-0e55226c-82c9-40eb-a992-ffd2e533fb53'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:51:30.865429 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-0e55226c-82c9-40eb-a992-ffd2e533fb53 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5104b467c19e4b9a9d2b4e44df656fb0', 'request_id': 'req-0e55226c-82c9-40eb-a992-ffd2e533fb53'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:51:30.872704 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-0e55226c-82c9-40eb-a992-ffd2e533fb53 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5104b467c19e4b9a9d2b4e44df656fb0', 'request_id': 'req-0e55226c-82c9-40eb-a992-ffd2e533fb53'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:51:30.886288 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-0e55226c-82c9-40eb-a992-ffd2e533fb53 admin admin] The token cache is being invalidate because project 5104b467c19e4b9a9d2b4e44df656fb0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87956) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 00:51:30.886574 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-0e55226c-82c9-40eb-a992-ffd2e533fb53 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:51:30.887532 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-0e55226c-82c9-40eb-a992-ffd2e533fb53 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:51:30.889083 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 1053/2087] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 30 00:51:30 2022] DELETE /identity/v3/projects/5104b467c19e4b9a9d2b4e44df656fb0 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 00:51:37.455439 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396da246-0226-440e-afe2-2f230204b263 None None] REQUEST_METHOD: `POST` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:51:37.456035 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396da246-0226-440e-afe2-2f230204b263 None None] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:51:37.456035 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396da246-0226-440e-afe2-2f230204b263 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:51:37.476951 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.auth.core [None req-396da246-0226-440e-afe2-2f230204b263 None None] MFA Rules not processed for user `eb55b6cbca4945abb21b0e49eb745e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=87955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:51:37.478156 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-396da246-0226-440e-afe2-2f230204b263 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:51:37.540199 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 1035/2088] 10.222.0.45 () {58 vars in 1016 bytes} [Sun Oct 30 00:51:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:51:37.565655 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e55226c-82c9-40eb-a992-ffd2e533fb53 admin admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:51:37.567241 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-0e55226c-82c9-40eb-a992-ffd2e533fb53 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:51:37.636941 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:51:37.643739 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e55226c-82c9-40eb-a992-ffd2e533fb53 admin admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:51:37.650746 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbeef277-5def-4eba-aa89-ae3f3f1c2aa5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fde877b6ddc74f4a87baf21471eb31d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d2387fdf794d4eaef07bbcd7b39f2a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:51:37.651385 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbeef277-5def-4eba-aa89-ae3f3f1c2aa5 service nova] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:51:37.651664 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbeef277-5def-4eba-aa89-ae3f3f1c2aa5 service nova] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:51:37.651935 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbeef277-5def-4eba-aa89-ae3f3f1c2aa5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:51:37.660428 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbeef277-5def-4eba-aa89-ae3f3f1c2aa5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:51:37.662012 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbeef277-5def-4eba-aa89-ae3f3f1c2aa5 service nova] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:51:37.672136 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 1054/2089] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 30 00:51:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 00:51:41.748154 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0f5270-b792-44eb-991a-c4dbb8e0c480 None None] REQUEST_METHOD: `POST` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:51:41.749123 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0f5270-b792-44eb-991a-c4dbb8e0c480 None None] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:51:41.749396 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0f5270-b792-44eb-991a-c4dbb8e0c480 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:51:41.768442 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:51:41.775407 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.auth.core [None req-ed0f5270-b792-44eb-991a-c4dbb8e0c480 None None] MFA Rules not processed for user `eb55b6cbca4945abb21b0e49eb745e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=87955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:51:41.777562 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-ed0f5270-b792-44eb-991a-c4dbb8e0c480 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:51:41.786401 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 1036/2090] 10.222.0.45 () {58 vars in 1016 bytes} [Sun Oct 30 00:51:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:51:41.808427 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbeef277-5def-4eba-aa89-ae3f3f1c2aa5 service nova] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:51:41.809931 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-cbeef277-5def-4eba-aa89-ae3f3f1c2aa5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:51:41.825000 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbeef277-5def-4eba-aa89-ae3f3f1c2aa5 service nova] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:51:41.831874 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c93444-a9ee-467d-aa5c-0dbf246795d5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fde877b6ddc74f4a87baf21471eb31d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d2387fdf794d4eaef07bbcd7b39f2a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:51:41.832451 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c93444-a9ee-467d-aa5c-0dbf246795d5 service nova] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:51:41.832707 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c93444-a9ee-467d-aa5c-0dbf246795d5 service nova] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:51:41.832972 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c93444-a9ee-467d-aa5c-0dbf246795d5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:51:41.842185 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c93444-a9ee-467d-aa5c-0dbf246795d5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:51:41.843807 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c93444-a9ee-467d-aa5c-0dbf246795d5 service nova] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:51:41.854818 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 1055/2091] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 30 00:51:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 00:51:43.717639 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7e12ca-3cd9-433f-98c2-44d748934652 None None] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:51:43.718190 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7e12ca-3cd9-433f-98c2-44d748934652 None None] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:51:43.718190 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7e12ca-3cd9-433f-98c2-44d748934652 None None] PATH_INFO: `/` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:51:43.719475 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 1037/2092] 10.222.0.42 () {54 vars in 961 bytes} [Sun Oct 30 00:51:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:51:43.726360 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917af4dd-cc20-4f32-9669-f67b8e49041d None None] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:51:43.727274 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917af4dd-cc20-4f32-9669-f67b8e49041d None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:51:43.727792 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917af4dd-cc20-4f32-9669-f67b8e49041d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:51:43.752762 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.auth.core [None req-917af4dd-cc20-4f32-9669-f67b8e49041d None None] MFA Rules not processed for user `202b8b2c0f454297bfb97c1ac4033625`. Rule list: `[]` (Enabled: `True`). {{(pid=87956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:51:43.753943 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-917af4dd-cc20-4f32-9669-f67b8e49041d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:51:43.826623 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 1056/2093] 10.222.0.42 () {58 vars in 1058 bytes} [Sun Oct 30 00:51:43 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:51:43.840062 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7e12ca-3cd9-433f-98c2-44d748934652 None None] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:51:43.856499 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7e12ca-3cd9-433f-98c2-44d748934652 None None] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:51:43.862238 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de75f125-42e8-4b36-a63d-6537ac0c03a3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '202b8b2c0f454297bfb97c1ac4033625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d2387fdf794d4eaef07bbcd7b39f2a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:51:43.863075 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de75f125-42e8-4b36-a63d-6537ac0c03a3 service placement] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:51:43.863484 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de75f125-42e8-4b36-a63d-6537ac0c03a3 service placement] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:51:43.863844 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de75f125-42e8-4b36-a63d-6537ac0c03a3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:51:43.866751 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-de75f125-42e8-4b36-a63d-6537ac0c03a3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:51:43.879786 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de75f125-42e8-4b36-a63d-6537ac0c03a3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:51:43.881626 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de75f125-42e8-4b36-a63d-6537ac0c03a3 service placement] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:51:43.893453 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 1038/2094] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 30 00:51:43 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 00:51:44.845602 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d94c3d-e447-43b3-b3db-41354e0be25b None None] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:51:44.846128 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d94c3d-e447-43b3-b3db-41354e0be25b None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:51:44.846128 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d94c3d-e447-43b3-b3db-41354e0be25b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:51:44.866092 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.auth.core [None req-89d94c3d-e447-43b3-b3db-41354e0be25b None None] MFA Rules not processed for user `eb55b6cbca4945abb21b0e49eb745e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=87956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:51:44.867301 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-89d94c3d-e447-43b3-b3db-41354e0be25b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:51:44.875563 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 1057/2095] 10.222.0.45 () {58 vars in 1016 bytes} [Sun Oct 30 00:51:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:51:44.902883 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de75f125-42e8-4b36-a63d-6537ac0c03a3 service placement] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:51:44.916325 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de75f125-42e8-4b36-a63d-6537ac0c03a3 service placement] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:51:44.922012 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacd1cc9-e3da-45d6-89a7-7f679f329d99 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fde877b6ddc74f4a87baf21471eb31d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d2387fdf794d4eaef07bbcd7b39f2a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:51:44.922634 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacd1cc9-e3da-45d6-89a7-7f679f329d99 service nova] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:51:44.922902 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacd1cc9-e3da-45d6-89a7-7f679f329d99 service nova] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:51:44.923163 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacd1cc9-e3da-45d6-89a7-7f679f329d99 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:51:44.932017 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aacd1cc9-e3da-45d6-89a7-7f679f329d99 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:51:44.933666 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aacd1cc9-e3da-45d6-89a7-7f679f329d99 service nova] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:51:44.943909 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 1039/2096] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 30 00:51:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 00:51:49.084621 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8ce19a-ceff-4caf-8d44-09b5c7826374 None None] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:51:49.085243 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8ce19a-ceff-4caf-8d44-09b5c7826374 None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:51:49.085243 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8ce19a-ceff-4caf-8d44-09b5c7826374 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:51:49.109432 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.auth.core [None req-9a8ce19a-ceff-4caf-8d44-09b5c7826374 None None] MFA Rules not processed for user `eb55b6cbca4945abb21b0e49eb745e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=87956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:51:49.110623 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-9a8ce19a-ceff-4caf-8d44-09b5c7826374 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:51:49.120149 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 1058/2097] 10.222.0.45 () {58 vars in 1016 bytes} [Sun Oct 30 00:51:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:51:49.149039 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacd1cc9-e3da-45d6-89a7-7f679f329d99 service nova] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:51:49.160488 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacd1cc9-e3da-45d6-89a7-7f679f329d99 service nova] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:51:49.167769 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c5d20b-c5fe-445a-b272-73b87c7c7988 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fde877b6ddc74f4a87baf21471eb31d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d2387fdf794d4eaef07bbcd7b39f2a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:51:49.168281 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c5d20b-c5fe-445a-b272-73b87c7c7988 service nova] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:51:49.168564 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c5d20b-c5fe-445a-b272-73b87c7c7988 service nova] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:51:49.168834 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c5d20b-c5fe-445a-b272-73b87c7c7988 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:51:49.177554 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c5d20b-c5fe-445a-b272-73b87c7c7988 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:51:49.179221 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c5d20b-c5fe-445a-b272-73b87c7c7988 service nova] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:51:49.188582 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 1040/2098] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 30 00:51:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 00:51:53.274740 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6853ec79-2dfd-436e-bbb6-69e2d7950304 None None] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:51:53.275303 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6853ec79-2dfd-436e-bbb6-69e2d7950304 None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:51:53.275303 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6853ec79-2dfd-436e-bbb6-69e2d7950304 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:51:53.296172 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.auth.core [None req-6853ec79-2dfd-436e-bbb6-69e2d7950304 None None] MFA Rules not processed for user `eb55b6cbca4945abb21b0e49eb745e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=87956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:51:53.297801 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-6853ec79-2dfd-436e-bbb6-69e2d7950304 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:51:53.307452 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 1059/2099] 10.222.0.45 () {58 vars in 1016 bytes} [Sun Oct 30 00:51:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:51:53.354781 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c5d20b-c5fe-445a-b272-73b87c7c7988 service nova] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:51:53.366085 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c5d20b-c5fe-445a-b272-73b87c7c7988 service nova] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:51:53.373190 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee98f39-5b41-476c-904d-b75bb0049c12 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fde877b6ddc74f4a87baf21471eb31d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d2387fdf794d4eaef07bbcd7b39f2a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:51:53.373781 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee98f39-5b41-476c-904d-b75bb0049c12 service nova] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:51:53.374051 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee98f39-5b41-476c-904d-b75bb0049c12 service nova] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:51:53.374316 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee98f39-5b41-476c-904d-b75bb0049c12 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:51:53.382924 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee98f39-5b41-476c-904d-b75bb0049c12 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:51:53.384532 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee98f39-5b41-476c-904d-b75bb0049c12 service nova] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:51:53.394048 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 1041/2100] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 30 00:51:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 00:52:00.496593 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a0d892-ab6a-4254-af55-bb1905a47057 None None] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:00.497115 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a0d892-ab6a-4254-af55-bb1905a47057 None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:00.497115 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a0d892-ab6a-4254-af55-bb1905a47057 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:00.516725 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.auth.core [None req-a0a0d892-ab6a-4254-af55-bb1905a47057 None None] MFA Rules not processed for user `861d1145dd48414c9388bed57e993493`. Rule list: `[]` (Enabled: `True`). {{(pid=87956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:52:00.517949 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-a0a0d892-ab6a-4254-af55-bb1905a47057 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:52:00.573020 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 1060/2101] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 30 00:52:00 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:52:03.389685 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=24 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:52:08.272198 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c932fb5c-eb54-4861-98d5-6c69b1bfe456 None None] REQUEST_METHOD: `POST` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:08.272931 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c932fb5c-eb54-4861-98d5-6c69b1bfe456 None None] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:08.272931 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c932fb5c-eb54-4861-98d5-6c69b1bfe456 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:08.296356 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.auth.core [None req-c932fb5c-eb54-4861-98d5-6c69b1bfe456 None None] MFA Rules not processed for user `6215c75145174a63b88110843e7c29c7`. Rule list: `[]` (Enabled: `True`). {{(pid=87955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:52:08.297733 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-c932fb5c-eb54-4861-98d5-6c69b1bfe456 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:52:08.359754 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 1042/2102] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 30 00:52:08 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:52:10.565788 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=74 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:52:18.353210 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=25 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:52:20.494158 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869feb02-44fa-403b-bb13-69fb9fb88edf None None] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:20.494663 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869feb02-44fa-403b-bb13-69fb9fb88edf None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:20.494663 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869feb02-44fa-403b-bb13-69fb9fb88edf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:20.514177 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.auth.core [None req-869feb02-44fa-403b-bb13-69fb9fb88edf None None] MFA Rules not processed for user `431eca0bd74247b8bcb832ed1c9ae3ac`. Rule list: `[]` (Enabled: `True`). {{(pid=87956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:52:20.515431 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-869feb02-44fa-403b-bb13-69fb9fb88edf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:52:20.573309 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 1061/2103] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 30 00:52:20 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:52:27.296530 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c932fb5c-eb54-4861-98d5-6c69b1bfe456 None None] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:52:27.297999 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-c932fb5c-eb54-4861-98d5-6c69b1bfe456 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:52:27.313088 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c932fb5c-eb54-4861-98d5-6c69b1bfe456 None None] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:52:27.317658 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20749aa0-7e58-43d3-a413-beabd413f08e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:52:27.318697 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20749aa0-7e58-43d3-a413-beabd413f08e admin admin] REQUEST_METHOD: `DELETE` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:27.319014 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20749aa0-7e58-43d3-a413-beabd413f08e admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:27.319318 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20749aa0-7e58-43d3-a413-beabd413f08e admin admin] PATH_INFO: `/v3/users/565269e8445b4eb1ab215a108f6e7d85` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:27.320498 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20749aa0-7e58-43d3-a413-beabd413f08e admin admin] RBAC: Authorizing `identity:delete_user(user_id=565269e8445b4eb1ab215a108f6e7d85)` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:52:27.322426 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20749aa0-7e58-43d3-a413-beabd413f08e admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:52:27.372501 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-20749aa0-7e58-43d3-a413-beabd413f08e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '565269e8445b4eb1ab215a108f6e7d85'} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:52:27.373144 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-20749aa0-7e58-43d3-a413-beabd413f08e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '565269e8445b4eb1ab215a108f6e7d85'} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:52:27.380574 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-20749aa0-7e58-43d3-a413-beabd413f08e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '565269e8445b4eb1ab215a108f6e7d85'} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:52:27.381743 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-20749aa0-7e58-43d3-a413-beabd413f08e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '565269e8445b4eb1ab215a108f6e7d85'} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:52:27.394423 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-20749aa0-7e58-43d3-a413-beabd413f08e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '565269e8445b4eb1ab215a108f6e7d85'} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:52:27.409071 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 1043/2104] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 30 00:52:27 2022] DELETE /identity/v3/users/565269e8445b4eb1ab215a108f6e7d85 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 00:52:27.593713 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869feb02-44fa-403b-bb13-69fb9fb88edf None None] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:52:27.605924 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869feb02-44fa-403b-bb13-69fb9fb88edf None None] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:52:27.668985 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e567f138-5705-4876-89b3-562d382be9fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:52:27.669617 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e567f138-5705-4876-89b3-562d382be9fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:27.669892 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e567f138-5705-4876-89b3-562d382be9fe admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:27.670165 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e567f138-5705-4876-89b3-562d382be9fe admin admin] PATH_INFO: `/v3/projects/a47f747eadff4e21be98fe4e123df974` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:27.671300 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e567f138-5705-4876-89b3-562d382be9fe admin admin] RBAC: Authorizing `identity:delete_project(project_id=a47f747eadff4e21be98fe4e123df974)` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:52:27.673213 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e567f138-5705-4876-89b3-562d382be9fe admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:52:27.727688 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-e567f138-5705-4876-89b3-562d382be9fe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a47f747eadff4e21be98fe4e123df974', 'request_id': 'req-e567f138-5705-4876-89b3-562d382be9fe'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:52:27.737407 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-e567f138-5705-4876-89b3-562d382be9fe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a47f747eadff4e21be98fe4e123df974', 'request_id': 'req-e567f138-5705-4876-89b3-562d382be9fe'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:52:27.745380 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-e567f138-5705-4876-89b3-562d382be9fe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a47f747eadff4e21be98fe4e123df974', 'request_id': 'req-e567f138-5705-4876-89b3-562d382be9fe'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:52:27.756286 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-e567f138-5705-4876-89b3-562d382be9fe admin admin] The token cache is being invalidate because project a47f747eadff4e21be98fe4e123df974 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87956) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 00:52:27.756569 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-e567f138-5705-4876-89b3-562d382be9fe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:52:27.757222 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-e567f138-5705-4876-89b3-562d382be9fe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:52:27.758722 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 1062/2105] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 30 00:52:27 2022] DELETE /identity/v3/projects/a47f747eadff4e21be98fe4e123df974 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 00:52:37.405795 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=29,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:52:37.753394 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=76,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:53:14.065668 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20749aa0-7e58-43d3-a413-beabd413f08e admin admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:53:14.067243 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-20749aa0-7e58-43d3-a413-beabd413f08e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:53:14.081812 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20749aa0-7e58-43d3-a413-beabd413f08e admin admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:53:14.145377 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70fa9a1-3e59-4d19-b618-c66f85c38f66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:53:14.146112 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70fa9a1-3e59-4d19-b618-c66f85c38f66 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:53:14.146389 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70fa9a1-3e59-4d19-b618-c66f85c38f66 admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:53:14.146791 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70fa9a1-3e59-4d19-b618-c66f85c38f66 admin admin] PATH_INFO: `/v3/users/6215c75145174a63b88110843e7c29c7` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:53:14.148092 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70fa9a1-3e59-4d19-b618-c66f85c38f66 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6215c75145174a63b88110843e7c29c7)` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:53:14.150065 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70fa9a1-3e59-4d19-b618-c66f85c38f66 admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:53:14.199942 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-f70fa9a1-3e59-4d19-b618-c66f85c38f66 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6215c75145174a63b88110843e7c29c7'} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:53:14.200508 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-f70fa9a1-3e59-4d19-b618-c66f85c38f66 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6215c75145174a63b88110843e7c29c7'} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:53:14.207506 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-f70fa9a1-3e59-4d19-b618-c66f85c38f66 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6215c75145174a63b88110843e7c29c7'} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:53:14.208132 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-f70fa9a1-3e59-4d19-b618-c66f85c38f66 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6215c75145174a63b88110843e7c29c7'} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:53:14.219715 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-f70fa9a1-3e59-4d19-b618-c66f85c38f66 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6215c75145174a63b88110843e7c29c7'} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:53:14.233811 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 1044/2106] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 30 00:53:14 2022] DELETE /identity/v3/users/6215c75145174a63b88110843e7c29c7 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 00:53:14.425527 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e567f138-5705-4876-89b3-562d382be9fe admin admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:53:14.427586 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-e567f138-5705-4876-89b3-562d382be9fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:53:14.441649 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e567f138-5705-4876-89b3-562d382be9fe admin admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:53:14.508412 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb7b8d8-e200-4dca-8031-bf14b03acc9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:53:14.509149 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb7b8d8-e200-4dca-8031-bf14b03acc9b admin admin] REQUEST_METHOD: `DELETE` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:53:14.509427 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb7b8d8-e200-4dca-8031-bf14b03acc9b admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:53:14.509699 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb7b8d8-e200-4dca-8031-bf14b03acc9b admin admin] PATH_INFO: `/v3/projects/07ced1d2691444c3a6e3dc0164104d81` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:53:14.510851 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb7b8d8-e200-4dca-8031-bf14b03acc9b admin admin] RBAC: Authorizing `identity:delete_project(project_id=07ced1d2691444c3a6e3dc0164104d81)` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:53:14.512877 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb7b8d8-e200-4dca-8031-bf14b03acc9b admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:53:14.560670 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-fbb7b8d8-e200-4dca-8031-bf14b03acc9b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '07ced1d2691444c3a6e3dc0164104d81', 'request_id': 'req-fbb7b8d8-e200-4dca-8031-bf14b03acc9b'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:53:14.570430 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-fbb7b8d8-e200-4dca-8031-bf14b03acc9b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '07ced1d2691444c3a6e3dc0164104d81', 'request_id': 'req-fbb7b8d8-e200-4dca-8031-bf14b03acc9b'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:53:14.577802 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-fbb7b8d8-e200-4dca-8031-bf14b03acc9b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '07ced1d2691444c3a6e3dc0164104d81', 'request_id': 'req-fbb7b8d8-e200-4dca-8031-bf14b03acc9b'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:53:14.589092 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-fbb7b8d8-e200-4dca-8031-bf14b03acc9b admin admin] The token cache is being invalidate because project 07ced1d2691444c3a6e3dc0164104d81 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87956) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 00:53:14.589410 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-fbb7b8d8-e200-4dca-8031-bf14b03acc9b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:53:14.590062 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-fbb7b8d8-e200-4dca-8031-bf14b03acc9b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:53:14.591638 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 1063/2107] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 30 00:53:14 2022] DELETE /identity/v3/projects/07ced1d2691444c3a6e3dc0164104d81 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 00:53:14.596977 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc2fa8f-947f-463e-a01b-921e6aaafc9e None None] REQUEST_METHOD: `POST` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:53:14.597266 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc2fa8f-947f-463e-a01b-921e6aaafc9e None None] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:53:14.597564 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc2fa8f-947f-463e-a01b-921e6aaafc9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:53:14.618262 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.auth.core [None req-7cc2fa8f-947f-463e-a01b-921e6aaafc9e None None] MFA Rules not processed for user `eb55b6cbca4945abb21b0e49eb745e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=87955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:53:14.619789 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-7cc2fa8f-947f-463e-a01b-921e6aaafc9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:53:14.682440 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 1045/2108] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 30 00:53:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:53:14.690484 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09841bae-b93b-4c5b-926e-617a3ede7c91 None None] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:53:14.690768 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09841bae-b93b-4c5b-926e-617a3ede7c91 None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:53:14.691057 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09841bae-b93b-4c5b-926e-617a3ede7c91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:53:14.712330 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.auth.core [None req-09841bae-b93b-4c5b-926e-617a3ede7c91 None None] MFA Rules not processed for user `eb55b6cbca4945abb21b0e49eb745e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=87956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:53:14.713453 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-09841bae-b93b-4c5b-926e-617a3ede7c91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:53:14.721601 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 1064/2109] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 30 00:53:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:53:14.726074 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc2fa8f-947f-463e-a01b-921e6aaafc9e None None] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:53:14.737278 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc2fa8f-947f-463e-a01b-921e6aaafc9e None None] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:53:14.742009 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8785129-4f11-4f09-9a10-56c7005f05a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:53:14.742609 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8785129-4f11-4f09-9a10-56c7005f05a4 admin admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:53:14.742884 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8785129-4f11-4f09-9a10-56c7005f05a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:53:14.743147 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8785129-4f11-4f09-9a10-56c7005f05a4 admin admin] PATH_INFO: `/v3/domains` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:53:14.743839 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8785129-4f11-4f09-9a10-56c7005f05a4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:53:14.744133 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8785129-4f11-4f09-9a10-56c7005f05a4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:53:14.745772 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8785129-4f11-4f09-9a10-56c7005f05a4 admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:53:14.760864 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 1046/2110] 10.222.0.42 () {58 vars in 1153 bytes} [Sun Oct 30 00:53:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:53:14.762102 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09841bae-b93b-4c5b-926e-617a3ede7c91 None None] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:53:14.771525 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09841bae-b93b-4c5b-926e-617a3ede7c91 None None] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:53:14.776581 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e264a425-8b99-44d8-82c7-d503480ebe3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:53:14.777297 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e264a425-8b99-44d8-82c7-d503480ebe3d admin admin] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:53:14.777613 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e264a425-8b99-44d8-82c7-d503480ebe3d admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:53:14.777883 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e264a425-8b99-44d8-82c7-d503480ebe3d admin admin] PATH_INFO: `/v3/projects` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:53:14.778566 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e264a425-8b99-44d8-82c7-d503480ebe3d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:53:14.780554 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e264a425-8b99-44d8-82c7-d503480ebe3d admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:53:14.815124 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 1065/2111] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 30 00:53:14 2022] POST /identity/v3/projects => generated 377 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 30 00:53:14.816364 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8785129-4f11-4f09-9a10-56c7005f05a4 admin admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:53:14.828075 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8785129-4f11-4f09-9a10-56c7005f05a4 admin admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:53:14.845246 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:53:14.848238 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091cf7d5-d837-429f-9cfc-3d239bdf3725 None None] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:53:14.848529 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091cf7d5-d837-429f-9cfc-3d239bdf3725 None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:53:14.848891 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091cf7d5-d837-429f-9cfc-3d239bdf3725 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:53:14.869228 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.auth.core [None req-091cf7d5-d837-429f-9cfc-3d239bdf3725 None None] MFA Rules not processed for user `861d1145dd48414c9388bed57e993493`. Rule list: `[]` (Enabled: `True`). {{(pid=87956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:53:14.870739 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-091cf7d5-d837-429f-9cfc-3d239bdf3725 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:53:14.908474 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5e1ae1-1ff8-40ae-bfb4-63d0e86c6478 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:53:14.909123 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5e1ae1-1ff8-40ae-bfb4-63d0e86c6478 admin admin] REQUEST_METHOD: `POST` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:53:14.909354 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5e1ae1-1ff8-40ae-bfb4-63d0e86c6478 admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:53:14.909619 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5e1ae1-1ff8-40ae-bfb4-63d0e86c6478 admin admin] PATH_INFO: `/v3/users` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:53:14.910251 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5e1ae1-1ff8-40ae-bfb4-63d0e86c6478 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:53:14.912250 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5e1ae1-1ff8-40ae-bfb4-63d0e86c6478 admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:53:14.935258 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 1047/2112] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 30 00:53:14 2022] POST /identity/v3/users => generated 289 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 00:53:14.939037 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5e1ae1-1ff8-40ae-bfb4-63d0e86c6478 admin admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:53:14.940282 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 1066/2113] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 30 00:53:14 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 30 00:53:14.951326 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5e1ae1-1ff8-40ae-bfb4-63d0e86c6478 admin admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:53:14.957264 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1adced1-fd8d-4e3c-982a-514586138a59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:53:14.957936 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1adced1-fd8d-4e3c-982a-514586138a59 admin admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:53:14.958285 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1adced1-fd8d-4e3c-982a-514586138a59 admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:53:14.958595 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1adced1-fd8d-4e3c-982a-514586138a59 admin admin] PATH_INFO: `/v3/roles` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:53:14.959337 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1adced1-fd8d-4e3c-982a-514586138a59 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:53:14.961477 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1adced1-fd8d-4e3c-982a-514586138a59 admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:53:14.976460 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 1048/2114] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 30 00:53:14 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 30 00:53:14.980752 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091cf7d5-d837-429f-9cfc-3d239bdf3725 None None] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:53:14.992455 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091cf7d5-d837-429f-9cfc-3d239bdf3725 None None] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:53:14.997088 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492441a0-3ca1-449b-8ffb-d08a46cfffd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:53:14.997697 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492441a0-3ca1-449b-8ffb-d08a46cfffd6 admin admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:53:14.998041 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492441a0-3ca1-449b-8ffb-d08a46cfffd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:53:14.998321 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492441a0-3ca1-449b-8ffb-d08a46cfffd6 admin admin] PATH_INFO: `/v3/roles` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:53:14.998971 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492441a0-3ca1-449b-8ffb-d08a46cfffd6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:53:15.000607 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492441a0-3ca1-449b-8ffb-d08a46cfffd6 admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:53:15.002466 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:53:15.012824 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 1067/2115] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 30 00:53:14 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 00:53:15.017022 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1adced1-fd8d-4e3c-982a-514586138a59 admin admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:53:15.027309 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1adced1-fd8d-4e3c-982a-514586138a59 admin admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:53:15.032041 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d2eed2-dc34-4604-8e9e-b22091af99d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:53:15.032695 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d2eed2-dc34-4604-8e9e-b22091af99d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:53:15.032966 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d2eed2-dc34-4604-8e9e-b22091af99d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:53:15.033235 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d2eed2-dc34-4604-8e9e-b22091af99d6 admin admin] PATH_INFO: `/v3/projects/068dde3247574ea6b36561a62c98ad24/users/8fb18a4735734c1e8db3ee7960e983d4/roles/1c93019874174c4b91118d9ce2347e47` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:53:15.047971 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d2eed2-dc34-4604-8e9e-b22091af99d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=068dde3247574ea6b36561a62c98ad24, user_id=8fb18a4735734c1e8db3ee7960e983d4, role_id=1c93019874174c4b91118d9ce2347e47)` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:53:15.050603 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d2eed2-dc34-4604-8e9e-b22091af99d6 admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:53:15.065103 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 1049/2116] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 30 00:53:15 2022] PUT /identity/v3/projects/068dde3247574ea6b36561a62c98ad24/users/8fb18a4735734c1e8db3ee7960e983d4/roles/1c93019874174c4b91118d9ce2347e47 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 00:53:15.070738 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e4ab5c-a813-4302-aea1-368db67d9ece None None] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:53:15.071238 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e4ab5c-a813-4302-aea1-368db67d9ece None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:53:15.071676 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e4ab5c-a813-4302-aea1-368db67d9ece None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:53:15.091279 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.auth.core [None req-a3e4ab5c-a813-4302-aea1-368db67d9ece None None] MFA Rules not processed for user `eb55b6cbca4945abb21b0e49eb745e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=87956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:53:15.092484 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-a3e4ab5c-a813-4302-aea1-368db67d9ece None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:53:15.150970 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 1068/2117] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 30 00:53:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 30 00:53:15.161022 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d2eed2-dc34-4604-8e9e-b22091af99d6 admin admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:53:15.162929 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-b1d2eed2-dc34-4604-8e9e-b22091af99d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:53:15.222340 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d2eed2-dc34-4604-8e9e-b22091af99d6 admin admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:53:15.225985 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850b4773-5e9f-4df8-9b5e-2fd3579b7129 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5693f186c6ad4d9394f02ee3477cdcd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d2387fdf794d4eaef07bbcd7b39f2a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:53:15.226595 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850b4773-5e9f-4df8-9b5e-2fd3579b7129 service neutron] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:53:15.226873 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850b4773-5e9f-4df8-9b5e-2fd3579b7129 service neutron] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:53:15.227142 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850b4773-5e9f-4df8-9b5e-2fd3579b7129 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:53:15.236621 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850b4773-5e9f-4df8-9b5e-2fd3579b7129 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:53:15.238056 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850b4773-5e9f-4df8-9b5e-2fd3579b7129 service neutron] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:53:15.248044 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 1050/2118] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 30 00:53:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 00:53:17.853784 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e4ab5c-a813-4302-aea1-368db67d9ece None None] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:53:17.862840 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-a3e4ab5c-a813-4302-aea1-368db67d9ece None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:53:17.916993 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850b4773-5e9f-4df8-9b5e-2fd3579b7129 service neutron] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:53:17.930176 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850b4773-5e9f-4df8-9b5e-2fd3579b7129 service neutron] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:53:17.935126 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2231760e-94a0-4302-ab31-58fe6cf198ed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5693f186c6ad4d9394f02ee3477cdcd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d2387fdf794d4eaef07bbcd7b39f2a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:53:17.936275 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2231760e-94a0-4302-ab31-58fe6cf198ed service neutron] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:53:17.936688 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2231760e-94a0-4302-ab31-58fe6cf198ed service neutron] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:53:17.937106 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2231760e-94a0-4302-ab31-58fe6cf198ed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:53:17.940885 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-2231760e-94a0-4302-ab31-58fe6cf198ed service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:53:18.009965 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e4ab5c-a813-4302-aea1-368db67d9ece None None] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:53:18.017483 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b5241d-eb7d-46fa-bdb2-ddf93d8a0e90 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36a86cf3eaf24b369737b65046142593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d2387fdf794d4eaef07bbcd7b39f2a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:53:18.018890 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b5241d-eb7d-46fa-bdb2-ddf93d8a0e90 service glance] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:53:18.019412 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b5241d-eb7d-46fa-bdb2-ddf93d8a0e90 service glance] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:53:18.020049 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b5241d-eb7d-46fa-bdb2-ddf93d8a0e90 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:53:18.032346 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-54b5241d-eb7d-46fa-bdb2-ddf93d8a0e90 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:53:18.033569 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:53:18.053225 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2231760e-94a0-4302-ab31-58fe6cf198ed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:53:18.054809 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2231760e-94a0-4302-ab31-58fe6cf198ed service neutron] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:53:18.070241 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 1051/2119] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 30 00:53:17 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 30 00:53:18.076373 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b5241d-eb7d-46fa-bdb2-ddf93d8a0e90 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:53:18.078092 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b5241d-eb7d-46fa-bdb2-ddf93d8a0e90 service glance] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:53:18.094127 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 1069/2120] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 30 00:53:17 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 00:53:20.906881 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd0f51a-501c-4209-9004-de97db6a3dd4 None None] REQUEST_METHOD: `POST` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:53:20.907455 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd0f51a-501c-4209-9004-de97db6a3dd4 None None] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:53:20.907455 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd0f51a-501c-4209-9004-de97db6a3dd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:53:20.938896 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.auth.core [None req-bbd0f51a-501c-4209-9004-de97db6a3dd4 None None] MFA Rules not processed for user `8fb18a4735734c1e8db3ee7960e983d4`. Rule list: `[]` (Enabled: `True`). {{(pid=87955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:53:20.940163 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-bbd0f51a-501c-4209-9004-de97db6a3dd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:53:21.022024 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 1052/2121] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 30 00:53:20 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:53:21.039311 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b5241d-eb7d-46fa-bdb2-ddf93d8a0e90 service glance] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:53:21.040745 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-54b5241d-eb7d-46fa-bdb2-ddf93d8a0e90 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:53:21.057398 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b5241d-eb7d-46fa-bdb2-ddf93d8a0e90 service glance] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:53:21.064812 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5700f9-a1cf-490b-9ab9-699ad03b24dc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fde877b6ddc74f4a87baf21471eb31d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d2387fdf794d4eaef07bbcd7b39f2a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:53:21.071315 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5700f9-a1cf-490b-9ab9-699ad03b24dc service nova] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:53:21.071677 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5700f9-a1cf-490b-9ab9-699ad03b24dc service nova] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:53:21.071949 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5700f9-a1cf-490b-9ab9-699ad03b24dc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:53:21.081130 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5700f9-a1cf-490b-9ab9-699ad03b24dc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:53:21.082741 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5700f9-a1cf-490b-9ab9-699ad03b24dc service nova] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:53:21.095076 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 1070/2122] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 30 00:53:21 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 00:53:23.506766 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00804309-d5d0-47f4-a63b-7f5dd6fa6aed None None] REQUEST_METHOD: `POST` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:53:23.507383 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00804309-d5d0-47f4-a63b-7f5dd6fa6aed None None] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:53:23.507383 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00804309-d5d0-47f4-a63b-7f5dd6fa6aed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:53:23.528823 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.auth.core [None req-00804309-d5d0-47f4-a63b-7f5dd6fa6aed None None] MFA Rules not processed for user `8fb18a4735734c1e8db3ee7960e983d4`. Rule list: `[]` (Enabled: `True`). {{(pid=87955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:53:23.530531 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-00804309-d5d0-47f4-a63b-7f5dd6fa6aed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:53:23.543627 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 1053/2123] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 30 00:53:23 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 30 00:53:31.090443 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=61 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:53:33.521719 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=40 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:53:34.712524 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5700f9-a1cf-490b-9ab9-699ad03b24dc service nova] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:53:34.728825 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5700f9-a1cf-490b-9ab9-699ad03b24dc service nova] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:53:34.734855 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264d4e72-1caa-419a-9cba-4ccd48ff0b64 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fde877b6ddc74f4a87baf21471eb31d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d2387fdf794d4eaef07bbcd7b39f2a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:53:34.735516 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264d4e72-1caa-419a-9cba-4ccd48ff0b64 service nova] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:53:34.735748 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264d4e72-1caa-419a-9cba-4ccd48ff0b64 service nova] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:53:34.736041 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264d4e72-1caa-419a-9cba-4ccd48ff0b64 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:53:34.737875 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-264d4e72-1caa-419a-9cba-4ccd48ff0b64 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:53:34.798009 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264d4e72-1caa-419a-9cba-4ccd48ff0b64 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:53:34.799985 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264d4e72-1caa-419a-9cba-4ccd48ff0b64 service nova] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:53:34.808831 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 1071/2124] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 30 00:53:34 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 00:53:37.324003 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb199e10-06ac-411b-8a7b-c6fb2614ca87 None None] REQUEST_METHOD: `POST` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:53:37.324611 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb199e10-06ac-411b-8a7b-c6fb2614ca87 None None] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:53:37.324611 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb199e10-06ac-411b-8a7b-c6fb2614ca87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:53:37.348232 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.auth.core [None req-eb199e10-06ac-411b-8a7b-c6fb2614ca87 None None] MFA Rules not processed for user `3e7b21b55fb84a6cad507a8954492d48`. Rule list: `[]` (Enabled: `True`). {{(pid=87955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:53:37.350303 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-eb199e10-06ac-411b-8a7b-c6fb2614ca87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:53:37.408514 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 1054/2125] 10.222.0.42 () {58 vars in 1009 bytes} [Sun Oct 30 00:53:37 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:53:37.456514 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264d4e72-1caa-419a-9cba-4ccd48ff0b64 service nova] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:53:37.457977 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-264d4e72-1caa-419a-9cba-4ccd48ff0b64 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:53:37.531936 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264d4e72-1caa-419a-9cba-4ccd48ff0b64 service nova] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:53:37.537677 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de688f1-c3f3-46e4-b38b-a88f63c98c80 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6d6e884a8104a428e4de6be1cfa467c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d2387fdf794d4eaef07bbcd7b39f2a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:53:37.538297 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de688f1-c3f3-46e4-b38b-a88f63c98c80 service swift] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:53:37.538568 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de688f1-c3f3-46e4-b38b-a88f63c98c80 service swift] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:53:37.538829 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de688f1-c3f3-46e4-b38b-a88f63c98c80 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:53:37.547343 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de688f1-c3f3-46e4-b38b-a88f63c98c80 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:53:37.548921 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de688f1-c3f3-46e4-b38b-a88f63c98c80 service swift] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:53:37.557036 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 1072/2126] 10.222.0.42 () {60 vars in 1384 bytes} [Sun Oct 30 00:53:37 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 30 00:53:47.389993 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb199e10-06ac-411b-8a7b-c6fb2614ca87 None None] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:53:47.391726 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-eb199e10-06ac-411b-8a7b-c6fb2614ca87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:53:47.404512 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb199e10-06ac-411b-8a7b-c6fb2614ca87 None None] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:53:47.408508 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffe1deb-e363-401e-87af-dc3f09bc846b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5693f186c6ad4d9394f02ee3477cdcd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d2387fdf794d4eaef07bbcd7b39f2a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:53:47.409127 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffe1deb-e363-401e-87af-dc3f09bc846b service neutron] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:53:47.409399 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffe1deb-e363-401e-87af-dc3f09bc846b service neutron] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:53:47.409669 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffe1deb-e363-401e-87af-dc3f09bc846b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:53:47.411725 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-4ffe1deb-e363-401e-87af-dc3f09bc846b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:53:47.421785 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffe1deb-e363-401e-87af-dc3f09bc846b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:53:47.423239 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffe1deb-e363-401e-87af-dc3f09bc846b service neutron] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:53:47.430997 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 1055/2127] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 30 00:53:47 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 00:53:47.553754 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=60 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:53:51.756334 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de688f1-c3f3-46e4-b38b-a88f63c98c80 service swift] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:53:51.757772 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-3de688f1-c3f3-46e4-b38b-a88f63c98c80 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:53:51.832464 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de688f1-c3f3-46e4-b38b-a88f63c98c80 service swift] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:53:51.838570 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6dce18-63e0-4e55-8709-07dd0e8e3711 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '202b8b2c0f454297bfb97c1ac4033625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d2387fdf794d4eaef07bbcd7b39f2a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:53:51.839175 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6dce18-63e0-4e55-8709-07dd0e8e3711 service placement] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:53:51.839488 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6dce18-63e0-4e55-8709-07dd0e8e3711 service placement] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:53:51.839756 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6dce18-63e0-4e55-8709-07dd0e8e3711 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:53:51.841582 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-4d6dce18-63e0-4e55-8709-07dd0e8e3711 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:53:51.853381 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6dce18-63e0-4e55-8709-07dd0e8e3711 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:53:51.854948 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6dce18-63e0-4e55-8709-07dd0e8e3711 service placement] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:53:51.864896 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 1073/2128] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 30 00:53:51 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 30 00:53:53.697639 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1c80d3-9cd1-4d20-a6ff-0c8486eb0dd8 None None] REQUEST_METHOD: `POST` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:53:53.698153 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1c80d3-9cd1-4d20-a6ff-0c8486eb0dd8 None None] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:53:53.698264 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1c80d3-9cd1-4d20-a6ff-0c8486eb0dd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:53:53.719587 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.auth.core [None req-1f1c80d3-9cd1-4d20-a6ff-0c8486eb0dd8 None None] MFA Rules not processed for user `3e7b21b55fb84a6cad507a8954492d48`. Rule list: `[]` (Enabled: `True`). {{(pid=87955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:53:53.720830 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-1f1c80d3-9cd1-4d20-a6ff-0c8486eb0dd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:53:53.729400 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 1056/2129] 10.222.0.42 () {58 vars in 1009 bytes} [Sun Oct 30 00:53:53 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:53:53.741843 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6dce18-63e0-4e55-8709-07dd0e8e3711 service placement] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:53:53.753925 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6dce18-63e0-4e55-8709-07dd0e8e3711 service placement] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:53:53.760204 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728183c1-caa1-4244-8326-aff7c56b95de service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6d6e884a8104a428e4de6be1cfa467c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d2387fdf794d4eaef07bbcd7b39f2a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:53:53.760796 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728183c1-caa1-4244-8326-aff7c56b95de service swift] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:53:53.761088 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728183c1-caa1-4244-8326-aff7c56b95de service swift] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:53:53.761346 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728183c1-caa1-4244-8326-aff7c56b95de service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:53:53.769694 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728183c1-caa1-4244-8326-aff7c56b95de service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:53:53.771177 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728183c1-caa1-4244-8326-aff7c56b95de service swift] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:53:53.779357 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 1074/2130] 10.222.0.42 () {60 vars in 1384 bytes} [Sun Oct 30 00:53:53 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 30 00:54:03.714110 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=34 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:54:03.776071 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=38 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:54:05.530781 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1c80d3-9cd1-4d20-a6ff-0c8486eb0dd8 None None] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:54:05.552010 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1c80d3-9cd1-4d20-a6ff-0c8486eb0dd8 None None] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:54:05.559866 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121e5927-78dc-4a22-9f20-c884995e92b7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fde877b6ddc74f4a87baf21471eb31d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d2387fdf794d4eaef07bbcd7b39f2a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:54:05.560508 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121e5927-78dc-4a22-9f20-c884995e92b7 service nova] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:54:05.560782 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121e5927-78dc-4a22-9f20-c884995e92b7 service nova] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:54:05.561158 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121e5927-78dc-4a22-9f20-c884995e92b7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:54:05.563397 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-121e5927-78dc-4a22-9f20-c884995e92b7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:54:05.623428 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121e5927-78dc-4a22-9f20-c884995e92b7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:54:05.624940 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121e5927-78dc-4a22-9f20-c884995e92b7 service nova] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:54:05.634269 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 1057/2131] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 30 00:54:05 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 00:54:09.476789 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728183c1-caa1-4244-8326-aff7c56b95de service swift] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:54:09.491985 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728183c1-caa1-4244-8326-aff7c56b95de service swift] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:54:09.498198 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cab9a18-c3a7-4027-becf-a34f839e88f9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fde877b6ddc74f4a87baf21471eb31d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d2387fdf794d4eaef07bbcd7b39f2a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:54:09.498489 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cab9a18-c3a7-4027-becf-a34f839e88f9 service nova] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:54:09.498764 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cab9a18-c3a7-4027-becf-a34f839e88f9 service nova] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:54:09.499033 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cab9a18-c3a7-4027-becf-a34f839e88f9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:54:09.501001 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-1cab9a18-c3a7-4027-becf-a34f839e88f9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:54:09.527541 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cab9a18-c3a7-4027-becf-a34f839e88f9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:54:09.527541 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cab9a18-c3a7-4027-becf-a34f839e88f9 service nova] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:54:09.530538 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 1075/2132] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 30 00:54:09 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 00:54:11.027655 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0154043-24e1-41ea-a377-05ae2ac69416 None None] REQUEST_METHOD: `POST` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:54:11.028110 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0154043-24e1-41ea-a377-05ae2ac69416 None None] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:54:11.028207 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0154043-24e1-41ea-a377-05ae2ac69416 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:54:11.049489 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.auth.core [None req-c0154043-24e1-41ea-a377-05ae2ac69416 None None] MFA Rules not processed for user `3e7b21b55fb84a6cad507a8954492d48`. Rule list: `[]` (Enabled: `True`). {{(pid=87955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:54:11.050702 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-c0154043-24e1-41ea-a377-05ae2ac69416 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:54:11.058997 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 1058/2133] 10.222.0.42 () {58 vars in 967 bytes} [Sun Oct 30 00:54:11 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:54:11.071819 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cab9a18-c3a7-4027-becf-a34f839e88f9 service nova] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:54:11.085908 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cab9a18-c3a7-4027-becf-a34f839e88f9 service nova] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:54:11.096518 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6de663f-1e50-4495-b21d-e2bdb730cc53 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6d6e884a8104a428e4de6be1cfa467c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d2387fdf794d4eaef07bbcd7b39f2a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:54:11.097136 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6de663f-1e50-4495-b21d-e2bdb730cc53 service swift] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:54:11.097397 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6de663f-1e50-4495-b21d-e2bdb730cc53 service swift] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:54:11.097846 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6de663f-1e50-4495-b21d-e2bdb730cc53 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:54:11.106888 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6de663f-1e50-4495-b21d-e2bdb730cc53 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:54:11.108418 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6de663f-1e50-4495-b21d-e2bdb730cc53 service swift] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:54:11.116605 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 1076/2134] 10.222.0.42 () {60 vars in 1384 bytes} [Sun Oct 30 00:54:11 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 30 00:54:15.099834 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0154043-24e1-41ea-a377-05ae2ac69416 None None] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:54:15.101267 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-c0154043-24e1-41ea-a377-05ae2ac69416 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:54:15.130646 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0154043-24e1-41ea-a377-05ae2ac69416 None None] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:54:15.136421 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db934b7-febc-448b-b1e5-0f6d43bab05b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fde877b6ddc74f4a87baf21471eb31d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d2387fdf794d4eaef07bbcd7b39f2a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:54:15.137057 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db934b7-febc-448b-b1e5-0f6d43bab05b service nova] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:54:15.137333 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db934b7-febc-448b-b1e5-0f6d43bab05b service nova] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:54:15.137598 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db934b7-febc-448b-b1e5-0f6d43bab05b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:54:15.139459 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-6db934b7-febc-448b-b1e5-0f6d43bab05b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:54:15.152434 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db934b7-febc-448b-b1e5-0f6d43bab05b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:54:15.154211 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db934b7-febc-448b-b1e5-0f6d43bab05b service nova] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:54:15.173837 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 1059/2135] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 30 00:54:15 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 00:54:20.285684 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6de663f-1e50-4495-b21d-e2bdb730cc53 service swift] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:54:20.295859 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6de663f-1e50-4495-b21d-e2bdb730cc53 service swift] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:54:20.299732 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4d93ce-beef-4e6b-80d1-ad283caf76ff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5693f186c6ad4d9394f02ee3477cdcd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d2387fdf794d4eaef07bbcd7b39f2a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:54:20.300330 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4d93ce-beef-4e6b-80d1-ad283caf76ff service neutron] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:54:20.300609 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4d93ce-beef-4e6b-80d1-ad283caf76ff service neutron] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:54:20.300878 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4d93ce-beef-4e6b-80d1-ad283caf76ff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:54:20.302627 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-ed4d93ce-beef-4e6b-80d1-ad283caf76ff service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:54:20.314937 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4d93ce-beef-4e6b-80d1-ad283caf76ff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:54:20.316392 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4d93ce-beef-4e6b-80d1-ad283caf76ff service neutron] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:54:20.329850 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 1077/2136] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 30 00:54:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 00:54:23.836790 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db934b7-febc-448b-b1e5-0f6d43bab05b service nova] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:54:23.838544 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-6db934b7-febc-448b-b1e5-0f6d43bab05b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:54:23.853298 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db934b7-febc-448b-b1e5-0f6d43bab05b service nova] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:54:23.857871 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9284d2a-0c70-4e3f-a881-06b673abe830 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:54:23.858533 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9284d2a-0c70-4e3f-a881-06b673abe830 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:54:23.858771 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9284d2a-0c70-4e3f-a881-06b673abe830 admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:54:23.859042 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9284d2a-0c70-4e3f-a881-06b673abe830 admin admin] PATH_INFO: `/v3/users/861d1145dd48414c9388bed57e993493` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:54:23.860242 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9284d2a-0c70-4e3f-a881-06b673abe830 admin admin] RBAC: Authorizing `identity:delete_user(user_id=861d1145dd48414c9388bed57e993493)` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:54:23.862172 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9284d2a-0c70-4e3f-a881-06b673abe830 admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:54:23.910618 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-b9284d2a-0c70-4e3f-a881-06b673abe830 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '861d1145dd48414c9388bed57e993493'} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:54:23.911308 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-b9284d2a-0c70-4e3f-a881-06b673abe830 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '861d1145dd48414c9388bed57e993493'} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:54:23.918303 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-b9284d2a-0c70-4e3f-a881-06b673abe830 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '861d1145dd48414c9388bed57e993493'} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:54:23.918925 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-b9284d2a-0c70-4e3f-a881-06b673abe830 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '861d1145dd48414c9388bed57e993493'} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:54:23.930892 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-b9284d2a-0c70-4e3f-a881-06b673abe830 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '861d1145dd48414c9388bed57e993493'} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:54:23.944538 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 1060/2137] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 30 00:54:23 2022] DELETE /identity/v3/users/861d1145dd48414c9388bed57e993493 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 00:54:24.127115 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4d93ce-beef-4e6b-80d1-ad283caf76ff service neutron] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:54:24.138062 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4d93ce-beef-4e6b-80d1-ad283caf76ff service neutron] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:54:24.199905 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70896334-eada-4c1b-961c-7b479b3fd0f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:54:24.200544 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70896334-eada-4c1b-961c-7b479b3fd0f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:54:24.200822 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70896334-eada-4c1b-961c-7b479b3fd0f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:54:24.201095 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70896334-eada-4c1b-961c-7b479b3fd0f5 admin admin] PATH_INFO: `/v3/projects/ea8c84d6a858426e86db9eabedfc296d` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:54:24.202401 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70896334-eada-4c1b-961c-7b479b3fd0f5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ea8c84d6a858426e86db9eabedfc296d)` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:54:24.204353 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70896334-eada-4c1b-961c-7b479b3fd0f5 admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:54:24.253424 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-70896334-eada-4c1b-961c-7b479b3fd0f5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ea8c84d6a858426e86db9eabedfc296d', 'request_id': 'req-70896334-eada-4c1b-961c-7b479b3fd0f5'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:54:24.261059 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-70896334-eada-4c1b-961c-7b479b3fd0f5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ea8c84d6a858426e86db9eabedfc296d', 'request_id': 'req-70896334-eada-4c1b-961c-7b479b3fd0f5'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:54:24.267667 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-70896334-eada-4c1b-961c-7b479b3fd0f5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ea8c84d6a858426e86db9eabedfc296d', 'request_id': 'req-70896334-eada-4c1b-961c-7b479b3fd0f5'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:54:24.278980 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-70896334-eada-4c1b-961c-7b479b3fd0f5 admin admin] The token cache is being invalidate because project ea8c84d6a858426e86db9eabedfc296d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87956) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 00:54:24.279297 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-70896334-eada-4c1b-961c-7b479b3fd0f5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:54:24.279938 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-70896334-eada-4c1b-961c-7b479b3fd0f5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:54:24.281493 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 1078/2138] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 30 00:54:24 2022] DELETE /identity/v3/projects/ea8c84d6a858426e86db9eabedfc296d => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 00:54:24.286848 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c05111-b64e-4704-9517-25755a8e0283 None None] REQUEST_METHOD: `POST` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:54:24.287236 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c05111-b64e-4704-9517-25755a8e0283 None None] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:54:24.287543 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c05111-b64e-4704-9517-25755a8e0283 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:54:24.308421 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.auth.core [None req-31c05111-b64e-4704-9517-25755a8e0283 None None] MFA Rules not processed for user `eb55b6cbca4945abb21b0e49eb745e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=87955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:54:24.309637 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-31c05111-b64e-4704-9517-25755a8e0283 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:54:24.359869 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:54:24.381696 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 1061/2139] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 30 00:54:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 30 00:54:24.390315 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dd1836-ccd5-4313-ada3-e4a1fee7c8b5 None None] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:54:24.390677 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dd1836-ccd5-4313-ada3-e4a1fee7c8b5 None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:54:24.391023 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dd1836-ccd5-4313-ada3-e4a1fee7c8b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:54:24.411922 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.auth.core [None req-37dd1836-ccd5-4313-ada3-e4a1fee7c8b5 None None] MFA Rules not processed for user `eb55b6cbca4945abb21b0e49eb745e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=87956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:54:24.413261 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-37dd1836-ccd5-4313-ada3-e4a1fee7c8b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:54:24.421323 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 1079/2140] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 30 00:54:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 30 00:54:24.425708 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c05111-b64e-4704-9517-25755a8e0283 None None] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:54:24.435777 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c05111-b64e-4704-9517-25755a8e0283 None None] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:54:24.440683 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0966d162-5b8c-4619-99f7-24104646e4b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:54:24.441290 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0966d162-5b8c-4619-99f7-24104646e4b3 admin admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:54:24.441566 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0966d162-5b8c-4619-99f7-24104646e4b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:54:24.441835 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0966d162-5b8c-4619-99f7-24104646e4b3 admin admin] PATH_INFO: `/v3/domains` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:54:24.442487 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0966d162-5b8c-4619-99f7-24104646e4b3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:54:24.442801 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0966d162-5b8c-4619-99f7-24104646e4b3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:54:24.444417 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0966d162-5b8c-4619-99f7-24104646e4b3 admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:54:24.457351 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 1062/2141] 10.222.0.42 () {58 vars in 1153 bytes} [Sun Oct 30 00:54:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:54:24.461737 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37dd1836-ccd5-4313-ada3-e4a1fee7c8b5 None None] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:54:24.471251 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37dd1836-ccd5-4313-ada3-e4a1fee7c8b5 None None] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:54:24.476069 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4114ec-3642-463f-b441-ad55c3804176 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:54:24.476675 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4114ec-3642-463f-b441-ad55c3804176 admin admin] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:54:24.476948 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4114ec-3642-463f-b441-ad55c3804176 admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:54:24.477219 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4114ec-3642-463f-b441-ad55c3804176 admin admin] PATH_INFO: `/v3/projects` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:54:24.477882 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4114ec-3642-463f-b441-ad55c3804176 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:54:24.480186 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4114ec-3642-463f-b441-ad55c3804176 admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:54:24.518002 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 1080/2142] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 30 00:54:24 2022] POST /identity/v3/projects => generated 379 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 00:54:24.524702 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0966d162-5b8c-4619-99f7-24104646e4b3 admin admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:54:24.535188 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0966d162-5b8c-4619-99f7-24104646e4b3 admin admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:54:24.595901 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49f4599-d78d-4e07-810b-6b30f33e2840 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:54:24.596509 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49f4599-d78d-4e07-810b-6b30f33e2840 admin admin] REQUEST_METHOD: `POST` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:54:24.596787 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49f4599-d78d-4e07-810b-6b30f33e2840 admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:54:24.597045 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49f4599-d78d-4e07-810b-6b30f33e2840 admin admin] PATH_INFO: `/v3/users` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:54:24.597683 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49f4599-d78d-4e07-810b-6b30f33e2840 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:54:24.599654 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49f4599-d78d-4e07-810b-6b30f33e2840 admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:54:24.623349 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 1063/2143] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 30 00:54:24 2022] POST /identity/v3/users => generated 290 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 00:54:24.629326 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4114ec-3642-463f-b441-ad55c3804176 admin admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:54:24.640200 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4114ec-3642-463f-b441-ad55c3804176 admin admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:54:24.644836 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e475ba5-ae4e-45bf-8918-0b7bc95ac1a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:54:24.645442 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e475ba5-ae4e-45bf-8918-0b7bc95ac1a3 admin admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:54:24.645719 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e475ba5-ae4e-45bf-8918-0b7bc95ac1a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:54:24.645988 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e475ba5-ae4e-45bf-8918-0b7bc95ac1a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:54:24.646636 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e475ba5-ae4e-45bf-8918-0b7bc95ac1a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:54:24.648381 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e475ba5-ae4e-45bf-8918-0b7bc95ac1a3 admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:54:24.658731 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 1081/2144] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 30 00:54:24 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 00:54:24.662881 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49f4599-d78d-4e07-810b-6b30f33e2840 admin admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:54:24.673151 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49f4599-d78d-4e07-810b-6b30f33e2840 admin admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:54:24.678278 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435fe9f0-12df-46c8-8516-3ce0264de6e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:54:24.678975 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435fe9f0-12df-46c8-8516-3ce0264de6e8 admin admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:54:24.679355 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435fe9f0-12df-46c8-8516-3ce0264de6e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:54:24.679626 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435fe9f0-12df-46c8-8516-3ce0264de6e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:54:24.680276 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435fe9f0-12df-46c8-8516-3ce0264de6e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:54:24.681903 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435fe9f0-12df-46c8-8516-3ce0264de6e8 admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:54:24.693931 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 1064/2145] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 30 00:54:24 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 00:54:24.698867 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e475ba5-ae4e-45bf-8918-0b7bc95ac1a3 admin admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:54:24.709158 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e475ba5-ae4e-45bf-8918-0b7bc95ac1a3 admin admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:54:24.714094 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345f0ca6-84af-4d41-bbb2-4299eabbfde7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:54:24.714719 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345f0ca6-84af-4d41-bbb2-4299eabbfde7 admin admin] REQUEST_METHOD: `PUT` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:54:24.714997 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345f0ca6-84af-4d41-bbb2-4299eabbfde7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:54:24.715308 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345f0ca6-84af-4d41-bbb2-4299eabbfde7 admin admin] PATH_INFO: `/v3/projects/3bc1b07c137d46c89614c632b8922271/users/369165968d944977baefc70c3a88cd53/roles/1c93019874174c4b91118d9ce2347e47` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:54:24.723721 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:54:24.731929 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345f0ca6-84af-4d41-bbb2-4299eabbfde7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3bc1b07c137d46c89614c632b8922271, user_id=369165968d944977baefc70c3a88cd53, role_id=1c93019874174c4b91118d9ce2347e47)` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:54:24.734820 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345f0ca6-84af-4d41-bbb2-4299eabbfde7 admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:54:24.750152 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 1082/2146] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 30 00:54:24 2022] PUT /identity/v3/projects/3bc1b07c137d46c89614c632b8922271/users/369165968d944977baefc70c3a88cd53/roles/1c93019874174c4b91118d9ce2347e47 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 00:54:24.760831 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd6d15f-f94a-479a-a2c3-f5bf5d1abbbd None None] REQUEST_METHOD: `POST` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:54:24.761212 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd6d15f-f94a-479a-a2c3-f5bf5d1abbbd None None] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:54:24.761478 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd6d15f-f94a-479a-a2c3-f5bf5d1abbbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:54:24.790038 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.auth.core [None req-1bd6d15f-f94a-479a-a2c3-f5bf5d1abbbd None None] MFA Rules not processed for user `369165968d944977baefc70c3a88cd53`. Rule list: `[]` (Enabled: `True`). {{(pid=87955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:54:24.791354 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-1bd6d15f-f94a-479a-a2c3-f5bf5d1abbbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:54:24.857131 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 1065/2147] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 30 00:54:24 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:54:24.861793 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345f0ca6-84af-4d41-bbb2-4299eabbfde7 admin admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:54:24.928511 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345f0ca6-84af-4d41-bbb2-4299eabbfde7 admin admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:54:24.933698 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e70c32-f9a5-4435-bd0b-d8329652a85d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:54:24.934335 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e70c32-f9a5-4435-bd0b-d8329652a85d admin admin] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:54:24.934609 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e70c32-f9a5-4435-bd0b-d8329652a85d admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:54:24.934879 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e70c32-f9a5-4435-bd0b-d8329652a85d admin admin] PATH_INFO: `/v3/projects` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:54:24.935631 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e70c32-f9a5-4435-bd0b-d8329652a85d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:54:24.937555 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e70c32-f9a5-4435-bd0b-d8329652a85d admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:54:24.969089 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 1083/2148] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 30 00:54:24 2022] POST /identity/v3/projects => generated 379 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 00:54:24.973353 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd6d15f-f94a-479a-a2c3-f5bf5d1abbbd None None] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:54:24.984037 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd6d15f-f94a-479a-a2c3-f5bf5d1abbbd None None] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:54:25.027226 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:54:25.042797 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b288df82-b758-4388-87d0-e934d9052eb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:54:25.043433 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b288df82-b758-4388-87d0-e934d9052eb1 admin admin] REQUEST_METHOD: `POST` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:54:25.043708 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b288df82-b758-4388-87d0-e934d9052eb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:54:25.043976 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b288df82-b758-4388-87d0-e934d9052eb1 admin admin] PATH_INFO: `/v3/users` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:54:25.044639 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b288df82-b758-4388-87d0-e934d9052eb1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:54:25.046547 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b288df82-b758-4388-87d0-e934d9052eb1 admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:54:25.071995 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 1066/2149] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 30 00:54:24 2022] POST /identity/v3/users => generated 296 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 00:54:25.073410 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e70c32-f9a5-4435-bd0b-d8329652a85d admin admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:54:25.084226 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e70c32-f9a5-4435-bd0b-d8329652a85d admin admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:54:25.089292 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2a49d6-49a0-4879-ae09-700588d9c745 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:54:25.089896 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2a49d6-49a0-4879-ae09-700588d9c745 admin admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:54:25.090174 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2a49d6-49a0-4879-ae09-700588d9c745 admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:54:25.090478 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2a49d6-49a0-4879-ae09-700588d9c745 admin admin] PATH_INFO: `/v3/roles` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:54:25.091117 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2a49d6-49a0-4879-ae09-700588d9c745 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:54:25.092747 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2a49d6-49a0-4879-ae09-700588d9c745 admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:54:25.104047 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 1084/2150] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 30 00:54:25 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 00:54:25.108423 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b288df82-b758-4388-87d0-e934d9052eb1 admin admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:54:25.118998 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b288df82-b758-4388-87d0-e934d9052eb1 admin admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:54:25.124387 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1574bf40-bf9b-4e56-9646-977eb4d4c2a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:54:25.125036 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1574bf40-bf9b-4e56-9646-977eb4d4c2a4 admin admin] REQUEST_METHOD: `PUT` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:54:25.125314 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1574bf40-bf9b-4e56-9646-977eb4d4c2a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:54:25.125584 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1574bf40-bf9b-4e56-9646-977eb4d4c2a4 admin admin] PATH_INFO: `/v3/projects/a7557ff498424729bc3aa90d7759ed81/users/cbcc8895a4e64877b110e00022b819c0/roles/6ccaa8c11f29456fb4e4eeccb21616c7` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:54:25.141931 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1574bf40-bf9b-4e56-9646-977eb4d4c2a4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a7557ff498424729bc3aa90d7759ed81, user_id=cbcc8895a4e64877b110e00022b819c0, role_id=6ccaa8c11f29456fb4e4eeccb21616c7)` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:54:25.145569 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1574bf40-bf9b-4e56-9646-977eb4d4c2a4 admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:54:25.161814 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 1067/2151] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 30 00:54:25 2022] PUT /identity/v3/projects/a7557ff498424729bc3aa90d7759ed81/users/cbcc8895a4e64877b110e00022b819c0/roles/6ccaa8c11f29456fb4e4eeccb21616c7 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 00:54:25.166303 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2a49d6-49a0-4879-ae09-700588d9c745 admin admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:54:25.177143 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2a49d6-49a0-4879-ae09-700588d9c745 admin admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:54:25.237569 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691e404e-b42a-4653-9981-12a0dac94cd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:54:25.238177 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691e404e-b42a-4653-9981-12a0dac94cd8 admin admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:54:25.238465 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691e404e-b42a-4653-9981-12a0dac94cd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:54:25.238729 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691e404e-b42a-4653-9981-12a0dac94cd8 admin admin] PATH_INFO: `/v3/roles` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:54:25.239410 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691e404e-b42a-4653-9981-12a0dac94cd8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:54:25.241009 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691e404e-b42a-4653-9981-12a0dac94cd8 admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:54:25.251244 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 1085/2152] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 30 00:54:25 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 30 00:54:25.257984 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1574bf40-bf9b-4e56-9646-977eb4d4c2a4 admin admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:54:25.275131 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1574bf40-bf9b-4e56-9646-977eb4d4c2a4 admin admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:54:25.281448 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6ca6ee-f9aa-4b37-9dbd-2487e986535b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:54:25.282098 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6ca6ee-f9aa-4b37-9dbd-2487e986535b admin admin] REQUEST_METHOD: `PUT` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:54:25.282396 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6ca6ee-f9aa-4b37-9dbd-2487e986535b admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:54:25.282638 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6ca6ee-f9aa-4b37-9dbd-2487e986535b admin admin] PATH_INFO: `/v3/projects/a7557ff498424729bc3aa90d7759ed81/users/cbcc8895a4e64877b110e00022b819c0/roles/6ccaa8c11f29456fb4e4eeccb21616c7` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:54:25.284895 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6ca6ee-f9aa-4b37-9dbd-2487e986535b admin admin] RBAC: Authorizing `identity:create_grant(project_id=a7557ff498424729bc3aa90d7759ed81, user_id=cbcc8895a4e64877b110e00022b819c0, role_id=6ccaa8c11f29456fb4e4eeccb21616c7)` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:54:25.287615 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6ca6ee-f9aa-4b37-9dbd-2487e986535b admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:54:25.299330 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 1068/2153] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 30 00:54:25 2022] PUT /identity/v3/projects/a7557ff498424729bc3aa90d7759ed81/users/cbcc8895a4e64877b110e00022b819c0/roles/6ccaa8c11f29456fb4e4eeccb21616c7 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 00:54:25.311554 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1972a7-64d7-4738-81e7-2155e85e610f None None] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:54:25.311830 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1972a7-64d7-4738-81e7-2155e85e610f None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:54:25.312110 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1972a7-64d7-4738-81e7-2155e85e610f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:54:25.346894 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.auth.core [None req-8d1972a7-64d7-4738-81e7-2155e85e610f None None] MFA Rules not processed for user `cbcc8895a4e64877b110e00022b819c0`. Rule list: `[]` (Enabled: `True`). {{(pid=87956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:54:25.348140 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-8d1972a7-64d7-4738-81e7-2155e85e610f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:54:25.395733 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:54:25.420430 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 1086/2154] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 30 00:54:25 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:54:25.432459 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6ca6ee-f9aa-4b37-9dbd-2487e986535b admin admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:54:25.434502 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-dd6ca6ee-f9aa-4b37-9dbd-2487e986535b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:54:25.492615 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6ca6ee-f9aa-4b37-9dbd-2487e986535b admin admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:54:25.497510 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62d3c35-7a99-4485-9402-c446d65f9923 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48d928ff7fe24348ac900f09c56acc20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d2387fdf794d4eaef07bbcd7b39f2a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:54:25.498158 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62d3c35-7a99-4485-9402-c446d65f9923 service cinder] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:54:25.498436 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62d3c35-7a99-4485-9402-c446d65f9923 service cinder] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:54:25.498743 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62d3c35-7a99-4485-9402-c446d65f9923 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:54:25.509170 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62d3c35-7a99-4485-9402-c446d65f9923 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:54:25.510802 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62d3c35-7a99-4485-9402-c446d65f9923 service cinder] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:54:25.521061 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 1069/2155] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 30 00:54:25 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 00:54:25.603505 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1972a7-64d7-4738-81e7-2155e85e610f None None] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:54:25.614706 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1972a7-64d7-4738-81e7-2155e85e610f None None] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:54:25.618493 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad185f5-b071-43de-9c34-efaa369c565a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48d928ff7fe24348ac900f09c56acc20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d2387fdf794d4eaef07bbcd7b39f2a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:54:25.619108 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad185f5-b071-43de-9c34-efaa369c565a service cinder] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:54:25.619480 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad185f5-b071-43de-9c34-efaa369c565a service cinder] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:54:25.619790 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad185f5-b071-43de-9c34-efaa369c565a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:54:25.692725 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad185f5-b071-43de-9c34-efaa369c565a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:54:25.694119 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad185f5-b071-43de-9c34-efaa369c565a service cinder] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:54:25.703682 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 1087/2156] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 30 00:54:25 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 00:54:32.587774 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62d3c35-7a99-4485-9402-c446d65f9923 service cinder] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:54:32.654808 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62d3c35-7a99-4485-9402-c446d65f9923 service cinder] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:54:32.659644 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3c02e7-7c90-470e-8a69-509f4d95cbd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:54:32.660213 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3c02e7-7c90-470e-8a69-509f4d95cbd9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:54:32.660480 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3c02e7-7c90-470e-8a69-509f4d95cbd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:54:32.660749 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3c02e7-7c90-470e-8a69-509f4d95cbd9 admin admin] PATH_INFO: `/v3/users/369165968d944977baefc70c3a88cd53` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:54:32.661862 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3c02e7-7c90-470e-8a69-509f4d95cbd9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=369165968d944977baefc70c3a88cd53)` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:54:32.663838 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3c02e7-7c90-470e-8a69-509f4d95cbd9 admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:54:32.711657 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=89,keystone:INSERT=5,keystone:DELETE=6 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:54:32.714436 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-ca3c02e7-7c90-470e-8a69-509f4d95cbd9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '369165968d944977baefc70c3a88cd53'} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:54:32.715960 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-ca3c02e7-7c90-470e-8a69-509f4d95cbd9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '369165968d944977baefc70c3a88cd53'} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:54:32.724173 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-ca3c02e7-7c90-470e-8a69-509f4d95cbd9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '369165968d944977baefc70c3a88cd53'} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:54:32.724859 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-ca3c02e7-7c90-470e-8a69-509f4d95cbd9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '369165968d944977baefc70c3a88cd53'} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:54:32.737208 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-ca3c02e7-7c90-470e-8a69-509f4d95cbd9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '369165968d944977baefc70c3a88cd53'} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:54:32.751673 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 1070/2157] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 30 00:54:32 2022] DELETE /identity/v3/users/369165968d944977baefc70c3a88cd53 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 00:54:32.756283 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f85b94-0eb7-4f37-ba84-efce6ee784ed None None] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:54:32.756768 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f85b94-0eb7-4f37-ba84-efce6ee784ed None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:54:32.756906 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f85b94-0eb7-4f37-ba84-efce6ee784ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:54:32.775797 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.auth.core [None req-c5f85b94-0eb7-4f37-ba84-efce6ee784ed None None] MFA Rules not processed for user `eb55b6cbca4945abb21b0e49eb745e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=87956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:54:32.777000 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-c5f85b94-0eb7-4f37-ba84-efce6ee784ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:54:32.841222 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 1088/2158] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 30 00:54:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:54:32.851110 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3c02e7-7c90-470e-8a69-509f4d95cbd9 admin admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:54:32.852756 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-ca3c02e7-7c90-470e-8a69-509f4d95cbd9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:54:32.910316 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3c02e7-7c90-470e-8a69-509f4d95cbd9 admin admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:54:32.914152 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612e6b9d-9d3f-4ba3-af5c-754a5c103470 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5693f186c6ad4d9394f02ee3477cdcd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d2387fdf794d4eaef07bbcd7b39f2a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:54:32.914807 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612e6b9d-9d3f-4ba3-af5c-754a5c103470 service neutron] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:54:32.915090 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612e6b9d-9d3f-4ba3-af5c-754a5c103470 service neutron] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:54:32.915382 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612e6b9d-9d3f-4ba3-af5c-754a5c103470 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:54:32.925336 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612e6b9d-9d3f-4ba3-af5c-754a5c103470 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:54:32.926938 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612e6b9d-9d3f-4ba3-af5c-754a5c103470 service neutron] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:54:32.936878 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 1071/2159] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 30 00:54:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 00:54:33.232706 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f85b94-0eb7-4f37-ba84-efce6ee784ed None None] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:54:33.235471 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-c5f85b94-0eb7-4f37-ba84-efce6ee784ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:54:33.249737 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f85b94-0eb7-4f37-ba84-efce6ee784ed None None] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:54:33.254498 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f91816-2b3c-47cd-bf93-2f07252d72b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:54:33.255138 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f91816-2b3c-47cd-bf93-2f07252d72b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:54:33.255510 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f91816-2b3c-47cd-bf93-2f07252d72b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:54:33.255777 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f91816-2b3c-47cd-bf93-2f07252d72b0 admin admin] PATH_INFO: `/v3/projects/3bc1b07c137d46c89614c632b8922271` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:54:33.256916 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f91816-2b3c-47cd-bf93-2f07252d72b0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3bc1b07c137d46c89614c632b8922271)` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:54:33.258852 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f91816-2b3c-47cd-bf93-2f07252d72b0 admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:54:33.306065 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-74f91816-2b3c-47cd-bf93-2f07252d72b0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3bc1b07c137d46c89614c632b8922271', 'request_id': 'req-74f91816-2b3c-47cd-bf93-2f07252d72b0'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:54:33.313890 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-74f91816-2b3c-47cd-bf93-2f07252d72b0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3bc1b07c137d46c89614c632b8922271', 'request_id': 'req-74f91816-2b3c-47cd-bf93-2f07252d72b0'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:54:33.320424 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-74f91816-2b3c-47cd-bf93-2f07252d72b0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3bc1b07c137d46c89614c632b8922271', 'request_id': 'req-74f91816-2b3c-47cd-bf93-2f07252d72b0'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:54:33.331494 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-74f91816-2b3c-47cd-bf93-2f07252d72b0 admin admin] The token cache is being invalidate because project 3bc1b07c137d46c89614c632b8922271 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87956) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 00:54:33.331777 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-74f91816-2b3c-47cd-bf93-2f07252d72b0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:54:33.332385 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-74f91816-2b3c-47cd-bf93-2f07252d72b0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:54:33.333835 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 1089/2160] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 30 00:54:33 2022] DELETE /identity/v3/projects/3bc1b07c137d46c89614c632b8922271 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 00:54:33.338055 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612e6b9d-9d3f-4ba3-af5c-754a5c103470 service neutron] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:54:33.348133 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612e6b9d-9d3f-4ba3-af5c-754a5c103470 service neutron] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:54:33.407213 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437f6bd4-81cb-4a24-8fcd-e4c0509160b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:54:33.407843 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437f6bd4-81cb-4a24-8fcd-e4c0509160b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:54:33.408117 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437f6bd4-81cb-4a24-8fcd-e4c0509160b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:54:33.408407 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437f6bd4-81cb-4a24-8fcd-e4c0509160b9 admin admin] PATH_INFO: `/v3/users/cbcc8895a4e64877b110e00022b819c0` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:54:33.410082 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437f6bd4-81cb-4a24-8fcd-e4c0509160b9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cbcc8895a4e64877b110e00022b819c0)` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:54:33.413223 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437f6bd4-81cb-4a24-8fcd-e4c0509160b9 admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:54:33.467151 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-437f6bd4-81cb-4a24-8fcd-e4c0509160b9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cbcc8895a4e64877b110e00022b819c0'} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:54:33.467751 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-437f6bd4-81cb-4a24-8fcd-e4c0509160b9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cbcc8895a4e64877b110e00022b819c0'} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:54:33.474836 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-437f6bd4-81cb-4a24-8fcd-e4c0509160b9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cbcc8895a4e64877b110e00022b819c0'} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:54:33.475498 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-437f6bd4-81cb-4a24-8fcd-e4c0509160b9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cbcc8895a4e64877b110e00022b819c0'} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:54:33.482458 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:DELETE=12,keystone:SELECT=87,keystone:INSERT=1 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:54:33.488835 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-437f6bd4-81cb-4a24-8fcd-e4c0509160b9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cbcc8895a4e64877b110e00022b819c0'} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:54:33.502933 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 1072/2161] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 30 00:54:33 2022] DELETE /identity/v3/users/cbcc8895a4e64877b110e00022b819c0 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 00:54:33.800970 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f91816-2b3c-47cd-bf93-2f07252d72b0 admin admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:54:33.802649 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-74f91816-2b3c-47cd-bf93-2f07252d72b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:54:33.813423 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:54:33.818917 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f91816-2b3c-47cd-bf93-2f07252d72b0 admin admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:54:33.886081 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d8b0ce-718f-483d-a3f1-90e8db81da5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:54:33.886718 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d8b0ce-718f-483d-a3f1-90e8db81da5f admin admin] REQUEST_METHOD: `DELETE` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:54:33.886996 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d8b0ce-718f-483d-a3f1-90e8db81da5f admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:54:33.887333 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d8b0ce-718f-483d-a3f1-90e8db81da5f admin admin] PATH_INFO: `/v3/projects/a7557ff498424729bc3aa90d7759ed81` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:54:33.888474 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d8b0ce-718f-483d-a3f1-90e8db81da5f admin admin] RBAC: Authorizing `identity:delete_project(project_id=a7557ff498424729bc3aa90d7759ed81)` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:54:33.890469 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d8b0ce-718f-483d-a3f1-90e8db81da5f admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:54:33.941054 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-97d8b0ce-718f-483d-a3f1-90e8db81da5f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a7557ff498424729bc3aa90d7759ed81', 'request_id': 'req-97d8b0ce-718f-483d-a3f1-90e8db81da5f'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:54:33.950365 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-97d8b0ce-718f-483d-a3f1-90e8db81da5f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a7557ff498424729bc3aa90d7759ed81', 'request_id': 'req-97d8b0ce-718f-483d-a3f1-90e8db81da5f'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:54:33.957478 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-97d8b0ce-718f-483d-a3f1-90e8db81da5f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a7557ff498424729bc3aa90d7759ed81', 'request_id': 'req-97d8b0ce-718f-483d-a3f1-90e8db81da5f'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:54:33.968211 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-97d8b0ce-718f-483d-a3f1-90e8db81da5f admin admin] The token cache is being invalidate because project a7557ff498424729bc3aa90d7759ed81 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87956) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 00:54:33.968449 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-97d8b0ce-718f-483d-a3f1-90e8db81da5f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:54:33.969044 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-97d8b0ce-718f-483d-a3f1-90e8db81da5f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:54:33.970532 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 1090/2162] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 30 00:54:33 2022] DELETE /identity/v3/projects/a7557ff498424729bc3aa90d7759ed81 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 00:54:33.975668 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6fc685-cc17-41c1-be50-6120370fee8f None None] REQUEST_METHOD: `POST` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:54:33.976122 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6fc685-cc17-41c1-be50-6120370fee8f None None] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:54:33.976224 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6fc685-cc17-41c1-be50-6120370fee8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:54:33.996250 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.auth.core [None req-2d6fc685-cc17-41c1-be50-6120370fee8f None None] MFA Rules not processed for user `eb55b6cbca4945abb21b0e49eb745e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=87955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:54:33.997459 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-2d6fc685-cc17-41c1-be50-6120370fee8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:54:34.070984 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 1073/2163] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 30 00:54:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:54:34.080446 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236eec67-2dde-42a2-8ae1-20d8ce43cafd None None] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:54:34.080763 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236eec67-2dde-42a2-8ae1-20d8ce43cafd None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:54:34.081156 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236eec67-2dde-42a2-8ae1-20d8ce43cafd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:54:34.105643 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.auth.core [None req-236eec67-2dde-42a2-8ae1-20d8ce43cafd None None] MFA Rules not processed for user `eb55b6cbca4945abb21b0e49eb745e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=87956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:54:34.106860 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-236eec67-2dde-42a2-8ae1-20d8ce43cafd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:54:34.115018 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 1091/2164] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 30 00:54:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:54:34.119751 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6fc685-cc17-41c1-be50-6120370fee8f None None] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:54:34.130362 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6fc685-cc17-41c1-be50-6120370fee8f None None] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:54:34.136315 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39dd0ed8-8177-4191-a88b-b03bf8ca6376 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:54:34.136910 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dd0ed8-8177-4191-a88b-b03bf8ca6376 admin admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:54:34.137183 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dd0ed8-8177-4191-a88b-b03bf8ca6376 admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:54:34.137444 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dd0ed8-8177-4191-a88b-b03bf8ca6376 admin admin] PATH_INFO: `/v3/domains` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:54:34.138085 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39dd0ed8-8177-4191-a88b-b03bf8ca6376 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:54:34.138385 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39dd0ed8-8177-4191-a88b-b03bf8ca6376 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:54:34.140171 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39dd0ed8-8177-4191-a88b-b03bf8ca6376 admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:54:34.153432 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 1074/2165] 10.222.0.42 () {58 vars in 1153 bytes} [Sun Oct 30 00:54:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:54:34.157931 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236eec67-2dde-42a2-8ae1-20d8ce43cafd None None] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:54:34.172600 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236eec67-2dde-42a2-8ae1-20d8ce43cafd None None] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:54:34.181331 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae916413-4856-49a3-8a6a-62a2700bd74c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:54:34.182084 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae916413-4856-49a3-8a6a-62a2700bd74c admin admin] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:54:34.182426 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae916413-4856-49a3-8a6a-62a2700bd74c admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:54:34.182802 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae916413-4856-49a3-8a6a-62a2700bd74c admin admin] PATH_INFO: `/v3/projects` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:54:34.183860 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae916413-4856-49a3-8a6a-62a2700bd74c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:54:34.186676 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae916413-4856-49a3-8a6a-62a2700bd74c admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:54:34.220897 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 1092/2166] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 30 00:54:34 2022] POST /identity/v3/projects => generated 373 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 00:54:34.225313 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39dd0ed8-8177-4191-a88b-b03bf8ca6376 admin admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:54:34.235717 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39dd0ed8-8177-4191-a88b-b03bf8ca6376 admin admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:54:34.296650 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365d4930-43ea-4875-bd5b-4c27675290d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:54:34.297313 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365d4930-43ea-4875-bd5b-4c27675290d2 admin admin] REQUEST_METHOD: `POST` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:54:34.297583 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365d4930-43ea-4875-bd5b-4c27675290d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:54:34.297970 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365d4930-43ea-4875-bd5b-4c27675290d2 admin admin] PATH_INFO: `/v3/users` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:54:34.298732 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365d4930-43ea-4875-bd5b-4c27675290d2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:54:34.300913 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365d4930-43ea-4875-bd5b-4c27675290d2 admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:54:34.325470 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 1075/2167] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 30 00:54:34 2022] POST /identity/v3/users => generated 287 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 00:54:34.329850 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae916413-4856-49a3-8a6a-62a2700bd74c admin admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:54:34.341274 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae916413-4856-49a3-8a6a-62a2700bd74c admin admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:54:34.346778 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c65af1c-3400-447d-8bd8-5691497a2dda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:54:34.347406 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c65af1c-3400-447d-8bd8-5691497a2dda admin admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:54:34.347667 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c65af1c-3400-447d-8bd8-5691497a2dda admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:54:34.347973 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c65af1c-3400-447d-8bd8-5691497a2dda admin admin] PATH_INFO: `/v3/roles` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:54:34.348666 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c65af1c-3400-447d-8bd8-5691497a2dda admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:54:34.350294 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c65af1c-3400-447d-8bd8-5691497a2dda admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:54:34.361313 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 1093/2168] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 30 00:54:34 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 00:54:34.365676 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365d4930-43ea-4875-bd5b-4c27675290d2 admin admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:54:34.376140 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365d4930-43ea-4875-bd5b-4c27675290d2 admin admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:54:34.381219 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b246639a-64be-4bfe-aed9-cabcd18b8770 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:54:34.381929 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b246639a-64be-4bfe-aed9-cabcd18b8770 admin admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:54:34.382233 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b246639a-64be-4bfe-aed9-cabcd18b8770 admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:54:34.382519 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b246639a-64be-4bfe-aed9-cabcd18b8770 admin admin] PATH_INFO: `/v3/roles` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:54:34.383227 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b246639a-64be-4bfe-aed9-cabcd18b8770 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:54:34.384873 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b246639a-64be-4bfe-aed9-cabcd18b8770 admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:54:34.396474 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 1076/2169] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 30 00:54:34 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 00:54:34.400804 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c65af1c-3400-447d-8bd8-5691497a2dda admin admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:54:34.410940 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c65af1c-3400-447d-8bd8-5691497a2dda admin admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:54:34.415610 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdf018a-7c12-4c85-aa69-4a8a1647b645 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:54:34.416265 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdf018a-7c12-4c85-aa69-4a8a1647b645 admin admin] REQUEST_METHOD: `PUT` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:54:34.416571 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdf018a-7c12-4c85-aa69-4a8a1647b645 admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:54:34.416845 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdf018a-7c12-4c85-aa69-4a8a1647b645 admin admin] PATH_INFO: `/v3/projects/8e432d451c54429f97936b70b53626a8/users/c815d68fd44447058b7df6be5976200d/roles/1c93019874174c4b91118d9ce2347e47` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:54:34.432476 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcdf018a-7c12-4c85-aa69-4a8a1647b645 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e432d451c54429f97936b70b53626a8, user_id=c815d68fd44447058b7df6be5976200d, role_id=1c93019874174c4b91118d9ce2347e47)` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:54:34.435130 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcdf018a-7c12-4c85-aa69-4a8a1647b645 admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:54:34.452196 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 1094/2170] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 30 00:54:34 2022] PUT /identity/v3/projects/8e432d451c54429f97936b70b53626a8/users/c815d68fd44447058b7df6be5976200d/roles/1c93019874174c4b91118d9ce2347e47 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 00:54:34.464718 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515c936c-3e97-4810-84ac-96c4d8689255 None None] REQUEST_METHOD: `POST` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:54:34.465037 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515c936c-3e97-4810-84ac-96c4d8689255 None None] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:54:34.465333 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515c936c-3e97-4810-84ac-96c4d8689255 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:54:34.496340 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.auth.core [None req-515c936c-3e97-4810-84ac-96c4d8689255 None None] MFA Rules not processed for user `c815d68fd44447058b7df6be5976200d`. Rule list: `[]` (Enabled: `True`). {{(pid=87955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:54:34.497486 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-515c936c-3e97-4810-84ac-96c4d8689255 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:54:34.544309 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=94,keystone:DELETE=2,keystone:INSERT=4 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:54:34.574358 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 1077/2171] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 30 00:54:34 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:54:34.579314 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdf018a-7c12-4c85-aa69-4a8a1647b645 admin admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:54:34.615580 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:54:34.645946 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdf018a-7c12-4c85-aa69-4a8a1647b645 admin admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:54:34.651541 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001f690c-f5ab-4245-826f-a09ba911704b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:54:34.652150 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001f690c-f5ab-4245-826f-a09ba911704b admin admin] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:54:34.652424 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001f690c-f5ab-4245-826f-a09ba911704b admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:54:34.652688 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001f690c-f5ab-4245-826f-a09ba911704b admin admin] PATH_INFO: `/v3/projects` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:54:34.653318 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001f690c-f5ab-4245-826f-a09ba911704b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:54:34.655253 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001f690c-f5ab-4245-826f-a09ba911704b admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:54:34.689498 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 1095/2172] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 30 00:54:34 2022] POST /identity/v3/projects => generated 373 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 00:54:34.693864 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515c936c-3e97-4810-84ac-96c4d8689255 None None] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:54:34.705454 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515c936c-3e97-4810-84ac-96c4d8689255 None None] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:54:34.767944 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b58d50-63cb-4367-8d4e-8a8372fe1c0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:54:34.768656 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b58d50-63cb-4367-8d4e-8a8372fe1c0a admin admin] REQUEST_METHOD: `POST` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:54:34.768929 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b58d50-63cb-4367-8d4e-8a8372fe1c0a admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:54:34.769239 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b58d50-63cb-4367-8d4e-8a8372fe1c0a admin admin] PATH_INFO: `/v3/users` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:54:34.770077 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b58d50-63cb-4367-8d4e-8a8372fe1c0a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:54:34.773152 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b58d50-63cb-4367-8d4e-8a8372fe1c0a admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:54:34.798863 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 1078/2173] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 30 00:54:34 2022] POST /identity/v3/users => generated 293 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 00:54:34.803061 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001f690c-f5ab-4245-826f-a09ba911704b admin admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:54:34.813645 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001f690c-f5ab-4245-826f-a09ba911704b admin admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:54:34.818444 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1734d2f8-7e32-43ba-8763-5e42ec95d087 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:54:34.819039 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1734d2f8-7e32-43ba-8763-5e42ec95d087 admin admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:54:34.819347 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1734d2f8-7e32-43ba-8763-5e42ec95d087 admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:54:34.819607 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1734d2f8-7e32-43ba-8763-5e42ec95d087 admin admin] PATH_INFO: `/v3/roles` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:54:34.820254 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1734d2f8-7e32-43ba-8763-5e42ec95d087 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:54:34.822255 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1734d2f8-7e32-43ba-8763-5e42ec95d087 admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:54:34.833031 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 1096/2174] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 30 00:54:34 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 00:54:34.837433 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b58d50-63cb-4367-8d4e-8a8372fe1c0a admin admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:54:34.848386 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b58d50-63cb-4367-8d4e-8a8372fe1c0a admin admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:54:34.853950 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383a6d4e-8b02-45ca-b001-9d0776589964 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:54:34.854640 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383a6d4e-8b02-45ca-b001-9d0776589964 admin admin] REQUEST_METHOD: `PUT` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:54:34.854918 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383a6d4e-8b02-45ca-b001-9d0776589964 admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:54:34.855186 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383a6d4e-8b02-45ca-b001-9d0776589964 admin admin] PATH_INFO: `/v3/projects/227978a7b9ec4cb2a49245f1914ddc64/users/d45afae751f94ee9b2cc99374329ac44/roles/6ccaa8c11f29456fb4e4eeccb21616c7` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:54:34.870967 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383a6d4e-8b02-45ca-b001-9d0776589964 admin admin] RBAC: Authorizing `identity:create_grant(project_id=227978a7b9ec4cb2a49245f1914ddc64, user_id=d45afae751f94ee9b2cc99374329ac44, role_id=6ccaa8c11f29456fb4e4eeccb21616c7)` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:54:34.873683 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383a6d4e-8b02-45ca-b001-9d0776589964 admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:54:34.888362 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 1079/2175] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 30 00:54:34 2022] PUT /identity/v3/projects/227978a7b9ec4cb2a49245f1914ddc64/users/d45afae751f94ee9b2cc99374329ac44/roles/6ccaa8c11f29456fb4e4eeccb21616c7 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 00:54:34.892765 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1734d2f8-7e32-43ba-8763-5e42ec95d087 admin admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:54:34.903671 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1734d2f8-7e32-43ba-8763-5e42ec95d087 admin admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:54:34.962595 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f513f827-3dc6-4893-a160-1f2932a20968 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:54:34.963181 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f513f827-3dc6-4893-a160-1f2932a20968 admin admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:54:34.963496 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f513f827-3dc6-4893-a160-1f2932a20968 admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:54:34.963760 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f513f827-3dc6-4893-a160-1f2932a20968 admin admin] PATH_INFO: `/v3/roles` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:54:34.964396 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f513f827-3dc6-4893-a160-1f2932a20968 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:54:34.965979 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f513f827-3dc6-4893-a160-1f2932a20968 admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:54:34.975973 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 1097/2176] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 30 00:54:34 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 00:54:34.980744 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383a6d4e-8b02-45ca-b001-9d0776589964 admin admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:54:34.991914 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383a6d4e-8b02-45ca-b001-9d0776589964 admin admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:54:34.997355 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1330f3-db94-491a-a9fa-2111a78837c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:54:34.998024 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1330f3-db94-491a-a9fa-2111a78837c7 admin admin] REQUEST_METHOD: `PUT` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:54:34.998291 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1330f3-db94-491a-a9fa-2111a78837c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:54:34.998559 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1330f3-db94-491a-a9fa-2111a78837c7 admin admin] PATH_INFO: `/v3/projects/227978a7b9ec4cb2a49245f1914ddc64/users/d45afae751f94ee9b2cc99374329ac44/roles/6ccaa8c11f29456fb4e4eeccb21616c7` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:54:35.000696 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1330f3-db94-491a-a9fa-2111a78837c7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=227978a7b9ec4cb2a49245f1914ddc64, user_id=d45afae751f94ee9b2cc99374329ac44, role_id=6ccaa8c11f29456fb4e4eeccb21616c7)` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:54:35.003362 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1330f3-db94-491a-a9fa-2111a78837c7 admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:54:35.014531 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 1080/2177] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 30 00:54:34 2022] PUT /identity/v3/projects/227978a7b9ec4cb2a49245f1914ddc64/users/d45afae751f94ee9b2cc99374329ac44/roles/6ccaa8c11f29456fb4e4eeccb21616c7 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 00:54:35.025021 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d086a697-7d2c-45e8-88a6-7806573381eb None None] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:54:35.025404 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d086a697-7d2c-45e8-88a6-7806573381eb None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:54:35.025767 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d086a697-7d2c-45e8-88a6-7806573381eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:54:35.058187 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.auth.core [None req-d086a697-7d2c-45e8-88a6-7806573381eb None None] MFA Rules not processed for user `d45afae751f94ee9b2cc99374329ac44`. Rule list: `[]` (Enabled: `True`). {{(pid=87956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:54:35.059523 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-d086a697-7d2c-45e8-88a6-7806573381eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:54:35.135641 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 1098/2178] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 30 00:54:35 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:54:35.147916 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1330f3-db94-491a-a9fa-2111a78837c7 admin admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:54:35.149664 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-4f1330f3-db94-491a-a9fa-2111a78837c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:54:35.208908 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1330f3-db94-491a-a9fa-2111a78837c7 admin admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:54:35.213190 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a509d513-c5a5-45d1-becb-1e9b8f20d756 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48d928ff7fe24348ac900f09c56acc20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d2387fdf794d4eaef07bbcd7b39f2a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:54:35.213788 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a509d513-c5a5-45d1-becb-1e9b8f20d756 service cinder] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:54:35.214065 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a509d513-c5a5-45d1-becb-1e9b8f20d756 service cinder] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:54:35.214331 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a509d513-c5a5-45d1-becb-1e9b8f20d756 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:54:35.224249 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a509d513-c5a5-45d1-becb-1e9b8f20d756 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:54:35.230142 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a509d513-c5a5-45d1-becb-1e9b8f20d756 service cinder] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:54:35.235961 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 1081/2179] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 30 00:54:35 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 00:54:35.662388 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d086a697-7d2c-45e8-88a6-7806573381eb None None] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:54:35.695899 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:54:35.740756 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d086a697-7d2c-45e8-88a6-7806573381eb None None] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:54:35.745793 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a215197-bae3-42f4-980a-a41337627504 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:54:35.746429 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a215197-bae3-42f4-980a-a41337627504 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:54:35.746697 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a215197-bae3-42f4-980a-a41337627504 admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:54:35.746974 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a215197-bae3-42f4-980a-a41337627504 admin admin] PATH_INFO: `/v3/users/c815d68fd44447058b7df6be5976200d` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:54:35.748194 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a215197-bae3-42f4-980a-a41337627504 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c815d68fd44447058b7df6be5976200d)` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:54:35.750129 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a215197-bae3-42f4-980a-a41337627504 admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:54:35.796728 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-1a215197-bae3-42f4-980a-a41337627504 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c815d68fd44447058b7df6be5976200d'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:54:35.797417 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-1a215197-bae3-42f4-980a-a41337627504 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c815d68fd44447058b7df6be5976200d'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:54:35.809177 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-1a215197-bae3-42f4-980a-a41337627504 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c815d68fd44447058b7df6be5976200d'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:54:35.817950 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-1a215197-bae3-42f4-980a-a41337627504 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c815d68fd44447058b7df6be5976200d'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:54:35.825144 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-1a215197-bae3-42f4-980a-a41337627504 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c815d68fd44447058b7df6be5976200d'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:54:35.831012 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 1099/2180] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 30 00:54:35 2022] DELETE /identity/v3/users/c815d68fd44447058b7df6be5976200d => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 00:54:35.835777 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a6f09d-1c8d-41de-a450-8506185a4c96 None None] REQUEST_METHOD: `POST` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:54:35.836058 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a6f09d-1c8d-41de-a450-8506185a4c96 None None] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:54:35.836330 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a6f09d-1c8d-41de-a450-8506185a4c96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:54:35.857764 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.auth.core [None req-b7a6f09d-1c8d-41de-a450-8506185a4c96 None None] MFA Rules not processed for user `eb55b6cbca4945abb21b0e49eb745e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=87955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:54:35.859037 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-b7a6f09d-1c8d-41de-a450-8506185a4c96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:54:35.889177 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:54:35.921248 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 1082/2181] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 30 00:54:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:54:35.931472 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a215197-bae3-42f4-980a-a41337627504 admin admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:54:35.933003 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-1a215197-bae3-42f4-980a-a41337627504 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:54:35.990764 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a215197-bae3-42f4-980a-a41337627504 admin admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:54:35.994634 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4c238e-3016-439a-bffb-dd05b4d34f20 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5693f186c6ad4d9394f02ee3477cdcd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d2387fdf794d4eaef07bbcd7b39f2a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:54:35.995258 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4c238e-3016-439a-bffb-dd05b4d34f20 service neutron] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:54:35.995536 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4c238e-3016-439a-bffb-dd05b4d34f20 service neutron] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:54:35.995805 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4c238e-3016-439a-bffb-dd05b4d34f20 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:54:36.005137 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4c238e-3016-439a-bffb-dd05b4d34f20 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:54:36.006562 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4c238e-3016-439a-bffb-dd05b4d34f20 service neutron] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:54:36.016028 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 1100/2182] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 30 00:54:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 00:54:36.296572 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a6f09d-1c8d-41de-a450-8506185a4c96 None None] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:54:36.298108 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-b7a6f09d-1c8d-41de-a450-8506185a4c96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:54:36.312307 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a6f09d-1c8d-41de-a450-8506185a4c96 None None] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:54:36.318498 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db58cec0-07f2-4574-8d88-c47cc62c3fc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:54:36.319276 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db58cec0-07f2-4574-8d88-c47cc62c3fc0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:54:36.319551 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db58cec0-07f2-4574-8d88-c47cc62c3fc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:54:36.319817 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db58cec0-07f2-4574-8d88-c47cc62c3fc0 admin admin] PATH_INFO: `/v3/projects/8e432d451c54429f97936b70b53626a8` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:54:36.321173 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db58cec0-07f2-4574-8d88-c47cc62c3fc0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8e432d451c54429f97936b70b53626a8)` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:54:36.324454 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db58cec0-07f2-4574-8d88-c47cc62c3fc0 admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:54:36.372697 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-db58cec0-07f2-4574-8d88-c47cc62c3fc0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8e432d451c54429f97936b70b53626a8', 'request_id': 'req-db58cec0-07f2-4574-8d88-c47cc62c3fc0'} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:54:36.378177 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-db58cec0-07f2-4574-8d88-c47cc62c3fc0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8e432d451c54429f97936b70b53626a8', 'request_id': 'req-db58cec0-07f2-4574-8d88-c47cc62c3fc0'} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:54:36.385766 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-db58cec0-07f2-4574-8d88-c47cc62c3fc0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8e432d451c54429f97936b70b53626a8', 'request_id': 'req-db58cec0-07f2-4574-8d88-c47cc62c3fc0'} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:54:36.397198 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-db58cec0-07f2-4574-8d88-c47cc62c3fc0 admin admin] The token cache is being invalidate because project 8e432d451c54429f97936b70b53626a8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87955) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 00:54:36.397485 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-db58cec0-07f2-4574-8d88-c47cc62c3fc0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:54:36.398122 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-db58cec0-07f2-4574-8d88-c47cc62c3fc0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:54:36.399671 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 1083/2183] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 30 00:54:36 2022] DELETE /identity/v3/projects/8e432d451c54429f97936b70b53626a8 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 00:54:36.404001 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4c238e-3016-439a-bffb-dd05b4d34f20 service neutron] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:54:36.414562 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4c238e-3016-439a-bffb-dd05b4d34f20 service neutron] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:54:36.464926 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:54:36.478435 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2d4ff0-e861-421e-a39c-6a3679328138 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:54:36.479102 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2d4ff0-e861-421e-a39c-6a3679328138 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:54:36.479403 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2d4ff0-e861-421e-a39c-6a3679328138 admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:54:36.479678 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2d4ff0-e861-421e-a39c-6a3679328138 admin admin] PATH_INFO: `/v3/users/d45afae751f94ee9b2cc99374329ac44` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:54:36.480833 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2d4ff0-e861-421e-a39c-6a3679328138 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d45afae751f94ee9b2cc99374329ac44)` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:54:36.482754 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2d4ff0-e861-421e-a39c-6a3679328138 admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:54:36.531331 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-9b2d4ff0-e861-421e-a39c-6a3679328138 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd45afae751f94ee9b2cc99374329ac44'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:54:36.531994 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-9b2d4ff0-e861-421e-a39c-6a3679328138 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd45afae751f94ee9b2cc99374329ac44'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:54:36.543505 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-9b2d4ff0-e861-421e-a39c-6a3679328138 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd45afae751f94ee9b2cc99374329ac44'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:54:36.552815 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-9b2d4ff0-e861-421e-a39c-6a3679328138 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd45afae751f94ee9b2cc99374329ac44'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:54:36.559977 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-9b2d4ff0-e861-421e-a39c-6a3679328138 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd45afae751f94ee9b2cc99374329ac44'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:54:36.565757 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 1101/2184] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 30 00:54:36 2022] DELETE /identity/v3/users/d45afae751f94ee9b2cc99374329ac44 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 00:54:36.850015 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db58cec0-07f2-4574-8d88-c47cc62c3fc0 admin admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:54:36.851589 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-db58cec0-07f2-4574-8d88-c47cc62c3fc0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:54:36.866254 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db58cec0-07f2-4574-8d88-c47cc62c3fc0 admin admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:54:36.927413 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300c54ac-e792-4c80-9cf9-44b8f5479346 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:54:36.928052 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300c54ac-e792-4c80-9cf9-44b8f5479346 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:54:36.928325 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300c54ac-e792-4c80-9cf9-44b8f5479346 admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:54:36.928595 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300c54ac-e792-4c80-9cf9-44b8f5479346 admin admin] PATH_INFO: `/v3/projects/227978a7b9ec4cb2a49245f1914ddc64` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:54:36.929694 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300c54ac-e792-4c80-9cf9-44b8f5479346 admin admin] RBAC: Authorizing `identity:delete_project(project_id=227978a7b9ec4cb2a49245f1914ddc64)` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:54:36.931645 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300c54ac-e792-4c80-9cf9-44b8f5479346 admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:54:36.982567 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-300c54ac-e792-4c80-9cf9-44b8f5479346 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '227978a7b9ec4cb2a49245f1914ddc64', 'request_id': 'req-300c54ac-e792-4c80-9cf9-44b8f5479346'} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:54:36.991725 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-300c54ac-e792-4c80-9cf9-44b8f5479346 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '227978a7b9ec4cb2a49245f1914ddc64', 'request_id': 'req-300c54ac-e792-4c80-9cf9-44b8f5479346'} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:54:36.994110 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:54:37.002841 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-300c54ac-e792-4c80-9cf9-44b8f5479346 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '227978a7b9ec4cb2a49245f1914ddc64', 'request_id': 'req-300c54ac-e792-4c80-9cf9-44b8f5479346'} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:54:37.015545 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-300c54ac-e792-4c80-9cf9-44b8f5479346 admin admin] The token cache is being invalidate because project 227978a7b9ec4cb2a49245f1914ddc64 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87955) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 00:54:37.015830 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-300c54ac-e792-4c80-9cf9-44b8f5479346 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:54:37.016473 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-300c54ac-e792-4c80-9cf9-44b8f5479346 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:54:37.018021 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 1084/2185] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 30 00:54:36 2022] DELETE /identity/v3/projects/227978a7b9ec4cb2a49245f1914ddc64 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 00:54:37.023252 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562163e7-a838-428f-be98-a50c3f0f9ca7 None None] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:54:37.023752 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562163e7-a838-428f-be98-a50c3f0f9ca7 None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:54:37.023850 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562163e7-a838-428f-be98-a50c3f0f9ca7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:54:37.045490 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.auth.core [None req-562163e7-a838-428f-be98-a50c3f0f9ca7 None None] MFA Rules not processed for user `eb55b6cbca4945abb21b0e49eb745e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=87956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:54:37.046695 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-562163e7-a838-428f-be98-a50c3f0f9ca7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:54:37.109484 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 1102/2186] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 30 00:54:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:54:37.117710 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0abc32-dba3-4321-a3f6-b6769f13e71f None None] REQUEST_METHOD: `POST` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:54:37.117994 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0abc32-dba3-4321-a3f6-b6769f13e71f None None] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:54:37.118262 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0abc32-dba3-4321-a3f6-b6769f13e71f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:54:37.138373 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.auth.core [None req-bc0abc32-dba3-4321-a3f6-b6769f13e71f None None] MFA Rules not processed for user `eb55b6cbca4945abb21b0e49eb745e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=87955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:54:37.139629 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-bc0abc32-dba3-4321-a3f6-b6769f13e71f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:54:37.147780 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 1085/2187] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 30 00:54:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:54:37.152131 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562163e7-a838-428f-be98-a50c3f0f9ca7 None None] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:54:37.161933 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562163e7-a838-428f-be98-a50c3f0f9ca7 None None] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:54:37.167258 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5668e333-8a72-47ae-b0d4-353179db2820 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:54:37.167895 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5668e333-8a72-47ae-b0d4-353179db2820 admin admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:54:37.168164 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5668e333-8a72-47ae-b0d4-353179db2820 admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:54:37.168432 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5668e333-8a72-47ae-b0d4-353179db2820 admin admin] PATH_INFO: `/v3/domains` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:54:37.169078 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5668e333-8a72-47ae-b0d4-353179db2820 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87956) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:54:37.169379 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5668e333-8a72-47ae-b0d4-353179db2820 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:54:37.170975 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5668e333-8a72-47ae-b0d4-353179db2820 admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:54:37.183265 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 1103/2188] 10.222.0.42 () {58 vars in 1153 bytes} [Sun Oct 30 00:54:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:54:37.187443 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0abc32-dba3-4321-a3f6-b6769f13e71f None None] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:54:37.197249 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0abc32-dba3-4321-a3f6-b6769f13e71f None None] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:54:37.202543 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f53552-f8a0-486f-b104-d4fe714d8b01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:54:37.203146 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f53552-f8a0-486f-b104-d4fe714d8b01 admin admin] REQUEST_METHOD: `POST` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:54:37.203485 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f53552-f8a0-486f-b104-d4fe714d8b01 admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:54:37.203793 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f53552-f8a0-486f-b104-d4fe714d8b01 admin admin] PATH_INFO: `/v3/projects` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:54:37.204436 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f53552-f8a0-486f-b104-d4fe714d8b01 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:54:37.206405 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f53552-f8a0-486f-b104-d4fe714d8b01 admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:54:37.239368 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 1086/2189] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 30 00:54:37 2022] POST /identity/v3/projects => generated 385 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 00:54:37.245444 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5668e333-8a72-47ae-b0d4-353179db2820 admin admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:54:37.256215 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5668e333-8a72-47ae-b0d4-353179db2820 admin admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:54:37.307124 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:54:37.315606 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b827669-4aca-40fe-9991-de589c14bdc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:54:37.316178 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b827669-4aca-40fe-9991-de589c14bdc7 admin admin] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:54:37.316521 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b827669-4aca-40fe-9991-de589c14bdc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:54:37.316816 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b827669-4aca-40fe-9991-de589c14bdc7 admin admin] PATH_INFO: `/v3/users` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:54:37.318154 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b827669-4aca-40fe-9991-de589c14bdc7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:54:37.321171 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b827669-4aca-40fe-9991-de589c14bdc7 admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:54:37.344274 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 1104/2190] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 30 00:54:37 2022] POST /identity/v3/users => generated 293 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 00:54:37.349163 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f53552-f8a0-486f-b104-d4fe714d8b01 admin admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:54:37.366363 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f53552-f8a0-486f-b104-d4fe714d8b01 admin admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:54:37.371755 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e080c74b-6142-48c3-8880-4d1a57d86978 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:54:37.372405 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e080c74b-6142-48c3-8880-4d1a57d86978 admin admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:54:37.372686 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e080c74b-6142-48c3-8880-4d1a57d86978 admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:54:37.372950 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e080c74b-6142-48c3-8880-4d1a57d86978 admin admin] PATH_INFO: `/v3/roles` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:54:37.373608 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e080c74b-6142-48c3-8880-4d1a57d86978 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:54:37.375225 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e080c74b-6142-48c3-8880-4d1a57d86978 admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:54:37.387235 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 1087/2191] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 30 00:54:37 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 00:54:37.391490 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b827669-4aca-40fe-9991-de589c14bdc7 admin admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:54:37.402874 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b827669-4aca-40fe-9991-de589c14bdc7 admin admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:54:37.408449 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301f99ef-5433-4520-855a-2e389eacbae2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:54:37.409118 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301f99ef-5433-4520-855a-2e389eacbae2 admin admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:54:37.409421 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301f99ef-5433-4520-855a-2e389eacbae2 admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:54:37.409691 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301f99ef-5433-4520-855a-2e389eacbae2 admin admin] PATH_INFO: `/v3/roles` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:54:37.410354 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301f99ef-5433-4520-855a-2e389eacbae2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:54:37.412029 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301f99ef-5433-4520-855a-2e389eacbae2 admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:54:37.423578 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 1105/2192] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 30 00:54:37 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 00:54:37.428177 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e080c74b-6142-48c3-8880-4d1a57d86978 admin admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:54:37.440115 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e080c74b-6142-48c3-8880-4d1a57d86978 admin admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:54:37.445425 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad6d4dc-f060-4c99-8a68-000a05583f9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:54:37.446097 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad6d4dc-f060-4c99-8a68-000a05583f9c admin admin] REQUEST_METHOD: `PUT` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:54:37.446368 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad6d4dc-f060-4c99-8a68-000a05583f9c admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:54:37.447310 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad6d4dc-f060-4c99-8a68-000a05583f9c admin admin] PATH_INFO: `/v3/projects/2c371f8d58f24ad4814618d26d3eb8bb/users/e23d89f0e1664d258760a32f24bfe437/roles/1c93019874174c4b91118d9ce2347e47` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:54:37.463167 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad6d4dc-f060-4c99-8a68-000a05583f9c admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c371f8d58f24ad4814618d26d3eb8bb, user_id=e23d89f0e1664d258760a32f24bfe437, role_id=1c93019874174c4b91118d9ce2347e47)` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:54:37.465872 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad6d4dc-f060-4c99-8a68-000a05583f9c admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:54:37.479889 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 1088/2193] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 30 00:54:37 2022] PUT /identity/v3/projects/2c371f8d58f24ad4814618d26d3eb8bb/users/e23d89f0e1664d258760a32f24bfe437/roles/1c93019874174c4b91118d9ce2347e47 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 00:54:37.491823 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3d7bda-967e-431b-8342-4e2bd56cca11 None None] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:54:37.492255 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3d7bda-967e-431b-8342-4e2bd56cca11 None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:54:37.492531 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3d7bda-967e-431b-8342-4e2bd56cca11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:54:37.522004 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.auth.core [None req-5e3d7bda-967e-431b-8342-4e2bd56cca11 None None] MFA Rules not processed for user `e23d89f0e1664d258760a32f24bfe437`. Rule list: `[]` (Enabled: `True`). {{(pid=87956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:54:37.523358 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-5e3d7bda-967e-431b-8342-4e2bd56cca11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:54:37.592008 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 1106/2194] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 30 00:54:37 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:54:37.596608 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad6d4dc-f060-4c99-8a68-000a05583f9c admin admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:54:37.663859 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad6d4dc-f060-4c99-8a68-000a05583f9c admin admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:54:37.668442 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0db3a2-0fc2-4823-979d-efc506636652 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:54:37.669053 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0db3a2-0fc2-4823-979d-efc506636652 admin admin] REQUEST_METHOD: `POST` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:54:37.669325 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0db3a2-0fc2-4823-979d-efc506636652 admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:54:37.669591 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0db3a2-0fc2-4823-979d-efc506636652 admin admin] PATH_INFO: `/v3/projects` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:54:37.670216 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0db3a2-0fc2-4823-979d-efc506636652 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:54:37.672378 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0db3a2-0fc2-4823-979d-efc506636652 admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:54:37.705043 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 1089/2195] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 30 00:54:37 2022] POST /identity/v3/projects => generated 387 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 00:54:37.711684 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3d7bda-967e-431b-8342-4e2bd56cca11 None None] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:54:37.727170 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3d7bda-967e-431b-8342-4e2bd56cca11 None None] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:54:37.792336 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c37eb46-f6e8-4d21-8f6a-c48462391983 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:54:37.792955 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c37eb46-f6e8-4d21-8f6a-c48462391983 admin admin] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:54:37.793225 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c37eb46-f6e8-4d21-8f6a-c48462391983 admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:54:37.793489 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c37eb46-f6e8-4d21-8f6a-c48462391983 admin admin] PATH_INFO: `/v3/users` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:54:37.794133 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c37eb46-f6e8-4d21-8f6a-c48462391983 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:54:37.796125 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c37eb46-f6e8-4d21-8f6a-c48462391983 admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:54:37.822961 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 1107/2196] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 30 00:54:37 2022] POST /identity/v3/users => generated 294 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 00:54:37.824169 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0db3a2-0fc2-4823-979d-efc506636652 admin admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:54:37.835682 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0db3a2-0fc2-4823-979d-efc506636652 admin admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:54:37.840454 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9457f0-5c8e-4ab6-81ba-fe25786111e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:54:37.841065 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9457f0-5c8e-4ab6-81ba-fe25786111e7 admin admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:54:37.841343 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9457f0-5c8e-4ab6-81ba-fe25786111e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:54:37.841644 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9457f0-5c8e-4ab6-81ba-fe25786111e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:54:37.842296 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9457f0-5c8e-4ab6-81ba-fe25786111e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:54:37.844025 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9457f0-5c8e-4ab6-81ba-fe25786111e7 admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:54:37.857211 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 1090/2197] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 30 00:54:37 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 00:54:37.861488 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c37eb46-f6e8-4d21-8f6a-c48462391983 admin admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:54:37.871883 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c37eb46-f6e8-4d21-8f6a-c48462391983 admin admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:54:37.877088 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40525cff-6058-4420-9b46-9119cf697ff9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:54:37.877694 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40525cff-6058-4420-9b46-9119cf697ff9 admin admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:54:37.877970 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40525cff-6058-4420-9b46-9119cf697ff9 admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:54:37.878254 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40525cff-6058-4420-9b46-9119cf697ff9 admin admin] PATH_INFO: `/v3/roles` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:54:37.878950 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40525cff-6058-4420-9b46-9119cf697ff9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:54:37.880603 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40525cff-6058-4420-9b46-9119cf697ff9 admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:54:37.890882 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 1108/2198] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 30 00:54:37 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 00:54:37.895323 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9457f0-5c8e-4ab6-81ba-fe25786111e7 admin admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:54:37.906263 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9457f0-5c8e-4ab6-81ba-fe25786111e7 admin admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:54:37.911913 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bcae18-7cf1-4887-bb28-6cba4a9f01e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:54:37.912551 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bcae18-7cf1-4887-bb28-6cba4a9f01e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:54:37.912827 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bcae18-7cf1-4887-bb28-6cba4a9f01e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:54:37.913102 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bcae18-7cf1-4887-bb28-6cba4a9f01e4 admin admin] PATH_INFO: `/v3/projects/8784febb50d5479596d9dce9a485493e/users/45899c7c547d405cad81aba875474ba4/roles/1c93019874174c4b91118d9ce2347e47` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:54:37.930097 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8bcae18-7cf1-4887-bb28-6cba4a9f01e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8784febb50d5479596d9dce9a485493e, user_id=45899c7c547d405cad81aba875474ba4, role_id=1c93019874174c4b91118d9ce2347e47)` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:54:37.932870 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8bcae18-7cf1-4887-bb28-6cba4a9f01e4 admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:54:37.949482 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 1091/2199] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 30 00:54:37 2022] PUT /identity/v3/projects/8784febb50d5479596d9dce9a485493e/users/45899c7c547d405cad81aba875474ba4/roles/1c93019874174c4b91118d9ce2347e47 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 00:54:37.960527 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff48db7c-f26e-4302-b899-efeb6378bf1a None None] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:54:37.960809 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff48db7c-f26e-4302-b899-efeb6378bf1a None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:54:37.961080 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff48db7c-f26e-4302-b899-efeb6378bf1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:54:37.989756 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.auth.core [None req-ff48db7c-f26e-4302-b899-efeb6378bf1a None None] MFA Rules not processed for user `45899c7c547d405cad81aba875474ba4`. Rule list: `[]` (Enabled: `True`). {{(pid=87956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:54:37.990986 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-ff48db7c-f26e-4302-b899-efeb6378bf1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:54:38.021604 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:54:38.062545 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 1109/2200] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 30 00:54:37 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:54:38.067321 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bcae18-7cf1-4887-bb28-6cba4a9f01e4 admin admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:54:38.103378 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:INSERT=5,keystone:DELETE=1,keystone:SELECT=94 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:54:38.132852 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bcae18-7cf1-4887-bb28-6cba4a9f01e4 admin admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:54:38.137773 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d4a193-614b-4351-a975-2a48683eb9c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:54:38.138539 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d4a193-614b-4351-a975-2a48683eb9c2 admin admin] REQUEST_METHOD: `POST` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:54:38.138833 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d4a193-614b-4351-a975-2a48683eb9c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:54:38.139018 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d4a193-614b-4351-a975-2a48683eb9c2 admin admin] PATH_INFO: `/v3/projects` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:54:38.139686 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d4a193-614b-4351-a975-2a48683eb9c2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:54:38.141665 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d4a193-614b-4351-a975-2a48683eb9c2 admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:54:38.169795 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 1092/2201] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 30 00:54:38 2022] POST /identity/v3/projects => generated 387 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 00:54:38.173999 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff48db7c-f26e-4302-b899-efeb6378bf1a None None] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:54:38.185038 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff48db7c-f26e-4302-b899-efeb6378bf1a None None] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:54:38.250740 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2360ce-47d5-4f79-b02c-cef744f609c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:54:38.251489 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2360ce-47d5-4f79-b02c-cef744f609c3 admin admin] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:54:38.251829 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2360ce-47d5-4f79-b02c-cef744f609c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:54:38.252159 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2360ce-47d5-4f79-b02c-cef744f609c3 admin admin] PATH_INFO: `/v3/users` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:54:38.252832 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2360ce-47d5-4f79-b02c-cef744f609c3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:54:38.254802 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2360ce-47d5-4f79-b02c-cef744f609c3 admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:54:38.280203 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 1110/2202] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 30 00:54:38 2022] POST /identity/v3/users => generated 300 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 30 00:54:38.281417 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d4a193-614b-4351-a975-2a48683eb9c2 admin admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:54:38.291777 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d4a193-614b-4351-a975-2a48683eb9c2 admin admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:54:38.296314 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56dcf02c-7d5e-46e9-83ea-a2cf11f95fe1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:54:38.296919 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dcf02c-7d5e-46e9-83ea-a2cf11f95fe1 admin admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:54:38.297195 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dcf02c-7d5e-46e9-83ea-a2cf11f95fe1 admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:54:38.297531 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dcf02c-7d5e-46e9-83ea-a2cf11f95fe1 admin admin] PATH_INFO: `/v3/roles` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:54:38.298199 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56dcf02c-7d5e-46e9-83ea-a2cf11f95fe1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:54:38.299885 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56dcf02c-7d5e-46e9-83ea-a2cf11f95fe1 admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:54:38.310786 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 1093/2203] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 30 00:54:38 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 00:54:38.315540 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2360ce-47d5-4f79-b02c-cef744f609c3 admin admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:54:38.325940 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2360ce-47d5-4f79-b02c-cef744f609c3 admin admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:54:38.331102 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431003d7-6a3d-4cf4-97ce-3577bd093abe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:54:38.331804 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431003d7-6a3d-4cf4-97ce-3577bd093abe admin admin] REQUEST_METHOD: `PUT` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:54:38.332077 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431003d7-6a3d-4cf4-97ce-3577bd093abe admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:54:38.332341 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431003d7-6a3d-4cf4-97ce-3577bd093abe admin admin] PATH_INFO: `/v3/projects/2d06485ef3b8423ab126f552208a6975/users/3f886369cf704215a66f65cb4a1af31b/roles/6ccaa8c11f29456fb4e4eeccb21616c7` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:54:38.348004 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431003d7-6a3d-4cf4-97ce-3577bd093abe admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d06485ef3b8423ab126f552208a6975, user_id=3f886369cf704215a66f65cb4a1af31b, role_id=6ccaa8c11f29456fb4e4eeccb21616c7)` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:54:38.350675 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431003d7-6a3d-4cf4-97ce-3577bd093abe admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:54:38.366964 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 1111/2204] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 30 00:54:38 2022] PUT /identity/v3/projects/2d06485ef3b8423ab126f552208a6975/users/3f886369cf704215a66f65cb4a1af31b/roles/6ccaa8c11f29456fb4e4eeccb21616c7 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 00:54:38.371054 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56dcf02c-7d5e-46e9-83ea-a2cf11f95fe1 admin admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:54:38.381161 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56dcf02c-7d5e-46e9-83ea-a2cf11f95fe1 admin admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:54:38.439434 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b554a48-5921-4530-8b04-7e6970bc1744 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:54:38.439969 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b554a48-5921-4530-8b04-7e6970bc1744 admin admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:54:38.440245 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b554a48-5921-4530-8b04-7e6970bc1744 admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:54:38.440520 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b554a48-5921-4530-8b04-7e6970bc1744 admin admin] PATH_INFO: `/v3/roles` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:54:38.441160 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b554a48-5921-4530-8b04-7e6970bc1744 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:54:38.442797 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b554a48-5921-4530-8b04-7e6970bc1744 admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:54:38.453111 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 1094/2205] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 30 00:54:38 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 00:54:38.457902 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431003d7-6a3d-4cf4-97ce-3577bd093abe admin admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:54:38.468443 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431003d7-6a3d-4cf4-97ce-3577bd093abe admin admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:54:38.474085 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a828c596-4265-497d-86ac-208d527bc807 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:54:38.474726 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a828c596-4265-497d-86ac-208d527bc807 admin admin] REQUEST_METHOD: `PUT` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:54:38.474999 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a828c596-4265-497d-86ac-208d527bc807 admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:54:38.475292 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a828c596-4265-497d-86ac-208d527bc807 admin admin] PATH_INFO: `/v3/projects/2d06485ef3b8423ab126f552208a6975/users/3f886369cf704215a66f65cb4a1af31b/roles/6ccaa8c11f29456fb4e4eeccb21616c7` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:54:38.477526 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a828c596-4265-497d-86ac-208d527bc807 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d06485ef3b8423ab126f552208a6975, user_id=3f886369cf704215a66f65cb4a1af31b, role_id=6ccaa8c11f29456fb4e4eeccb21616c7)` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:54:38.480261 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a828c596-4265-497d-86ac-208d527bc807 admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:54:38.491151 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 1112/2206] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 30 00:54:38 2022] PUT /identity/v3/projects/2d06485ef3b8423ab126f552208a6975/users/3f886369cf704215a66f65cb4a1af31b/roles/6ccaa8c11f29456fb4e4eeccb21616c7 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 00:54:38.501522 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1298bf1-9ccd-445f-b2a5-586f6e9aa72d None None] REQUEST_METHOD: `POST` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:54:38.501805 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1298bf1-9ccd-445f-b2a5-586f6e9aa72d None None] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:54:38.502078 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1298bf1-9ccd-445f-b2a5-586f6e9aa72d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:54:38.530533 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.auth.core [None req-b1298bf1-9ccd-445f-b2a5-586f6e9aa72d None None] MFA Rules not processed for user `3f886369cf704215a66f65cb4a1af31b`. Rule list: `[]` (Enabled: `True`). {{(pid=87955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:54:38.531993 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-b1298bf1-9ccd-445f-b2a5-586f6e9aa72d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:54:38.600116 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 1095/2207] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 30 00:54:38 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:54:38.615266 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a828c596-4265-497d-86ac-208d527bc807 admin admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:54:38.618051 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-a828c596-4265-497d-86ac-208d527bc807 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:54:38.680844 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a828c596-4265-497d-86ac-208d527bc807 admin admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:54:38.684882 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b89f14-24a9-4e3b-9ba7-0c8d0ab5c0f4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48d928ff7fe24348ac900f09c56acc20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d2387fdf794d4eaef07bbcd7b39f2a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:54:38.685476 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b89f14-24a9-4e3b-9ba7-0c8d0ab5c0f4 service cinder] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:54:38.685745 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b89f14-24a9-4e3b-9ba7-0c8d0ab5c0f4 service cinder] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:54:38.686078 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b89f14-24a9-4e3b-9ba7-0c8d0ab5c0f4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:54:38.696189 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b89f14-24a9-4e3b-9ba7-0c8d0ab5c0f4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:54:38.697917 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b89f14-24a9-4e3b-9ba7-0c8d0ab5c0f4 service cinder] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:54:38.707554 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 1113/2208] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 30 00:54:38 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 00:54:39.244172 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1298bf1-9ccd-445f-b2a5-586f6e9aa72d None None] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:54:39.245867 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-b1298bf1-9ccd-445f-b2a5-586f6e9aa72d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:54:39.258857 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1298bf1-9ccd-445f-b2a5-586f6e9aa72d None None] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:54:39.262817 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc0c43b-c092-405f-9f7b-ae8d48102821 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48d928ff7fe24348ac900f09c56acc20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d2387fdf794d4eaef07bbcd7b39f2a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:54:39.263440 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc0c43b-c092-405f-9f7b-ae8d48102821 service cinder] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:54:39.263758 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc0c43b-c092-405f-9f7b-ae8d48102821 service cinder] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:54:39.264025 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc0c43b-c092-405f-9f7b-ae8d48102821 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:54:39.290198 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:54:39.320997 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc0c43b-c092-405f-9f7b-ae8d48102821 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:54:39.322795 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc0c43b-c092-405f-9f7b-ae8d48102821 service cinder] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:54:39.331787 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 1096/2209] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 30 00:54:39 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 00:54:43.400064 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b89f14-24a9-4e3b-9ba7-0c8d0ab5c0f4 service cinder] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:54:43.409082 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b89f14-24a9-4e3b-9ba7-0c8d0ab5c0f4 service cinder] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:54:43.413260 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7dab548-3a0f-439a-ae8e-1d84da469d4e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48d928ff7fe24348ac900f09c56acc20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d2387fdf794d4eaef07bbcd7b39f2a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:54:43.413848 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dab548-3a0f-439a-ae8e-1d84da469d4e service cinder] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:54:43.414121 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dab548-3a0f-439a-ae8e-1d84da469d4e service cinder] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:54:43.414386 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dab548-3a0f-439a-ae8e-1d84da469d4e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:54:43.438689 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:54:43.481749 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7dab548-3a0f-439a-ae8e-1d84da469d4e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:54:43.483187 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7dab548-3a0f-439a-ae8e-1d84da469d4e service cinder] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:54:43.492289 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 1114/2210] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 30 00:54:43 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 00:54:45.627328 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc0c43b-c092-405f-9f7b-ae8d48102821 service cinder] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:54:45.710899 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc0c43b-c092-405f-9f7b-ae8d48102821 service cinder] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:54:45.715318 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1138709e-4e1e-472d-ad21-a97ebb14a35c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:54:45.715975 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1138709e-4e1e-472d-ad21-a97ebb14a35c admin admin] REQUEST_METHOD: `DELETE` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:54:45.716254 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1138709e-4e1e-472d-ad21-a97ebb14a35c admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:54:45.716517 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1138709e-4e1e-472d-ad21-a97ebb14a35c admin admin] PATH_INFO: `/v3/users/e23d89f0e1664d258760a32f24bfe437` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:54:45.717598 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1138709e-4e1e-472d-ad21-a97ebb14a35c admin admin] RBAC: Authorizing `identity:delete_user(user_id=e23d89f0e1664d258760a32f24bfe437)` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:54:45.719561 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1138709e-4e1e-472d-ad21-a97ebb14a35c admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:54:45.769498 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-1138709e-4e1e-472d-ad21-a97ebb14a35c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e23d89f0e1664d258760a32f24bfe437'} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:54:45.770209 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-1138709e-4e1e-472d-ad21-a97ebb14a35c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e23d89f0e1664d258760a32f24bfe437'} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:54:45.777510 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-1138709e-4e1e-472d-ad21-a97ebb14a35c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e23d89f0e1664d258760a32f24bfe437'} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:54:45.778195 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-1138709e-4e1e-472d-ad21-a97ebb14a35c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e23d89f0e1664d258760a32f24bfe437'} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:54:45.798838 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-1138709e-4e1e-472d-ad21-a97ebb14a35c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e23d89f0e1664d258760a32f24bfe437'} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:54:45.813346 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 1097/2211] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 30 00:54:45 2022] DELETE /identity/v3/users/e23d89f0e1664d258760a32f24bfe437 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 00:54:45.821116 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13483f2-17e7-42be-8d37-18b1f68570cf None None] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:54:45.821613 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13483f2-17e7-42be-8d37-18b1f68570cf None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:54:45.822085 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13483f2-17e7-42be-8d37-18b1f68570cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:54:45.841125 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.auth.core [None req-b13483f2-17e7-42be-8d37-18b1f68570cf None None] MFA Rules not processed for user `eb55b6cbca4945abb21b0e49eb745e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=87956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:54:45.842311 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-b13483f2-17e7-42be-8d37-18b1f68570cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:54:45.899618 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 1115/2212] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 30 00:54:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:54:45.909701 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1138709e-4e1e-472d-ad21-a97ebb14a35c admin admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:54:45.911234 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-1138709e-4e1e-472d-ad21-a97ebb14a35c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:54:45.964767 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:54:45.971873 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1138709e-4e1e-472d-ad21-a97ebb14a35c admin admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:54:45.976784 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73316888-74ad-47f4-950e-2398ed0e8da3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5693f186c6ad4d9394f02ee3477cdcd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d2387fdf794d4eaef07bbcd7b39f2a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:54:45.977384 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73316888-74ad-47f4-950e-2398ed0e8da3 service neutron] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:54:45.977826 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73316888-74ad-47f4-950e-2398ed0e8da3 service neutron] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:54:45.978309 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73316888-74ad-47f4-950e-2398ed0e8da3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:54:45.987426 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73316888-74ad-47f4-950e-2398ed0e8da3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:54:45.988865 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73316888-74ad-47f4-950e-2398ed0e8da3 service neutron] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:54:45.998615 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 1098/2213] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 30 00:54:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 00:54:46.281704 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13483f2-17e7-42be-8d37-18b1f68570cf None None] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:54:46.283335 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-b13483f2-17e7-42be-8d37-18b1f68570cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:54:46.296805 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13483f2-17e7-42be-8d37-18b1f68570cf None None] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:54:46.301946 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0017a0-a004-4284-9ffb-bb0769c326d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:54:46.302687 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0017a0-a004-4284-9ffb-bb0769c326d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:54:46.303089 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0017a0-a004-4284-9ffb-bb0769c326d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:54:46.303377 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0017a0-a004-4284-9ffb-bb0769c326d3 admin admin] PATH_INFO: `/v3/projects/2c371f8d58f24ad4814618d26d3eb8bb` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:54:46.304675 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0017a0-a004-4284-9ffb-bb0769c326d3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2c371f8d58f24ad4814618d26d3eb8bb)` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:54:46.306628 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0017a0-a004-4284-9ffb-bb0769c326d3 admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:54:46.352784 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-8e0017a0-a004-4284-9ffb-bb0769c326d3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2c371f8d58f24ad4814618d26d3eb8bb', 'request_id': 'req-8e0017a0-a004-4284-9ffb-bb0769c326d3'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:54:46.360160 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-8e0017a0-a004-4284-9ffb-bb0769c326d3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2c371f8d58f24ad4814618d26d3eb8bb', 'request_id': 'req-8e0017a0-a004-4284-9ffb-bb0769c326d3'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:54:46.366573 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-8e0017a0-a004-4284-9ffb-bb0769c326d3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2c371f8d58f24ad4814618d26d3eb8bb', 'request_id': 'req-8e0017a0-a004-4284-9ffb-bb0769c326d3'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:54:46.376721 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-8e0017a0-a004-4284-9ffb-bb0769c326d3 admin admin] The token cache is being invalidate because project 2c371f8d58f24ad4814618d26d3eb8bb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87956) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 00:54:46.377003 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-8e0017a0-a004-4284-9ffb-bb0769c326d3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:54:46.377617 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-8e0017a0-a004-4284-9ffb-bb0769c326d3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:54:46.379109 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 1116/2214] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 30 00:54:46 2022] DELETE /identity/v3/projects/2c371f8d58f24ad4814618d26d3eb8bb => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 00:54:46.383391 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73316888-74ad-47f4-950e-2398ed0e8da3 service neutron] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:54:46.393310 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73316888-74ad-47f4-950e-2398ed0e8da3 service neutron] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:54:46.450395 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0d68a5-32d3-4b9f-ab8e-2cd45dc0882b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:54:46.451018 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0d68a5-32d3-4b9f-ab8e-2cd45dc0882b admin admin] REQUEST_METHOD: `DELETE` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:54:46.451313 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0d68a5-32d3-4b9f-ab8e-2cd45dc0882b admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:54:46.451581 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0d68a5-32d3-4b9f-ab8e-2cd45dc0882b admin admin] PATH_INFO: `/v3/users/45899c7c547d405cad81aba875474ba4` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:54:46.452901 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0d68a5-32d3-4b9f-ab8e-2cd45dc0882b admin admin] RBAC: Authorizing `identity:delete_user(user_id=45899c7c547d405cad81aba875474ba4)` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:54:46.454637 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0d68a5-32d3-4b9f-ab8e-2cd45dc0882b admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:54:46.500832 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-0f0d68a5-32d3-4b9f-ab8e-2cd45dc0882b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '45899c7c547d405cad81aba875474ba4'} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:54:46.501445 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-0f0d68a5-32d3-4b9f-ab8e-2cd45dc0882b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '45899c7c547d405cad81aba875474ba4'} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:54:46.508566 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-0f0d68a5-32d3-4b9f-ab8e-2cd45dc0882b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '45899c7c547d405cad81aba875474ba4'} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:54:46.509188 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-0f0d68a5-32d3-4b9f-ab8e-2cd45dc0882b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '45899c7c547d405cad81aba875474ba4'} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:54:46.520991 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-0f0d68a5-32d3-4b9f-ab8e-2cd45dc0882b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '45899c7c547d405cad81aba875474ba4'} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:54:46.536017 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 1099/2215] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 30 00:54:46 2022] DELETE /identity/v3/users/45899c7c547d405cad81aba875474ba4 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 00:54:46.805717 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0017a0-a004-4284-9ffb-bb0769c326d3 admin admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:54:46.807337 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-8e0017a0-a004-4284-9ffb-bb0769c326d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:54:46.822577 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0017a0-a004-4284-9ffb-bb0769c326d3 admin admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:54:46.877261 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:54:46.890233 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481d0bc7-22b2-4219-a396-09e8756b841d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:54:46.890889 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481d0bc7-22b2-4219-a396-09e8756b841d admin admin] REQUEST_METHOD: `DELETE` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:54:46.891159 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481d0bc7-22b2-4219-a396-09e8756b841d admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:54:46.891458 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481d0bc7-22b2-4219-a396-09e8756b841d admin admin] PATH_INFO: `/v3/projects/8784febb50d5479596d9dce9a485493e` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:54:46.892585 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481d0bc7-22b2-4219-a396-09e8756b841d admin admin] RBAC: Authorizing `identity:delete_project(project_id=8784febb50d5479596d9dce9a485493e)` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:54:46.894517 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481d0bc7-22b2-4219-a396-09e8756b841d admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:54:46.944349 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-481d0bc7-22b2-4219-a396-09e8756b841d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8784febb50d5479596d9dce9a485493e', 'request_id': 'req-481d0bc7-22b2-4219-a396-09e8756b841d'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:54:46.952624 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-481d0bc7-22b2-4219-a396-09e8756b841d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8784febb50d5479596d9dce9a485493e', 'request_id': 'req-481d0bc7-22b2-4219-a396-09e8756b841d'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:54:46.959368 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-481d0bc7-22b2-4219-a396-09e8756b841d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8784febb50d5479596d9dce9a485493e', 'request_id': 'req-481d0bc7-22b2-4219-a396-09e8756b841d'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:54:46.970984 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-481d0bc7-22b2-4219-a396-09e8756b841d admin admin] The token cache is being invalidate because project 8784febb50d5479596d9dce9a485493e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87956) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 00:54:46.971288 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-481d0bc7-22b2-4219-a396-09e8756b841d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:54:46.971958 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-481d0bc7-22b2-4219-a396-09e8756b841d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:54:46.973451 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 1117/2216] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 30 00:54:46 2022] DELETE /identity/v3/projects/8784febb50d5479596d9dce9a485493e => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 00:54:46.977528 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0d68a5-32d3-4b9f-ab8e-2cd45dc0882b admin admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:54:46.980201 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-0f0d68a5-32d3-4b9f-ab8e-2cd45dc0882b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:54:46.999463 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0d68a5-32d3-4b9f-ab8e-2cd45dc0882b admin admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:54:47.060894 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8d1e47-6ee8-40ef-8474-1b9e5e05dd26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:54:47.061556 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8d1e47-6ee8-40ef-8474-1b9e5e05dd26 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:54:47.061833 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8d1e47-6ee8-40ef-8474-1b9e5e05dd26 admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:54:47.062102 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8d1e47-6ee8-40ef-8474-1b9e5e05dd26 admin admin] PATH_INFO: `/v3/users/3f886369cf704215a66f65cb4a1af31b` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:54:47.063358 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8d1e47-6ee8-40ef-8474-1b9e5e05dd26 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3f886369cf704215a66f65cb4a1af31b)` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:54:47.065280 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8d1e47-6ee8-40ef-8474-1b9e5e05dd26 admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:54:47.076380 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:54:47.114853 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-3a8d1e47-6ee8-40ef-8474-1b9e5e05dd26 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3f886369cf704215a66f65cb4a1af31b'} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:54:47.115536 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-3a8d1e47-6ee8-40ef-8474-1b9e5e05dd26 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3f886369cf704215a66f65cb4a1af31b'} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:54:47.122721 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-3a8d1e47-6ee8-40ef-8474-1b9e5e05dd26 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3f886369cf704215a66f65cb4a1af31b'} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:54:47.123437 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-3a8d1e47-6ee8-40ef-8474-1b9e5e05dd26 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3f886369cf704215a66f65cb4a1af31b'} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:54:47.136516 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-3a8d1e47-6ee8-40ef-8474-1b9e5e05dd26 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3f886369cf704215a66f65cb4a1af31b'} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:54:47.152291 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 1100/2217] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 30 00:54:46 2022] DELETE /identity/v3/users/3f886369cf704215a66f65cb4a1af31b => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 00:54:47.436692 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481d0bc7-22b2-4219-a396-09e8756b841d admin admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:54:47.438361 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-481d0bc7-22b2-4219-a396-09e8756b841d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:54:47.458284 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481d0bc7-22b2-4219-a396-09e8756b841d admin admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:54:47.518332 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b6dcbd-e044-49b1-92ef-a25a12629b14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:54:47.518977 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b6dcbd-e044-49b1-92ef-a25a12629b14 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:54:47.519284 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b6dcbd-e044-49b1-92ef-a25a12629b14 admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:54:47.519559 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b6dcbd-e044-49b1-92ef-a25a12629b14 admin admin] PATH_INFO: `/v3/projects/2d06485ef3b8423ab126f552208a6975` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:54:47.521297 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b6dcbd-e044-49b1-92ef-a25a12629b14 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2d06485ef3b8423ab126f552208a6975)` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:54:47.523439 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b6dcbd-e044-49b1-92ef-a25a12629b14 admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:54:47.570849 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-30b6dcbd-e044-49b1-92ef-a25a12629b14 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2d06485ef3b8423ab126f552208a6975', 'request_id': 'req-30b6dcbd-e044-49b1-92ef-a25a12629b14'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:54:47.579737 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-30b6dcbd-e044-49b1-92ef-a25a12629b14 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2d06485ef3b8423ab126f552208a6975', 'request_id': 'req-30b6dcbd-e044-49b1-92ef-a25a12629b14'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:54:47.586720 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-30b6dcbd-e044-49b1-92ef-a25a12629b14 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2d06485ef3b8423ab126f552208a6975', 'request_id': 'req-30b6dcbd-e044-49b1-92ef-a25a12629b14'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:54:47.597412 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-30b6dcbd-e044-49b1-92ef-a25a12629b14 admin admin] The token cache is being invalidate because project 2d06485ef3b8423ab126f552208a6975 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87956) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 00:54:47.597696 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-30b6dcbd-e044-49b1-92ef-a25a12629b14 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:54:47.598329 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-30b6dcbd-e044-49b1-92ef-a25a12629b14 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:54:47.600215 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 1118/2218] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 30 00:54:47 2022] DELETE /identity/v3/projects/2d06485ef3b8423ab126f552208a6975 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 00:54:47.606363 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93246a8c-20d8-400f-b6c4-7ca5eb2713e0 None None] REQUEST_METHOD: `POST` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:54:47.606703 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93246a8c-20d8-400f-b6c4-7ca5eb2713e0 None None] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:54:47.606977 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93246a8c-20d8-400f-b6c4-7ca5eb2713e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:54:47.627278 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.auth.core [None req-93246a8c-20d8-400f-b6c4-7ca5eb2713e0 None None] MFA Rules not processed for user `eb55b6cbca4945abb21b0e49eb745e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=87955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:54:47.628530 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-93246a8c-20d8-400f-b6c4-7ca5eb2713e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:54:47.687132 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 1101/2219] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 30 00:54:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:54:47.695945 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd1ed12-b1df-400d-8a38-d07f777459bd None None] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:54:47.696226 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd1ed12-b1df-400d-8a38-d07f777459bd None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:54:47.696494 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd1ed12-b1df-400d-8a38-d07f777459bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:54:47.716912 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.auth.core [None req-edd1ed12-b1df-400d-8a38-d07f777459bd None None] MFA Rules not processed for user `eb55b6cbca4945abb21b0e49eb745e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=87956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:54:47.718140 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-edd1ed12-b1df-400d-8a38-d07f777459bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:54:47.728252 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 1119/2220] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 30 00:54:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:54:47.732731 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93246a8c-20d8-400f-b6c4-7ca5eb2713e0 None None] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:54:47.742817 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93246a8c-20d8-400f-b6c4-7ca5eb2713e0 None None] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:54:47.748199 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef062cf-16c1-4e83-adf4-c4b8b4fd1428 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:54:47.748894 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef062cf-16c1-4e83-adf4-c4b8b4fd1428 admin admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:54:47.749255 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef062cf-16c1-4e83-adf4-c4b8b4fd1428 admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:54:47.749593 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef062cf-16c1-4e83-adf4-c4b8b4fd1428 admin admin] PATH_INFO: `/v3/domains` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:54:47.750316 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef062cf-16c1-4e83-adf4-c4b8b4fd1428 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:54:47.750684 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef062cf-16c1-4e83-adf4-c4b8b4fd1428 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:54:47.752471 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef062cf-16c1-4e83-adf4-c4b8b4fd1428 admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:54:47.764815 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 1102/2221] 10.222.0.42 () {58 vars in 1153 bytes} [Sun Oct 30 00:54:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 30 00:54:47.769372 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd1ed12-b1df-400d-8a38-d07f777459bd None None] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:54:47.773960 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:54:47.780872 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd1ed12-b1df-400d-8a38-d07f777459bd None None] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:54:47.786833 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b21af1-30e4-46a9-8c32-80c285256823 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:54:47.788232 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b21af1-30e4-46a9-8c32-80c285256823 admin admin] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:54:47.788232 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b21af1-30e4-46a9-8c32-80c285256823 admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:54:47.788232 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b21af1-30e4-46a9-8c32-80c285256823 admin admin] PATH_INFO: `/v3/projects` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:54:47.788687 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b21af1-30e4-46a9-8c32-80c285256823 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:54:47.791509 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b21af1-30e4-46a9-8c32-80c285256823 admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:54:47.827889 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 1120/2222] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 30 00:54:47 2022] POST /identity/v3/projects => generated 401 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 00:54:47.832564 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef062cf-16c1-4e83-adf4-c4b8b4fd1428 admin admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:54:47.842689 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef062cf-16c1-4e83-adf4-c4b8b4fd1428 admin admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:54:47.905571 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e38d505-46b1-477f-9eec-df41588f1cbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:54:47.906185 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e38d505-46b1-477f-9eec-df41588f1cbd admin admin] REQUEST_METHOD: `POST` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:54:47.906464 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e38d505-46b1-477f-9eec-df41588f1cbd admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:54:47.906734 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e38d505-46b1-477f-9eec-df41588f1cbd admin admin] PATH_INFO: `/v3/users` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:54:47.907413 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e38d505-46b1-477f-9eec-df41588f1cbd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:54:47.909332 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e38d505-46b1-477f-9eec-df41588f1cbd admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:54:47.934351 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 1103/2223] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 30 00:54:47 2022] POST /identity/v3/users => generated 301 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 30 00:54:47.935569 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b21af1-30e4-46a9-8c32-80c285256823 admin admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:54:47.946223 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b21af1-30e4-46a9-8c32-80c285256823 admin admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:54:47.951498 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab8d0b2-d6c2-4c27-a748-4fc53c59cd1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:54:47.952091 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab8d0b2-d6c2-4c27-a748-4fc53c59cd1e admin admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:54:47.952364 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab8d0b2-d6c2-4c27-a748-4fc53c59cd1e admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:54:47.952630 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab8d0b2-d6c2-4c27-a748-4fc53c59cd1e admin admin] PATH_INFO: `/v3/roles` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:54:47.953277 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab8d0b2-d6c2-4c27-a748-4fc53c59cd1e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:54:47.954875 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab8d0b2-d6c2-4c27-a748-4fc53c59cd1e admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:54:47.965780 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 1121/2224] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 30 00:54:47 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 00:54:47.969974 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e38d505-46b1-477f-9eec-df41588f1cbd admin admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:54:47.980711 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:DELETE=10,keystone:SELECT=86,keystone:INSERT=4 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:54:47.985246 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e38d505-46b1-477f-9eec-df41588f1cbd admin admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:54:47.991991 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb840c94-30ae-4ba2-aeb3-ce20a6a7a5d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:54:47.992770 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb840c94-30ae-4ba2-aeb3-ce20a6a7a5d1 admin admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:54:47.993161 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb840c94-30ae-4ba2-aeb3-ce20a6a7a5d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:54:47.993443 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb840c94-30ae-4ba2-aeb3-ce20a6a7a5d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:54:47.994361 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb840c94-30ae-4ba2-aeb3-ce20a6a7a5d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:54:47.996343 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb840c94-30ae-4ba2-aeb3-ce20a6a7a5d1 admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:54:48.007839 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 1104/2225] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 30 00:54:47 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 00:54:48.013346 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab8d0b2-d6c2-4c27-a748-4fc53c59cd1e admin admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:54:48.024065 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab8d0b2-d6c2-4c27-a748-4fc53c59cd1e admin admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:54:48.028619 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4aad92-6a0f-4bbf-a47e-7bb0486f054b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:54:48.029279 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4aad92-6a0f-4bbf-a47e-7bb0486f054b admin admin] REQUEST_METHOD: `PUT` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:54:48.029596 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4aad92-6a0f-4bbf-a47e-7bb0486f054b admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:54:48.029812 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4aad92-6a0f-4bbf-a47e-7bb0486f054b admin admin] PATH_INFO: `/v3/projects/d15497e3905a43a1bcb0f3c1c3a97454/users/5cb618a47c0e49d0b4449f2191522d48/roles/1c93019874174c4b91118d9ce2347e47` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:54:48.045339 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4aad92-6a0f-4bbf-a47e-7bb0486f054b admin admin] RBAC: Authorizing `identity:create_grant(project_id=d15497e3905a43a1bcb0f3c1c3a97454, user_id=5cb618a47c0e49d0b4449f2191522d48, role_id=1c93019874174c4b91118d9ce2347e47)` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:54:48.048063 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4aad92-6a0f-4bbf-a47e-7bb0486f054b admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:54:48.075180 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 1122/2226] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 30 00:54:48 2022] PUT /identity/v3/projects/d15497e3905a43a1bcb0f3c1c3a97454/users/5cb618a47c0e49d0b4449f2191522d48/roles/1c93019874174c4b91118d9ce2347e47 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 00:54:48.077046 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ad9ebb-6884-41fa-ac76-cb04d3d074f6 None None] REQUEST_METHOD: `POST` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:54:48.077386 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ad9ebb-6884-41fa-ac76-cb04d3d074f6 None None] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:54:48.077730 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ad9ebb-6884-41fa-ac76-cb04d3d074f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:54:48.111155 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.auth.core [None req-10ad9ebb-6884-41fa-ac76-cb04d3d074f6 None None] MFA Rules not processed for user `5cb618a47c0e49d0b4449f2191522d48`. Rule list: `[]` (Enabled: `True`). {{(pid=87955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:54:48.112505 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-10ad9ebb-6884-41fa-ac76-cb04d3d074f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:54:48.192689 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 1105/2227] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 30 00:54:48 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:54:48.193652 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4aad92-6a0f-4bbf-a47e-7bb0486f054b admin admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:54:48.297171 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4aad92-6a0f-4bbf-a47e-7bb0486f054b admin admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:54:48.303240 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb1a9c2-30da-4d00-be57-09469e212c8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:54:48.303956 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb1a9c2-30da-4d00-be57-09469e212c8f admin admin] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:54:48.304296 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb1a9c2-30da-4d00-be57-09469e212c8f admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:54:48.304643 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb1a9c2-30da-4d00-be57-09469e212c8f admin admin] PATH_INFO: `/v3/projects` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:54:48.305407 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb1a9c2-30da-4d00-be57-09469e212c8f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:54:48.308088 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb1a9c2-30da-4d00-be57-09469e212c8f admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:54:48.343259 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 1123/2228] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 30 00:54:48 2022] POST /identity/v3/projects => generated 399 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 30 00:54:48.346784 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ad9ebb-6884-41fa-ac76-cb04d3d074f6 None None] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:54:48.361662 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ad9ebb-6884-41fa-ac76-cb04d3d074f6 None None] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:54:48.428564 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8e1f66-0bca-4a01-982b-31d6836d978e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:54:48.429277 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8e1f66-0bca-4a01-982b-31d6836d978e admin admin] REQUEST_METHOD: `POST` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:54:48.429506 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8e1f66-0bca-4a01-982b-31d6836d978e admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:54:48.429779 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8e1f66-0bca-4a01-982b-31d6836d978e admin admin] PATH_INFO: `/v3/users` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:54:48.430419 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8e1f66-0bca-4a01-982b-31d6836d978e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:54:48.432376 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8e1f66-0bca-4a01-982b-31d6836d978e admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:54:48.459846 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 1106/2229] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 30 00:54:48 2022] POST /identity/v3/users => generated 306 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 30 00:54:48.461107 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb1a9c2-30da-4d00-be57-09469e212c8f admin admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:54:48.473345 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb1a9c2-30da-4d00-be57-09469e212c8f admin admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:54:48.479389 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4edf4c-db7b-496b-8f53-2bd10a32976f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:54:48.480004 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4edf4c-db7b-496b-8f53-2bd10a32976f admin admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:54:48.480281 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4edf4c-db7b-496b-8f53-2bd10a32976f admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:54:48.480549 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4edf4c-db7b-496b-8f53-2bd10a32976f admin admin] PATH_INFO: `/v3/roles` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:54:48.481204 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4edf4c-db7b-496b-8f53-2bd10a32976f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:54:48.483047 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4edf4c-db7b-496b-8f53-2bd10a32976f admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:54:48.495837 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 1124/2230] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 30 00:54:48 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 00:54:48.500249 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8e1f66-0bca-4a01-982b-31d6836d978e admin admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:54:48.510465 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8e1f66-0bca-4a01-982b-31d6836d978e admin admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:54:48.515219 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318c552a-efad-43f8-9eeb-aa21b860d26f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:54:48.515974 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318c552a-efad-43f8-9eeb-aa21b860d26f admin admin] REQUEST_METHOD: `PUT` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:54:48.516344 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318c552a-efad-43f8-9eeb-aa21b860d26f admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:54:48.516671 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318c552a-efad-43f8-9eeb-aa21b860d26f admin admin] PATH_INFO: `/v3/projects/d4efd92debd942d7b7142087e413f1fa/users/b856aa9e723b475c9730278abd74813c/roles/6ccaa8c11f29456fb4e4eeccb21616c7` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:54:48.531775 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318c552a-efad-43f8-9eeb-aa21b860d26f admin admin] RBAC: Authorizing `identity:create_grant(project_id=d4efd92debd942d7b7142087e413f1fa, user_id=b856aa9e723b475c9730278abd74813c, role_id=6ccaa8c11f29456fb4e4eeccb21616c7)` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:54:48.534459 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318c552a-efad-43f8-9eeb-aa21b860d26f admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:54:48.548042 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 1107/2231] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 30 00:54:48 2022] PUT /identity/v3/projects/d4efd92debd942d7b7142087e413f1fa/users/b856aa9e723b475c9730278abd74813c/roles/6ccaa8c11f29456fb4e4eeccb21616c7 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 00:54:48.552353 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4edf4c-db7b-496b-8f53-2bd10a32976f admin admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:54:48.562778 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4edf4c-db7b-496b-8f53-2bd10a32976f admin admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:54:48.620368 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2e3e7a-9b39-431c-bfd2-acdcd476deff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:54:48.620952 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2e3e7a-9b39-431c-bfd2-acdcd476deff admin admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:54:48.621243 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2e3e7a-9b39-431c-bfd2-acdcd476deff admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:54:48.621517 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2e3e7a-9b39-431c-bfd2-acdcd476deff admin admin] PATH_INFO: `/v3/roles` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:54:48.622213 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2e3e7a-9b39-431c-bfd2-acdcd476deff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:54:48.623898 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2e3e7a-9b39-431c-bfd2-acdcd476deff admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:54:48.635365 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 1125/2232] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 30 00:54:48 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 00:54:48.639966 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318c552a-efad-43f8-9eeb-aa21b860d26f admin admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:54:48.650841 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318c552a-efad-43f8-9eeb-aa21b860d26f admin admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:54:48.655581 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5e6e94-a0c2-407b-92ff-c4ee21bea577 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:54:48.656267 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5e6e94-a0c2-407b-92ff-c4ee21bea577 admin admin] REQUEST_METHOD: `PUT` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:54:48.656544 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5e6e94-a0c2-407b-92ff-c4ee21bea577 admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:54:48.656815 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5e6e94-a0c2-407b-92ff-c4ee21bea577 admin admin] PATH_INFO: `/v3/projects/d4efd92debd942d7b7142087e413f1fa/users/b856aa9e723b475c9730278abd74813c/roles/6ccaa8c11f29456fb4e4eeccb21616c7` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:54:48.658709 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5e6e94-a0c2-407b-92ff-c4ee21bea577 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d4efd92debd942d7b7142087e413f1fa, user_id=b856aa9e723b475c9730278abd74813c, role_id=6ccaa8c11f29456fb4e4eeccb21616c7)` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:54:48.661422 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5e6e94-a0c2-407b-92ff-c4ee21bea577 admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:54:48.672893 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 1108/2233] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 30 00:54:48 2022] PUT /identity/v3/projects/d4efd92debd942d7b7142087e413f1fa/users/b856aa9e723b475c9730278abd74813c/roles/6ccaa8c11f29456fb4e4eeccb21616c7 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 00:54:48.685026 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce4a396-28c2-437b-9137-2abe339d2236 None None] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:54:48.685309 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce4a396-28c2-437b-9137-2abe339d2236 None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:54:48.685583 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce4a396-28c2-437b-9137-2abe339d2236 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:54:48.716303 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.auth.core [None req-5ce4a396-28c2-437b-9137-2abe339d2236 None None] MFA Rules not processed for user `b856aa9e723b475c9730278abd74813c`. Rule list: `[]` (Enabled: `True`). {{(pid=87956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:54:48.717538 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-5ce4a396-28c2-437b-9137-2abe339d2236 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:54:48.721730 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:54:48.793265 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 1126/2234] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 30 00:54:48 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 30 00:54:48.804769 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5e6e94-a0c2-407b-92ff-c4ee21bea577 admin admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:54:48.807937 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-7c5e6e94-a0c2-407b-92ff-c4ee21bea577 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:54:48.850928 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:54:48.873307 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5e6e94-a0c2-407b-92ff-c4ee21bea577 admin admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:54:48.879098 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c43ce8e-2691-443a-b746-6fe865669087 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48d928ff7fe24348ac900f09c56acc20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d2387fdf794d4eaef07bbcd7b39f2a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:54:48.879098 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c43ce8e-2691-443a-b746-6fe865669087 service cinder] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:54:48.879098 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c43ce8e-2691-443a-b746-6fe865669087 service cinder] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:54:48.879713 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c43ce8e-2691-443a-b746-6fe865669087 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:54:48.889267 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c43ce8e-2691-443a-b746-6fe865669087 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:54:48.890717 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c43ce8e-2691-443a-b746-6fe865669087 service cinder] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:54:48.900900 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 1109/2235] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 30 00:54:48 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 30 00:54:48.989575 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce4a396-28c2-437b-9137-2abe339d2236 None None] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:54:48.999827 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce4a396-28c2-437b-9137-2abe339d2236 None None] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:54:49.003358 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6e1d39-873a-4330-824c-7cddf0072a64 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48d928ff7fe24348ac900f09c56acc20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d2387fdf794d4eaef07bbcd7b39f2a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:54:49.003988 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6e1d39-873a-4330-824c-7cddf0072a64 service cinder] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:54:49.004264 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6e1d39-873a-4330-824c-7cddf0072a64 service cinder] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:54:49.004532 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6e1d39-873a-4330-824c-7cddf0072a64 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:54:49.064009 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6e1d39-873a-4330-824c-7cddf0072a64 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:54:49.065458 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6e1d39-873a-4330-824c-7cddf0072a64 service cinder] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:54:49.076098 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 1127/2236] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 30 00:54:48 2022] GET /identity/v3/auth/tokens => generated 3278 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 00:54:52.354535 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c43ce8e-2691-443a-b746-6fe865669087 service cinder] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:54:52.356509 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-8c43ce8e-2691-443a-b746-6fe865669087 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:54:52.417961 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c43ce8e-2691-443a-b746-6fe865669087 service cinder] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:54:52.422021 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2094aa91-c050-4a4f-9276-a8990ad387a9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5693f186c6ad4d9394f02ee3477cdcd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d2387fdf794d4eaef07bbcd7b39f2a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:54:52.422834 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2094aa91-c050-4a4f-9276-a8990ad387a9 service neutron] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:54:52.423108 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2094aa91-c050-4a4f-9276-a8990ad387a9 service neutron] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:54:52.423425 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2094aa91-c050-4a4f-9276-a8990ad387a9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:54:52.425458 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-2094aa91-c050-4a4f-9276-a8990ad387a9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:54:52.488893 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2094aa91-c050-4a4f-9276-a8990ad387a9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:54:52.490331 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2094aa91-c050-4a4f-9276-a8990ad387a9 service neutron] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:54:52.500064 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 1110/2237] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 30 00:54:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 00:54:53.242318 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6e1d39-873a-4330-824c-7cddf0072a64 service cinder] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:54:53.253446 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6e1d39-873a-4330-824c-7cddf0072a64 service cinder] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:54:53.258180 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4779c38-c321-4053-8cb3-1f2c887c0b76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:54:53.258812 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4779c38-c321-4053-8cb3-1f2c887c0b76 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:54:53.259290 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4779c38-c321-4053-8cb3-1f2c887c0b76 admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:54:53.259630 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4779c38-c321-4053-8cb3-1f2c887c0b76 admin admin] PATH_INFO: `/v3/users/5cb618a47c0e49d0b4449f2191522d48` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:54:53.260991 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4779c38-c321-4053-8cb3-1f2c887c0b76 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5cb618a47c0e49d0b4449f2191522d48)` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:54:53.262974 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4779c38-c321-4053-8cb3-1f2c887c0b76 admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:54:53.312882 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-e4779c38-c321-4053-8cb3-1f2c887c0b76 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5cb618a47c0e49d0b4449f2191522d48'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:54:53.313633 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-e4779c38-c321-4053-8cb3-1f2c887c0b76 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5cb618a47c0e49d0b4449f2191522d48'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:54:53.326199 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-e4779c38-c321-4053-8cb3-1f2c887c0b76 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5cb618a47c0e49d0b4449f2191522d48'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:54:53.333569 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-e4779c38-c321-4053-8cb3-1f2c887c0b76 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5cb618a47c0e49d0b4449f2191522d48'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:54:53.340846 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-e4779c38-c321-4053-8cb3-1f2c887c0b76 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5cb618a47c0e49d0b4449f2191522d48'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:54:53.347725 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 1128/2238] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 30 00:54:53 2022] DELETE /identity/v3/users/5cb618a47c0e49d0b4449f2191522d48 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 00:54:53.352894 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9153ef65-0716-4418-b537-daf0e1a4237a None None] REQUEST_METHOD: `POST` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:54:53.353282 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9153ef65-0716-4418-b537-daf0e1a4237a None None] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:54:53.353731 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9153ef65-0716-4418-b537-daf0e1a4237a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:54:53.374406 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.auth.core [None req-9153ef65-0716-4418-b537-daf0e1a4237a None None] MFA Rules not processed for user `eb55b6cbca4945abb21b0e49eb745e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=87955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:54:53.375714 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-9153ef65-0716-4418-b537-daf0e1a4237a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:54:53.438336 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 1111/2239] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 30 00:54:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 30 00:54:53.449092 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4779c38-c321-4053-8cb3-1f2c887c0b76 admin admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:54:53.452017 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-e4779c38-c321-4053-8cb3-1f2c887c0b76 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:54:53.469242 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:54:53.523236 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4779c38-c321-4053-8cb3-1f2c887c0b76 admin admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:54:53.527722 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9649d46-2c6a-4372-873e-a136f4844f69 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5693f186c6ad4d9394f02ee3477cdcd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d2387fdf794d4eaef07bbcd7b39f2a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:54:53.528640 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9649d46-2c6a-4372-873e-a136f4844f69 service neutron] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:54:53.529084 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9649d46-2c6a-4372-873e-a136f4844f69 service neutron] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:54:53.529350 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9649d46-2c6a-4372-873e-a136f4844f69 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:54:53.540375 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9649d46-2c6a-4372-873e-a136f4844f69 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:54:53.541860 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9649d46-2c6a-4372-873e-a136f4844f69 service neutron] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:54:53.559630 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 1129/2240] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 30 00:54:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 00:54:53.850797 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9153ef65-0716-4418-b537-daf0e1a4237a None None] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:54:53.856371 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-9153ef65-0716-4418-b537-daf0e1a4237a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:54:53.886438 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9153ef65-0716-4418-b537-daf0e1a4237a None None] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:54:53.891053 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2467babe-c455-4fa0-8e3c-ceda4dd92b8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:54:53.892522 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2467babe-c455-4fa0-8e3c-ceda4dd92b8f admin admin] REQUEST_METHOD: `DELETE` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:54:53.892863 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2467babe-c455-4fa0-8e3c-ceda4dd92b8f admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:54:53.893208 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2467babe-c455-4fa0-8e3c-ceda4dd92b8f admin admin] PATH_INFO: `/v3/projects/d15497e3905a43a1bcb0f3c1c3a97454` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:54:53.894451 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2467babe-c455-4fa0-8e3c-ceda4dd92b8f admin admin] RBAC: Authorizing `identity:delete_project(project_id=d15497e3905a43a1bcb0f3c1c3a97454)` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:54:53.896538 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2467babe-c455-4fa0-8e3c-ceda4dd92b8f admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:54:53.927550 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:54:53.957087 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-2467babe-c455-4fa0-8e3c-ceda4dd92b8f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd15497e3905a43a1bcb0f3c1c3a97454', 'request_id': 'req-2467babe-c455-4fa0-8e3c-ceda4dd92b8f'} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:54:53.969263 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-2467babe-c455-4fa0-8e3c-ceda4dd92b8f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd15497e3905a43a1bcb0f3c1c3a97454', 'request_id': 'req-2467babe-c455-4fa0-8e3c-ceda4dd92b8f'} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:54:53.982801 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-2467babe-c455-4fa0-8e3c-ceda4dd92b8f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd15497e3905a43a1bcb0f3c1c3a97454', 'request_id': 'req-2467babe-c455-4fa0-8e3c-ceda4dd92b8f'} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:54:53.996017 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-2467babe-c455-4fa0-8e3c-ceda4dd92b8f admin admin] The token cache is being invalidate because project d15497e3905a43a1bcb0f3c1c3a97454 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87955) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 00:54:53.996442 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-2467babe-c455-4fa0-8e3c-ceda4dd92b8f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:54:53.997240 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-2467babe-c455-4fa0-8e3c-ceda4dd92b8f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:54:54.003152 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9649d46-2c6a-4372-873e-a136f4844f69 service neutron] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:54:54.006727 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 1112/2241] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 30 00:54:53 2022] DELETE /identity/v3/projects/d15497e3905a43a1bcb0f3c1c3a97454 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 00:54:54.021827 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9649d46-2c6a-4372-873e-a136f4844f69 service neutron] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:54:54.099674 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df679ecd-03b0-4de6-b52f-0a2f723cf6d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:54:54.101838 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df679ecd-03b0-4de6-b52f-0a2f723cf6d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:54:54.102121 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df679ecd-03b0-4de6-b52f-0a2f723cf6d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:54:54.102397 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df679ecd-03b0-4de6-b52f-0a2f723cf6d0 admin admin] PATH_INFO: `/v3/users/b856aa9e723b475c9730278abd74813c` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:54:54.103707 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df679ecd-03b0-4de6-b52f-0a2f723cf6d0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b856aa9e723b475c9730278abd74813c)` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:54:54.105712 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df679ecd-03b0-4de6-b52f-0a2f723cf6d0 admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:54:54.169200 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-df679ecd-03b0-4de6-b52f-0a2f723cf6d0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b856aa9e723b475c9730278abd74813c'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:54:54.169996 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-df679ecd-03b0-4de6-b52f-0a2f723cf6d0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b856aa9e723b475c9730278abd74813c'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:54:54.186676 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-df679ecd-03b0-4de6-b52f-0a2f723cf6d0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b856aa9e723b475c9730278abd74813c'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:54:54.199469 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-df679ecd-03b0-4de6-b52f-0a2f723cf6d0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b856aa9e723b475c9730278abd74813c'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:54:54.210614 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-df679ecd-03b0-4de6-b52f-0a2f723cf6d0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b856aa9e723b475c9730278abd74813c'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:54:54.226581 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 1130/2242] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 30 00:54:54 2022] DELETE /identity/v3/users/b856aa9e723b475c9730278abd74813c => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 00:54:54.711124 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2467babe-c455-4fa0-8e3c-ceda4dd92b8f admin admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:54:54.712681 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-2467babe-c455-4fa0-8e3c-ceda4dd92b8f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:54:54.725599 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2467babe-c455-4fa0-8e3c-ceda4dd92b8f admin admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:54:54.785613 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87ba23e-04d5-49df-bc0a-ab2b950d0218 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:54:54.786269 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87ba23e-04d5-49df-bc0a-ab2b950d0218 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:54:54.786540 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87ba23e-04d5-49df-bc0a-ab2b950d0218 admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:54:54.786808 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87ba23e-04d5-49df-bc0a-ab2b950d0218 admin admin] PATH_INFO: `/v3/projects/d4efd92debd942d7b7142087e413f1fa` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:54:54.787953 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87ba23e-04d5-49df-bc0a-ab2b950d0218 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d4efd92debd942d7b7142087e413f1fa)` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:54:54.789878 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87ba23e-04d5-49df-bc0a-ab2b950d0218 admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:54:54.852449 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-a87ba23e-04d5-49df-bc0a-ab2b950d0218 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd4efd92debd942d7b7142087e413f1fa', 'request_id': 'req-a87ba23e-04d5-49df-bc0a-ab2b950d0218'} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:54:54.859593 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-a87ba23e-04d5-49df-bc0a-ab2b950d0218 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd4efd92debd942d7b7142087e413f1fa', 'request_id': 'req-a87ba23e-04d5-49df-bc0a-ab2b950d0218'} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:54:54.868817 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-a87ba23e-04d5-49df-bc0a-ab2b950d0218 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd4efd92debd942d7b7142087e413f1fa', 'request_id': 'req-a87ba23e-04d5-49df-bc0a-ab2b950d0218'} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:54:54.884846 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-a87ba23e-04d5-49df-bc0a-ab2b950d0218 admin admin] The token cache is being invalidate because project d4efd92debd942d7b7142087e413f1fa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87955) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 00:54:54.885241 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-a87ba23e-04d5-49df-bc0a-ab2b950d0218 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:54:54.886052 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-a87ba23e-04d5-49df-bc0a-ab2b950d0218 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:54:54.892716 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 1113/2243] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 30 00:54:54 2022] DELETE /identity/v3/projects/d4efd92debd942d7b7142087e413f1fa => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 00:54:54.900038 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713a6eeb-7c7d-43e0-b9a0-f307c7584c5f None None] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:54:54.900548 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713a6eeb-7c7d-43e0-b9a0-f307c7584c5f None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:54:54.900664 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713a6eeb-7c7d-43e0-b9a0-f307c7584c5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:54:54.929449 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.auth.core [None req-713a6eeb-7c7d-43e0-b9a0-f307c7584c5f None None] MFA Rules not processed for user `eb55b6cbca4945abb21b0e49eb745e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=87956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:54:54.930757 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-713a6eeb-7c7d-43e0-b9a0-f307c7584c5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:54:54.962115 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:54:54.995473 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 1131/2244] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 30 00:54:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:54:55.003382 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8760542a-a11e-4fd7-b250-94f9f6006760 None None] REQUEST_METHOD: `POST` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:54:55.003783 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8760542a-a11e-4fd7-b250-94f9f6006760 None None] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:54:55.004063 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8760542a-a11e-4fd7-b250-94f9f6006760 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:54:55.024811 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.auth.core [None req-8760542a-a11e-4fd7-b250-94f9f6006760 None None] MFA Rules not processed for user `eb55b6cbca4945abb21b0e49eb745e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=87955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:54:55.026107 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-8760542a-a11e-4fd7-b250-94f9f6006760 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:54:55.034722 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 1114/2245] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 30 00:54:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:54:55.039176 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713a6eeb-7c7d-43e0-b9a0-f307c7584c5f None None] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:54:55.051462 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713a6eeb-7c7d-43e0-b9a0-f307c7584c5f None None] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:54:55.057249 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3b84db-8252-451b-8c35-5df838b1ac56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:54:55.057878 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3b84db-8252-451b-8c35-5df838b1ac56 admin admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:54:55.058149 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3b84db-8252-451b-8c35-5df838b1ac56 admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:54:55.058416 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3b84db-8252-451b-8c35-5df838b1ac56 admin admin] PATH_INFO: `/v3/domains` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:54:55.059868 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3b84db-8252-451b-8c35-5df838b1ac56 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87956) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:54:55.059868 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3b84db-8252-451b-8c35-5df838b1ac56 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:54:55.061090 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3b84db-8252-451b-8c35-5df838b1ac56 admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:54:55.075821 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 1132/2246] 10.222.0.42 () {58 vars in 1153 bytes} [Sun Oct 30 00:54:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:54:55.080327 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8760542a-a11e-4fd7-b250-94f9f6006760 None None] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:54:55.090029 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8760542a-a11e-4fd7-b250-94f9f6006760 None None] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:54:55.095749 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0844b2f-023e-4832-87ee-2732683a2943 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:54:55.096356 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0844b2f-023e-4832-87ee-2732683a2943 admin admin] REQUEST_METHOD: `POST` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:54:55.096629 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0844b2f-023e-4832-87ee-2732683a2943 admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:54:55.096906 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0844b2f-023e-4832-87ee-2732683a2943 admin admin] PATH_INFO: `/v3/projects` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:54:55.097560 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0844b2f-023e-4832-87ee-2732683a2943 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:54:55.099508 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0844b2f-023e-4832-87ee-2732683a2943 admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:54:55.127613 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 1115/2247] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 30 00:54:55 2022] POST /identity/v3/projects => generated 381 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 00:54:55.131772 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3b84db-8252-451b-8c35-5df838b1ac56 admin admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:54:55.143157 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3b84db-8252-451b-8c35-5df838b1ac56 admin admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:54:55.206289 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdfd4fd-ab9e-4c6c-b082-df9c7a809183 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:54:55.206917 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdfd4fd-ab9e-4c6c-b082-df9c7a809183 admin admin] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:54:55.207194 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdfd4fd-ab9e-4c6c-b082-df9c7a809183 admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:54:55.209618 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdfd4fd-ab9e-4c6c-b082-df9c7a809183 admin admin] PATH_INFO: `/v3/users` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:54:55.210290 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecdfd4fd-ab9e-4c6c-b082-df9c7a809183 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:54:55.212911 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecdfd4fd-ab9e-4c6c-b082-df9c7a809183 admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:54:55.246693 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 1133/2248] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 30 00:54:55 2022] POST /identity/v3/users => generated 291 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 00:54:55.250511 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0844b2f-023e-4832-87ee-2732683a2943 admin admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:54:55.261597 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0844b2f-023e-4832-87ee-2732683a2943 admin admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:54:55.270345 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502965fc-ae4a-4a5b-9c66-48c8f26c20c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:54:55.272106 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502965fc-ae4a-4a5b-9c66-48c8f26c20c3 admin admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:54:55.272396 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502965fc-ae4a-4a5b-9c66-48c8f26c20c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:54:55.272748 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502965fc-ae4a-4a5b-9c66-48c8f26c20c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:54:55.273434 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502965fc-ae4a-4a5b-9c66-48c8f26c20c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:54:55.275165 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502965fc-ae4a-4a5b-9c66-48c8f26c20c3 admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:54:55.290338 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 1116/2249] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 30 00:54:55 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 00:54:55.294516 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdfd4fd-ab9e-4c6c-b082-df9c7a809183 admin admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:54:55.307547 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdfd4fd-ab9e-4c6c-b082-df9c7a809183 admin admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:54:55.312712 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b8e918-9ad2-4a48-99d4-4015e9b5b05f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:54:55.313336 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b8e918-9ad2-4a48-99d4-4015e9b5b05f admin admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:54:55.313616 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b8e918-9ad2-4a48-99d4-4015e9b5b05f admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:54:55.313890 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b8e918-9ad2-4a48-99d4-4015e9b5b05f admin admin] PATH_INFO: `/v3/roles` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:54:55.314551 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b8e918-9ad2-4a48-99d4-4015e9b5b05f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:54:55.327271 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b8e918-9ad2-4a48-99d4-4015e9b5b05f admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:54:55.349008 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 1134/2250] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 30 00:54:55 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 00:54:55.351383 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502965fc-ae4a-4a5b-9c66-48c8f26c20c3 admin admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:54:55.363369 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=84,keystone:DELETE=13,keystone:INSERT=3 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:54:55.377172 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502965fc-ae4a-4a5b-9c66-48c8f26c20c3 admin admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:54:55.384011 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e220ad1-1394-4e02-853a-fab986d13009 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:54:55.385082 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e220ad1-1394-4e02-853a-fab986d13009 admin admin] REQUEST_METHOD: `PUT` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:54:55.385640 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e220ad1-1394-4e02-853a-fab986d13009 admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:54:55.386043 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e220ad1-1394-4e02-853a-fab986d13009 admin admin] PATH_INFO: `/v3/projects/e0d77b1bd33e4b80a50a7f811239c815/users/caf04cf2f5d949cd8adb8719f6caa4cc/roles/1c93019874174c4b91118d9ce2347e47` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:54:55.420338 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e220ad1-1394-4e02-853a-fab986d13009 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e0d77b1bd33e4b80a50a7f811239c815, user_id=caf04cf2f5d949cd8adb8719f6caa4cc, role_id=1c93019874174c4b91118d9ce2347e47)` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:54:55.423779 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e220ad1-1394-4e02-853a-fab986d13009 admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:54:55.452433 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 1117/2251] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 30 00:54:55 2022] PUT /identity/v3/projects/e0d77b1bd33e4b80a50a7f811239c815/users/caf04cf2f5d949cd8adb8719f6caa4cc/roles/1c93019874174c4b91118d9ce2347e47 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 00:54:55.454169 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37acc014-5183-481e-bea5-4d2fe8f8fbaf None None] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:54:55.454550 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37acc014-5183-481e-bea5-4d2fe8f8fbaf None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:54:55.454970 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37acc014-5183-481e-bea5-4d2fe8f8fbaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:54:55.489510 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.auth.core [None req-37acc014-5183-481e-bea5-4d2fe8f8fbaf None None] MFA Rules not processed for user `caf04cf2f5d949cd8adb8719f6caa4cc`. Rule list: `[]` (Enabled: `True`). {{(pid=87956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:54:55.491030 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-37acc014-5183-481e-bea5-4d2fe8f8fbaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:54:55.592953 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e220ad1-1394-4e02-853a-fab986d13009 admin admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:54:55.596508 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 1135/2252] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 30 00:54:55 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 30 00:54:55.668923 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e220ad1-1394-4e02-853a-fab986d13009 admin admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:54:55.673734 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47dc8d0b-3563-47ce-8212-f58bfd6ab5ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:54:55.674431 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dc8d0b-3563-47ce-8212-f58bfd6ab5ec admin admin] REQUEST_METHOD: `POST` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:54:55.674771 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dc8d0b-3563-47ce-8212-f58bfd6ab5ec admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:54:55.675234 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dc8d0b-3563-47ce-8212-f58bfd6ab5ec admin admin] PATH_INFO: `/v3/projects` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:54:55.675887 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47dc8d0b-3563-47ce-8212-f58bfd6ab5ec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:54:55.677784 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47dc8d0b-3563-47ce-8212-f58bfd6ab5ec admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:54:55.725377 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 1118/2253] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 30 00:54:55 2022] POST /identity/v3/projects => generated 381 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 00:54:55.726768 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37acc014-5183-481e-bea5-4d2fe8f8fbaf None None] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:54:55.740047 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37acc014-5183-481e-bea5-4d2fe8f8fbaf None None] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:54:55.746183 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47dc8d0b-3563-47ce-8212-f58bfd6ab5ec admin admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:54:55.747975 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-47dc8d0b-3563-47ce-8212-f58bfd6ab5ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:54:55.769572 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:54:55.813618 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a5182a-f8c6-4ac5-8d1a-03e7b46f0112 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:54:55.814400 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a5182a-f8c6-4ac5-8d1a-03e7b46f0112 admin admin] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:54:55.814740 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a5182a-f8c6-4ac5-8d1a-03e7b46f0112 admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:54:55.815143 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a5182a-f8c6-4ac5-8d1a-03e7b46f0112 admin admin] PATH_INFO: `/v3/users` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:54:55.815876 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a5182a-f8c6-4ac5-8d1a-03e7b46f0112 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:54:55.818699 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a5182a-f8c6-4ac5-8d1a-03e7b46f0112 admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:54:55.835579 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47dc8d0b-3563-47ce-8212-f58bfd6ab5ec admin admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:54:55.841604 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b040adec-61f3-4fe4-a584-713b727b74f6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '202b8b2c0f454297bfb97c1ac4033625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d2387fdf794d4eaef07bbcd7b39f2a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:54:55.842283 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b040adec-61f3-4fe4-a584-713b727b74f6 service placement] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:54:55.842557 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b040adec-61f3-4fe4-a584-713b727b74f6 service placement] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:54:55.845757 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 1136/2254] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 30 00:54:55 2022] POST /identity/v3/users => generated 297 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 00:54:55.845980 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b040adec-61f3-4fe4-a584-713b727b74f6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:54:55.846085 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a5182a-f8c6-4ac5-8d1a-03e7b46f0112 admin admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:54:55.846180 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-b040adec-61f3-4fe4-a584-713b727b74f6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:54:55.846265 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-29a5182a-f8c6-4ac5-8d1a-03e7b46f0112 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:54:55.856677 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b040adec-61f3-4fe4-a584-713b727b74f6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:54:55.858066 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a5182a-f8c6-4ac5-8d1a-03e7b46f0112 admin admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:54:55.858279 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b040adec-61f3-4fe4-a584-713b727b74f6 service placement] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:54:55.862676 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b84f45a-dd80-4066-966d-8604f4b4f418 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:54:55.863318 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b84f45a-dd80-4066-966d-8604f4b4f418 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:54:55.863604 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b84f45a-dd80-4066-966d-8604f4b4f418 admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:54:55.863876 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b84f45a-dd80-4066-966d-8604f4b4f418 admin admin] PATH_INFO: `/v3/users/431eca0bd74247b8bcb832ed1c9ae3ac` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:54:55.865001 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b84f45a-dd80-4066-966d-8604f4b4f418 admin admin] RBAC: Authorizing `identity:delete_user(user_id=431eca0bd74247b8bcb832ed1c9ae3ac)` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:54:55.866909 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b84f45a-dd80-4066-966d-8604f4b4f418 admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:54:55.868129 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 1119/2255] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 30 00:54:55 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 00:54:55.868904 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b040adec-61f3-4fe4-a584-713b727b74f6 service placement] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:54:55.888948 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b040adec-61f3-4fe4-a584-713b727b74f6 service placement] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:54:55.896422 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572d64ea-ea42-4b87-8f3b-8f480762cb68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:54:55.897035 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572d64ea-ea42-4b87-8f3b-8f480762cb68 admin admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:54:55.897311 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572d64ea-ea42-4b87-8f3b-8f480762cb68 admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:54:55.897580 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572d64ea-ea42-4b87-8f3b-8f480762cb68 admin admin] PATH_INFO: `/v3/roles` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:54:55.898270 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572d64ea-ea42-4b87-8f3b-8f480762cb68 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:54:55.899903 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572d64ea-ea42-4b87-8f3b-8f480762cb68 admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:54:55.911771 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 1120/2256] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 30 00:54:55 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 00:54:55.916114 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572d64ea-ea42-4b87-8f3b-8f480762cb68 admin admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:54:55.926867 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572d64ea-ea42-4b87-8f3b-8f480762cb68 admin admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:54:55.931461 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcea56fe-5efc-4038-a77b-c69edab6c937 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:54:55.932127 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcea56fe-5efc-4038-a77b-c69edab6c937 admin admin] REQUEST_METHOD: `PUT` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:54:55.932246 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-5b84f45a-dd80-4066-966d-8604f4b4f418 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '431eca0bd74247b8bcb832ed1c9ae3ac'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:54:55.932681 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcea56fe-5efc-4038-a77b-c69edab6c937 admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:54:55.932681 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcea56fe-5efc-4038-a77b-c69edab6c937 admin admin] PATH_INFO: `/v3/projects/b9a0c45aef904f0a84cfc1535ed1864d/users/a7a29f03d800424d928e9239fd090721/roles/6ccaa8c11f29456fb4e4eeccb21616c7` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:54:55.932851 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-5b84f45a-dd80-4066-966d-8604f4b4f418 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '431eca0bd74247b8bcb832ed1c9ae3ac'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:54:55.946184 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-5b84f45a-dd80-4066-966d-8604f4b4f418 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '431eca0bd74247b8bcb832ed1c9ae3ac'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:54:55.950538 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcea56fe-5efc-4038-a77b-c69edab6c937 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b9a0c45aef904f0a84cfc1535ed1864d, user_id=a7a29f03d800424d928e9239fd090721, role_id=6ccaa8c11f29456fb4e4eeccb21616c7)` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:54:55.953264 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcea56fe-5efc-4038-a77b-c69edab6c937 admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:54:55.955921 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-5b84f45a-dd80-4066-966d-8604f4b4f418 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '431eca0bd74247b8bcb832ed1c9ae3ac'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:54:55.963454 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-5b84f45a-dd80-4066-966d-8604f4b4f418 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '431eca0bd74247b8bcb832ed1c9ae3ac'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:54:55.966288 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 1121/2257] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 30 00:54:55 2022] PUT /identity/v3/projects/b9a0c45aef904f0a84cfc1535ed1864d/users/a7a29f03d800424d928e9239fd090721/roles/6ccaa8c11f29456fb4e4eeccb21616c7 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 00:54:55.969810 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 1137/2258] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 30 00:54:55 2022] DELETE /identity/v3/users/431eca0bd74247b8bcb832ed1c9ae3ac => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 00:54:55.969932 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcea56fe-5efc-4038-a77b-c69edab6c937 admin admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:54:55.971751 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-fcea56fe-5efc-4038-a77b-c69edab6c937 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:54:55.998406 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:54:56.043460 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcea56fe-5efc-4038-a77b-c69edab6c937 admin admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:54:56.105039 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2114456-05f8-49dc-aed6-36c784f8d806 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:54:56.105649 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2114456-05f8-49dc-aed6-36c784f8d806 admin admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:54:56.105923 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2114456-05f8-49dc-aed6-36c784f8d806 admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:54:56.106190 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2114456-05f8-49dc-aed6-36c784f8d806 admin admin] PATH_INFO: `/v3/roles` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:54:56.106826 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2114456-05f8-49dc-aed6-36c784f8d806 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:54:56.108455 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2114456-05f8-49dc-aed6-36c784f8d806 admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:54:56.121573 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 1122/2259] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 30 00:54:55 2022] GET /identity/v3/roles => generated 1420 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 30 00:54:56.122905 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b84f45a-dd80-4066-966d-8604f4b4f418 admin admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:54:56.133356 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b84f45a-dd80-4066-966d-8604f4b4f418 admin admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:54:56.139280 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c792c87f-cb31-4575-809a-8ba56792f1bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:54:56.139982 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c792c87f-cb31-4575-809a-8ba56792f1bc admin admin] REQUEST_METHOD: `PUT` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:54:56.140260 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c792c87f-cb31-4575-809a-8ba56792f1bc admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:54:56.140588 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c792c87f-cb31-4575-809a-8ba56792f1bc admin admin] PATH_INFO: `/v3/projects/b9a0c45aef904f0a84cfc1535ed1864d/users/a7a29f03d800424d928e9239fd090721/roles/6ccaa8c11f29456fb4e4eeccb21616c7` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:54:56.142641 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c792c87f-cb31-4575-809a-8ba56792f1bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=b9a0c45aef904f0a84cfc1535ed1864d, user_id=a7a29f03d800424d928e9239fd090721, role_id=6ccaa8c11f29456fb4e4eeccb21616c7)` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:54:56.145558 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c792c87f-cb31-4575-809a-8ba56792f1bc admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:54:56.175231 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 1138/2260] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 30 00:54:56 2022] PUT /identity/v3/projects/b9a0c45aef904f0a84cfc1535ed1864d/users/a7a29f03d800424d928e9239fd090721/roles/6ccaa8c11f29456fb4e4eeccb21616c7 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 00:54:56.176384 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2114456-05f8-49dc-aed6-36c784f8d806 admin admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:54:56.176384 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-e2114456-05f8-49dc-aed6-36c784f8d806 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:54:56.176783 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2114456-05f8-49dc-aed6-36c784f8d806 admin admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:54:56.228631 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494ca115-d6a2-49fe-b32c-e92264dec2e3 None None] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:54:56.228965 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494ca115-d6a2-49fe-b32c-e92264dec2e3 None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:54:56.229248 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494ca115-d6a2-49fe-b32c-e92264dec2e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:54:56.241681 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284fdb81-80f3-4882-bc26-a354cb987edb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:54:56.242311 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284fdb81-80f3-4882-bc26-a354cb987edb admin admin] REQUEST_METHOD: `DELETE` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:54:56.242582 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284fdb81-80f3-4882-bc26-a354cb987edb admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:54:56.242848 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284fdb81-80f3-4882-bc26-a354cb987edb admin admin] PATH_INFO: `/v3/projects/0945be7464c34ca4a6dcc95286ee5a51` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:54:56.244037 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284fdb81-80f3-4882-bc26-a354cb987edb admin admin] RBAC: Authorizing `identity:delete_project(project_id=0945be7464c34ca4a6dcc95286ee5a51)` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:54:56.246028 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284fdb81-80f3-4882-bc26-a354cb987edb admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:54:56.257409 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.auth.core [None req-494ca115-d6a2-49fe-b32c-e92264dec2e3 None None] MFA Rules not processed for user `a7a29f03d800424d928e9239fd090721`. Rule list: `[]` (Enabled: `True`). {{(pid=87956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:54:56.258630 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-494ca115-d6a2-49fe-b32c-e92264dec2e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:54:56.294381 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-284fdb81-80f3-4882-bc26-a354cb987edb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0945be7464c34ca4a6dcc95286ee5a51', 'request_id': 'req-284fdb81-80f3-4882-bc26-a354cb987edb'} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:54:56.300050 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-284fdb81-80f3-4882-bc26-a354cb987edb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0945be7464c34ca4a6dcc95286ee5a51', 'request_id': 'req-284fdb81-80f3-4882-bc26-a354cb987edb'} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:54:56.304613 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:54:56.308831 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-284fdb81-80f3-4882-bc26-a354cb987edb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0945be7464c34ca4a6dcc95286ee5a51', 'request_id': 'req-284fdb81-80f3-4882-bc26-a354cb987edb'} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:54:56.321949 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-284fdb81-80f3-4882-bc26-a354cb987edb admin admin] The token cache is being invalidate because project 0945be7464c34ca4a6dcc95286ee5a51 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87955) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 00:54:56.322580 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-284fdb81-80f3-4882-bc26-a354cb987edb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:54:56.323186 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-284fdb81-80f3-4882-bc26-a354cb987edb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:54:56.324906 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 1123/2261] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 30 00:54:56 2022] DELETE /identity/v3/projects/0945be7464c34ca4a6dcc95286ee5a51 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 00:54:56.329379 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dd24f3-2ca2-48d3-9063-ca894a08a4e3 None None] REQUEST_METHOD: `POST` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:54:56.329654 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dd24f3-2ca2-48d3-9063-ca894a08a4e3 None None] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:54:56.329917 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dd24f3-2ca2-48d3-9063-ca894a08a4e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:54:56.332414 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 1139/2262] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 30 00:54:56 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:54:56.343518 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494ca115-d6a2-49fe-b32c-e92264dec2e3 None None] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:54:56.345065 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-494ca115-d6a2-49fe-b32c-e92264dec2e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:54:56.350171 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=85,keystone:INSERT=5,keystone:DELETE=10 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:54:56.352739 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.auth.core [None req-e4dd24f3-2ca2-48d3-9063-ca894a08a4e3 None None] MFA Rules not processed for user `eb55b6cbca4945abb21b0e49eb745e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=87955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:54:56.354080 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-e4dd24f3-2ca2-48d3-9063-ca894a08a4e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:54:56.407882 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494ca115-d6a2-49fe-b32c-e92264dec2e3 None None] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:54:56.413952 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 1124/2263] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 30 00:54:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 30 00:54:56.422789 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bdbf4b-42b7-42c9-a4a4-5489dbd4c846 None None] REQUEST_METHOD: `POST` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:54:56.423146 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bdbf4b-42b7-42c9-a4a4-5489dbd4c846 None None] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:54:56.423523 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bdbf4b-42b7-42c9-a4a4-5489dbd4c846 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:54:56.443535 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.auth.core [None req-c2bdbf4b-42b7-42c9-a4a4-5489dbd4c846 None None] MFA Rules not processed for user `eb55b6cbca4945abb21b0e49eb745e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=87955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:54:56.444770 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-c2bdbf4b-42b7-42c9-a4a4-5489dbd4c846 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:54:56.452928 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 1125/2264] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 30 00:54:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:54:56.457985 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bdbf4b-42b7-42c9-a4a4-5489dbd4c846 None None] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:54:56.458861 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa481f45-ab30-4849-8433-cbcdcfcda956 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48d928ff7fe24348ac900f09c56acc20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d2387fdf794d4eaef07bbcd7b39f2a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:54:56.459515 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa481f45-ab30-4849-8433-cbcdcfcda956 service cinder] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:54:56.459793 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa481f45-ab30-4849-8433-cbcdcfcda956 service cinder] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:54:56.460058 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa481f45-ab30-4849-8433-cbcdcfcda956 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:54:56.461800 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-aa481f45-ab30-4849-8433-cbcdcfcda956 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:54:56.468477 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bdbf4b-42b7-42c9-a4a4-5489dbd4c846 None None] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:54:56.474240 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c04cf8-581a-4e9c-b40c-4b19dbeb85aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:54:56.475130 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c04cf8-581a-4e9c-b40c-4b19dbeb85aa admin admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:54:56.475478 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c04cf8-581a-4e9c-b40c-4b19dbeb85aa admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:54:56.475828 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c04cf8-581a-4e9c-b40c-4b19dbeb85aa admin admin] PATH_INFO: `/v3/domains` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:54:56.476678 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c04cf8-581a-4e9c-b40c-4b19dbeb85aa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:54:56.476980 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c04cf8-581a-4e9c-b40c-4b19dbeb85aa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:54:56.478802 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c04cf8-581a-4e9c-b40c-4b19dbeb85aa admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:54:56.490552 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 1126/2265] 10.222.0.42 () {58 vars in 1153 bytes} [Sun Oct 30 00:54:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 30 00:54:56.495110 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c04cf8-581a-4e9c-b40c-4b19dbeb85aa admin admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:54:56.505718 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c04cf8-581a-4e9c-b40c-4b19dbeb85aa admin admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:54:56.510799 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03817e15-1baf-42af-9050-528605e407d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:54:56.511417 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03817e15-1baf-42af-9050-528605e407d6 admin admin] REQUEST_METHOD: `POST` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:54:56.511687 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03817e15-1baf-42af-9050-528605e407d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:54:56.511956 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03817e15-1baf-42af-9050-528605e407d6 admin admin] PATH_INFO: `/v3/projects` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:54:56.512604 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03817e15-1baf-42af-9050-528605e407d6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:54:56.514848 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03817e15-1baf-42af-9050-528605e407d6 admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:54:56.528078 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa481f45-ab30-4849-8433-cbcdcfcda956 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:54:56.529546 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa481f45-ab30-4849-8433-cbcdcfcda956 service cinder] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:54:56.540770 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 1140/2266] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 30 00:54:56 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 30 00:54:56.545940 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 1127/2267] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 30 00:54:56 2022] POST /identity/v3/projects => generated 375 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 30 00:54:56.547533 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa481f45-ab30-4849-8433-cbcdcfcda956 service cinder] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:54:56.557835 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa481f45-ab30-4849-8433-cbcdcfcda956 service cinder] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:54:56.617854 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63eace1-e155-43a6-8270-d88dec8d2e64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:54:56.618467 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63eace1-e155-43a6-8270-d88dec8d2e64 admin admin] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:54:56.618738 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63eace1-e155-43a6-8270-d88dec8d2e64 admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:54:56.619000 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63eace1-e155-43a6-8270-d88dec8d2e64 admin admin] PATH_INFO: `/v3/users` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:54:56.619695 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63eace1-e155-43a6-8270-d88dec8d2e64 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:54:56.621575 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63eace1-e155-43a6-8270-d88dec8d2e64 admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:54:56.638870 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:54:56.651347 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 1141/2268] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 30 00:54:56 2022] POST /identity/v3/users => generated 288 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 30 00:54:56.652625 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03817e15-1baf-42af-9050-528605e407d6 admin admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:54:56.663371 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03817e15-1baf-42af-9050-528605e407d6 admin admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:54:56.668442 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30301b71-8d6c-4683-a225-97105d1a389f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:54:56.669052 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30301b71-8d6c-4683-a225-97105d1a389f admin admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:54:56.669330 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30301b71-8d6c-4683-a225-97105d1a389f admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:54:56.669604 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30301b71-8d6c-4683-a225-97105d1a389f admin admin] PATH_INFO: `/v3/roles` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:54:56.670250 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30301b71-8d6c-4683-a225-97105d1a389f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:54:56.671943 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30301b71-8d6c-4683-a225-97105d1a389f admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:54:56.685051 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 1128/2269] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 30 00:54:56 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 00:54:56.686425 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63eace1-e155-43a6-8270-d88dec8d2e64 admin admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:54:56.697754 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63eace1-e155-43a6-8270-d88dec8d2e64 admin admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:54:56.704114 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd65baa8-a5f9-4194-b162-3f1b40b79a20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:54:56.704815 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd65baa8-a5f9-4194-b162-3f1b40b79a20 admin admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:54:56.705273 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd65baa8-a5f9-4194-b162-3f1b40b79a20 admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:54:56.705568 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd65baa8-a5f9-4194-b162-3f1b40b79a20 admin admin] PATH_INFO: `/v3/roles` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:54:56.706356 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd65baa8-a5f9-4194-b162-3f1b40b79a20 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:54:56.708493 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd65baa8-a5f9-4194-b162-3f1b40b79a20 admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:54:56.720883 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 1142/2270] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 30 00:54:56 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 00:54:56.726311 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30301b71-8d6c-4683-a225-97105d1a389f admin admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:54:56.739734 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30301b71-8d6c-4683-a225-97105d1a389f admin admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:54:56.747530 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab16081-3701-4a0a-a0e4-cedb5a832e7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:54:56.748214 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab16081-3701-4a0a-a0e4-cedb5a832e7d admin admin] REQUEST_METHOD: `PUT` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:54:56.748491 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab16081-3701-4a0a-a0e4-cedb5a832e7d admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:54:56.748762 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab16081-3701-4a0a-a0e4-cedb5a832e7d admin admin] PATH_INFO: `/v3/projects/0122176ef42a4df1b3a06fb28389c996/users/70d3e2d15c0a420aa2ef72e9fcc6bd35/roles/1c93019874174c4b91118d9ce2347e47` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:54:56.766141 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab16081-3701-4a0a-a0e4-cedb5a832e7d admin admin] RBAC: Authorizing `identity:create_grant(project_id=0122176ef42a4df1b3a06fb28389c996, user_id=70d3e2d15c0a420aa2ef72e9fcc6bd35, role_id=1c93019874174c4b91118d9ce2347e47)` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:54:56.768851 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab16081-3701-4a0a-a0e4-cedb5a832e7d admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:54:56.783267 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 1129/2271] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 30 00:54:56 2022] PUT /identity/v3/projects/0122176ef42a4df1b3a06fb28389c996/users/70d3e2d15c0a420aa2ef72e9fcc6bd35/roles/1c93019874174c4b91118d9ce2347e47 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 00:54:56.793794 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f36f691-3b75-4490-b08d-1d133222c7e7 None None] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:54:56.794076 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f36f691-3b75-4490-b08d-1d133222c7e7 None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:54:56.794341 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f36f691-3b75-4490-b08d-1d133222c7e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:54:56.823669 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.auth.core [None req-6f36f691-3b75-4490-b08d-1d133222c7e7 None None] MFA Rules not processed for user `70d3e2d15c0a420aa2ef72e9fcc6bd35`. Rule list: `[]` (Enabled: `True`). {{(pid=87956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:54:56.824931 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-6f36f691-3b75-4490-b08d-1d133222c7e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:54:56.901088 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 1143/2272] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 30 00:54:56 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:54:56.905647 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab16081-3701-4a0a-a0e4-cedb5a832e7d admin admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:54:56.974872 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f36f691-3b75-4490-b08d-1d133222c7e7 None None] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:54:56.976332 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-6f36f691-3b75-4490-b08d-1d133222c7e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:54:56.977863 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab16081-3701-4a0a-a0e4-cedb5a832e7d admin admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:54:56.983349 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754f0857-ab49-4db6-bd22-2df496ab3f2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:54:56.984076 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754f0857-ab49-4db6-bd22-2df496ab3f2f admin admin] REQUEST_METHOD: `POST` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:54:56.984425 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754f0857-ab49-4db6-bd22-2df496ab3f2f admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:54:56.984765 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754f0857-ab49-4db6-bd22-2df496ab3f2f admin admin] PATH_INFO: `/v3/projects` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:54:56.985471 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754f0857-ab49-4db6-bd22-2df496ab3f2f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:54:56.987521 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754f0857-ab49-4db6-bd22-2df496ab3f2f admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:54:56.991777 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f36f691-3b75-4490-b08d-1d133222c7e7 None None] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:54:56.997248 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82f21e1-e172-458d-a780-90a91723234b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:54:56.997897 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82f21e1-e172-458d-a780-90a91723234b admin admin] REQUEST_METHOD: `DELETE` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:54:56.998797 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82f21e1-e172-458d-a780-90a91723234b admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:54:56.999136 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82f21e1-e172-458d-a780-90a91723234b admin admin] PATH_INFO: `/v3/users/caf04cf2f5d949cd8adb8719f6caa4cc` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:54:57.001581 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82f21e1-e172-458d-a780-90a91723234b admin admin] RBAC: Authorizing `identity:delete_user(user_id=caf04cf2f5d949cd8adb8719f6caa4cc)` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:54:57.003593 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82f21e1-e172-458d-a780-90a91723234b admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:54:57.012745 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:54:57.020080 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 1130/2273] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 30 00:54:56 2022] POST /identity/v3/projects => generated 377 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 00:54:57.024075 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754f0857-ab49-4db6-bd22-2df496ab3f2f admin admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:54:57.056282 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-e82f21e1-e172-458d-a780-90a91723234b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'caf04cf2f5d949cd8adb8719f6caa4cc'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:54:57.057112 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-e82f21e1-e172-458d-a780-90a91723234b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'caf04cf2f5d949cd8adb8719f6caa4cc'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:54:57.073116 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-e82f21e1-e172-458d-a780-90a91723234b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'caf04cf2f5d949cd8adb8719f6caa4cc'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:54:57.081474 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-e82f21e1-e172-458d-a780-90a91723234b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'caf04cf2f5d949cd8adb8719f6caa4cc'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:54:57.088785 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-e82f21e1-e172-458d-a780-90a91723234b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'caf04cf2f5d949cd8adb8719f6caa4cc'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:54:57.091966 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754f0857-ab49-4db6-bd22-2df496ab3f2f admin admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:54:57.095075 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 1144/2274] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 30 00:54:56 2022] DELETE /identity/v3/users/caf04cf2f5d949cd8adb8719f6caa4cc => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 00:54:57.096654 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44987ae2-a794-4958-9e46-aeb46c685ba5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:54:57.097257 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44987ae2-a794-4958-9e46-aeb46c685ba5 admin admin] REQUEST_METHOD: `POST` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:54:57.097529 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44987ae2-a794-4958-9e46-aeb46c685ba5 admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:54:57.097852 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44987ae2-a794-4958-9e46-aeb46c685ba5 admin admin] PATH_INFO: `/v3/users` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:54:57.098503 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44987ae2-a794-4958-9e46-aeb46c685ba5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:54:57.099571 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab0b4ac-35c8-49a6-88a9-7dcc01943149 None None] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:54:57.099860 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab0b4ac-35c8-49a6-88a9-7dcc01943149 None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:54:57.100157 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab0b4ac-35c8-49a6-88a9-7dcc01943149 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:54:57.100461 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44987ae2-a794-4958-9e46-aeb46c685ba5 admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:54:57.119964 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.auth.core [None req-aab0b4ac-35c8-49a6-88a9-7dcc01943149 None None] MFA Rules not processed for user `eb55b6cbca4945abb21b0e49eb745e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=87956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:54:57.121278 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-aab0b4ac-35c8-49a6-88a9-7dcc01943149 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:54:57.122653 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 1131/2275] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 30 00:54:57 2022] POST /identity/v3/users => generated 295 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 30 00:54:57.126767 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44987ae2-a794-4958-9e46-aeb46c685ba5 admin admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:54:57.128521 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-44987ae2-a794-4958-9e46-aeb46c685ba5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:54:57.140671 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44987ae2-a794-4958-9e46-aeb46c685ba5 admin admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:54:57.167221 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:54:57.185828 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 1145/2276] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 30 00:54:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 30 00:54:57.195878 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab0b4ac-35c8-49a6-88a9-7dcc01943149 None None] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:54:57.197637 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-aab0b4ac-35c8-49a6-88a9-7dcc01943149 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:54:57.198705 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572ebfd5-d671-4a1b-bcf0-a68f52310156 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:54:57.199401 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572ebfd5-d671-4a1b-bcf0-a68f52310156 admin admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:54:57.199676 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572ebfd5-d671-4a1b-bcf0-a68f52310156 admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:54:57.199925 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572ebfd5-d671-4a1b-bcf0-a68f52310156 admin admin] PATH_INFO: `/v3/roles` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:54:57.200580 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572ebfd5-d671-4a1b-bcf0-a68f52310156 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:54:57.202223 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572ebfd5-d671-4a1b-bcf0-a68f52310156 admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:54:57.212808 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 1132/2277] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 30 00:54:57 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 30 00:54:57.216952 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572ebfd5-d671-4a1b-bcf0-a68f52310156 admin admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:54:57.226552 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572ebfd5-d671-4a1b-bcf0-a68f52310156 admin admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:54:57.231841 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df61af40-7c33-494e-bfc3-7569cbaf85a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:54:57.232570 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df61af40-7c33-494e-bfc3-7569cbaf85a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:54:57.232848 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df61af40-7c33-494e-bfc3-7569cbaf85a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:54:57.233118 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df61af40-7c33-494e-bfc3-7569cbaf85a6 admin admin] PATH_INFO: `/v3/projects/16d0b5e16e8345d192c0d39ae17971bf/users/51fa80e67da444f7832d2701930af9ec/roles/6ccaa8c11f29456fb4e4eeccb21616c7` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:54:57.248159 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df61af40-7c33-494e-bfc3-7569cbaf85a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=16d0b5e16e8345d192c0d39ae17971bf, user_id=51fa80e67da444f7832d2701930af9ec, role_id=6ccaa8c11f29456fb4e4eeccb21616c7)` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:54:57.251233 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df61af40-7c33-494e-bfc3-7569cbaf85a6 admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:54:57.256092 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab0b4ac-35c8-49a6-88a9-7dcc01943149 None None] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:54:57.261273 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75d3a8d-3eed-4dcd-9229-19aca7c7a64d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5693f186c6ad4d9394f02ee3477cdcd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d2387fdf794d4eaef07bbcd7b39f2a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:54:57.262194 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75d3a8d-3eed-4dcd-9229-19aca7c7a64d service neutron] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:54:57.262489 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75d3a8d-3eed-4dcd-9229-19aca7c7a64d service neutron] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:54:57.262753 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75d3a8d-3eed-4dcd-9229-19aca7c7a64d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:54:57.265845 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 1133/2278] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 30 00:54:57 2022] PUT /identity/v3/projects/16d0b5e16e8345d192c0d39ae17971bf/users/51fa80e67da444f7832d2701930af9ec/roles/6ccaa8c11f29456fb4e4eeccb21616c7 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 00:54:57.269693 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df61af40-7c33-494e-bfc3-7569cbaf85a6 admin admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:54:57.272979 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75d3a8d-3eed-4dcd-9229-19aca7c7a64d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:54:57.274483 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75d3a8d-3eed-4dcd-9229-19aca7c7a64d service neutron] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:54:57.284867 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 1146/2279] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 30 00:54:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 30 00:54:57.332443 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df61af40-7c33-494e-bfc3-7569cbaf85a6 admin admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:54:57.338744 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3289d12a-40a3-4a96-b18e-004ca5203c87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:54:57.339470 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3289d12a-40a3-4a96-b18e-004ca5203c87 admin admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:54:57.339766 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3289d12a-40a3-4a96-b18e-004ca5203c87 admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:54:57.340103 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3289d12a-40a3-4a96-b18e-004ca5203c87 admin admin] PATH_INFO: `/v3/roles` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:54:57.340773 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3289d12a-40a3-4a96-b18e-004ca5203c87 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:54:57.342444 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3289d12a-40a3-4a96-b18e-004ca5203c87 admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:54:57.344899 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:54:57.355306 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 1134/2280] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 30 00:54:57 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 30 00:54:57.358662 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75d3a8d-3eed-4dcd-9229-19aca7c7a64d service neutron] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:54:57.368741 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75d3a8d-3eed-4dcd-9229-19aca7c7a64d service neutron] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:54:57.373338 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c130fd-805c-4085-999d-16d809dfd025 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:54:57.373985 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c130fd-805c-4085-999d-16d809dfd025 admin admin] REQUEST_METHOD: `PUT` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:54:57.374258 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c130fd-805c-4085-999d-16d809dfd025 admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:54:57.374527 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c130fd-805c-4085-999d-16d809dfd025 admin admin] PATH_INFO: `/v3/projects/16d0b5e16e8345d192c0d39ae17971bf/users/51fa80e67da444f7832d2701930af9ec/roles/6ccaa8c11f29456fb4e4eeccb21616c7` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:54:57.376471 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c130fd-805c-4085-999d-16d809dfd025 admin admin] RBAC: Authorizing `identity:create_grant(project_id=16d0b5e16e8345d192c0d39ae17971bf, user_id=51fa80e67da444f7832d2701930af9ec, role_id=6ccaa8c11f29456fb4e4eeccb21616c7)` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:54:57.379438 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c130fd-805c-4085-999d-16d809dfd025 admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:54:57.393160 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 1147/2281] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 30 00:54:57 2022] PUT /identity/v3/projects/16d0b5e16e8345d192c0d39ae17971bf/users/51fa80e67da444f7832d2701930af9ec/roles/6ccaa8c11f29456fb4e4eeccb21616c7 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 00:54:57.405492 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9eab29-dc6f-443f-93db-aecf284e0e24 None None] REQUEST_METHOD: `POST` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:54:57.405768 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9eab29-dc6f-443f-93db-aecf284e0e24 None None] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:54:57.406037 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9eab29-dc6f-443f-93db-aecf284e0e24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:54:57.437746 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.auth.core [None req-ee9eab29-dc6f-443f-93db-aecf284e0e24 None None] MFA Rules not processed for user `51fa80e67da444f7832d2701930af9ec`. Rule list: `[]` (Enabled: `True`). {{(pid=87955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:54:57.438986 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-ee9eab29-dc6f-443f-93db-aecf284e0e24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:54:57.514081 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 1135/2282] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 30 00:54:57 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:54:57.522094 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c130fd-805c-4085-999d-16d809dfd025 admin admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:54:57.524165 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-53c130fd-805c-4085-999d-16d809dfd025 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:54:57.562226 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9eab29-dc6f-443f-93db-aecf284e0e24 None None] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:54:57.563822 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-ee9eab29-dc6f-443f-93db-aecf284e0e24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:54:57.598176 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c130fd-805c-4085-999d-16d809dfd025 admin admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:54:57.602310 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5b6c79-c0ca-43ca-8603-a5060d2c203e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48d928ff7fe24348ac900f09c56acc20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d2387fdf794d4eaef07bbcd7b39f2a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:54:57.602912 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5b6c79-c0ca-43ca-8603-a5060d2c203e service cinder] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:54:57.603182 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5b6c79-c0ca-43ca-8603-a5060d2c203e service cinder] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:54:57.603475 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5b6c79-c0ca-43ca-8603-a5060d2c203e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:54:57.605319 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-3a5b6c79-c0ca-43ca-8603-a5060d2c203e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:54:57.633404 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9eab29-dc6f-443f-93db-aecf284e0e24 None None] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:54:57.638051 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdc7a90-268c-41a0-afb7-3e7e77bc457c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:54:57.638677 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdc7a90-268c-41a0-afb7-3e7e77bc457c admin admin] REQUEST_METHOD: `DELETE` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:54:57.638950 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdc7a90-268c-41a0-afb7-3e7e77bc457c admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:54:57.639255 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdc7a90-268c-41a0-afb7-3e7e77bc457c admin admin] PATH_INFO: `/v3/projects/e0d77b1bd33e4b80a50a7f811239c815` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:54:57.640431 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bdc7a90-268c-41a0-afb7-3e7e77bc457c admin admin] RBAC: Authorizing `identity:delete_project(project_id=e0d77b1bd33e4b80a50a7f811239c815)` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:54:57.642401 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bdc7a90-268c-41a0-afb7-3e7e77bc457c admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:54:57.664404 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5b6c79-c0ca-43ca-8603-a5060d2c203e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:54:57.666015 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5b6c79-c0ca-43ca-8603-a5060d2c203e service cinder] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:54:57.676286 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 1148/2283] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 30 00:54:57 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 00:54:57.693601 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-4bdc7a90-268c-41a0-afb7-3e7e77bc457c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e0d77b1bd33e4b80a50a7f811239c815', 'request_id': 'req-4bdc7a90-268c-41a0-afb7-3e7e77bc457c'} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:54:57.699984 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-4bdc7a90-268c-41a0-afb7-3e7e77bc457c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e0d77b1bd33e4b80a50a7f811239c815', 'request_id': 'req-4bdc7a90-268c-41a0-afb7-3e7e77bc457c'} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:54:57.707671 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-4bdc7a90-268c-41a0-afb7-3e7e77bc457c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e0d77b1bd33e4b80a50a7f811239c815', 'request_id': 'req-4bdc7a90-268c-41a0-afb7-3e7e77bc457c'} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:54:57.719865 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-4bdc7a90-268c-41a0-afb7-3e7e77bc457c admin admin] The token cache is being invalidate because project e0d77b1bd33e4b80a50a7f811239c815 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87955) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 00:54:57.720154 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-4bdc7a90-268c-41a0-afb7-3e7e77bc457c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:54:57.720820 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-4bdc7a90-268c-41a0-afb7-3e7e77bc457c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:54:57.722364 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 1136/2284] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 30 00:54:57 2022] DELETE /identity/v3/projects/e0d77b1bd33e4b80a50a7f811239c815 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 00:54:57.726581 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5b6c79-c0ca-43ca-8603-a5060d2c203e service cinder] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:54:57.737503 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5b6c79-c0ca-43ca-8603-a5060d2c203e service cinder] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:54:57.768280 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:54:57.797263 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5242d9d-991c-4823-a01a-6bbd99125bb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:54:57.797977 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5242d9d-991c-4823-a01a-6bbd99125bb3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:54:57.798364 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5242d9d-991c-4823-a01a-6bbd99125bb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:54:57.798687 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5242d9d-991c-4823-a01a-6bbd99125bb3 admin admin] PATH_INFO: `/v3/users/a7a29f03d800424d928e9239fd090721` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:54:57.801676 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5242d9d-991c-4823-a01a-6bbd99125bb3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a7a29f03d800424d928e9239fd090721)` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:54:57.802545 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5242d9d-991c-4823-a01a-6bbd99125bb3 admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:54:57.851889 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-d5242d9d-991c-4823-a01a-6bbd99125bb3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a7a29f03d800424d928e9239fd090721'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:54:57.852635 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-d5242d9d-991c-4823-a01a-6bbd99125bb3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a7a29f03d800424d928e9239fd090721'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:54:57.866377 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-d5242d9d-991c-4823-a01a-6bbd99125bb3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a7a29f03d800424d928e9239fd090721'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:54:57.875130 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-d5242d9d-991c-4823-a01a-6bbd99125bb3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a7a29f03d800424d928e9239fd090721'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:54:57.883531 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-d5242d9d-991c-4823-a01a-6bbd99125bb3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a7a29f03d800424d928e9239fd090721'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:54:57.891722 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 1149/2285] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 30 00:54:57 2022] DELETE /identity/v3/users/a7a29f03d800424d928e9239fd090721 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 00:54:58.192077 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdc7a90-268c-41a0-afb7-3e7e77bc457c admin admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:54:58.193838 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-4bdc7a90-268c-41a0-afb7-3e7e77bc457c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:54:58.209104 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdc7a90-268c-41a0-afb7-3e7e77bc457c admin admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:54:58.218362 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:54:58.269496 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e88641c-7e4d-4365-bba2-ea43a66953c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:54:58.270040 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e88641c-7e4d-4365-bba2-ea43a66953c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:54:58.270317 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e88641c-7e4d-4365-bba2-ea43a66953c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:54:58.270589 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e88641c-7e4d-4365-bba2-ea43a66953c3 admin admin] PATH_INFO: `/v3/projects/b9a0c45aef904f0a84cfc1535ed1864d` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:54:58.271724 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e88641c-7e4d-4365-bba2-ea43a66953c3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b9a0c45aef904f0a84cfc1535ed1864d)` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:54:58.273632 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e88641c-7e4d-4365-bba2-ea43a66953c3 admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:54:58.321604 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-8e88641c-7e4d-4365-bba2-ea43a66953c3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b9a0c45aef904f0a84cfc1535ed1864d', 'request_id': 'req-8e88641c-7e4d-4365-bba2-ea43a66953c3'} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:54:58.327323 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-8e88641c-7e4d-4365-bba2-ea43a66953c3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b9a0c45aef904f0a84cfc1535ed1864d', 'request_id': 'req-8e88641c-7e4d-4365-bba2-ea43a66953c3'} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:54:58.335167 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-8e88641c-7e4d-4365-bba2-ea43a66953c3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b9a0c45aef904f0a84cfc1535ed1864d', 'request_id': 'req-8e88641c-7e4d-4365-bba2-ea43a66953c3'} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:54:58.349691 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-8e88641c-7e4d-4365-bba2-ea43a66953c3 admin admin] The token cache is being invalidate because project b9a0c45aef904f0a84cfc1535ed1864d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87955) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 00:54:58.349980 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-8e88641c-7e4d-4365-bba2-ea43a66953c3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:54:58.350738 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-8e88641c-7e4d-4365-bba2-ea43a66953c3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:54:58.352369 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 1137/2286] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 30 00:54:58 2022] DELETE /identity/v3/projects/b9a0c45aef904f0a84cfc1535ed1864d => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 00:54:58.357657 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3d0c49-423b-4d19-babe-f7a805afd08b None None] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:54:58.358165 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3d0c49-423b-4d19-babe-f7a805afd08b None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:54:58.358261 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3d0c49-423b-4d19-babe-f7a805afd08b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:54:58.378188 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.auth.core [None req-ca3d0c49-423b-4d19-babe-f7a805afd08b None None] MFA Rules not processed for user `eb55b6cbca4945abb21b0e49eb745e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=87956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:54:58.379495 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-ca3d0c49-423b-4d19-babe-f7a805afd08b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:54:58.446178 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 1150/2287] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 30 00:54:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:54:58.454655 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4d5bac-9899-4824-9883-ec8b0727aec2 None None] REQUEST_METHOD: `POST` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:54:58.454942 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4d5bac-9899-4824-9883-ec8b0727aec2 None None] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:54:58.455232 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4d5bac-9899-4824-9883-ec8b0727aec2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:54:58.476159 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.auth.core [None req-8d4d5bac-9899-4824-9883-ec8b0727aec2 None None] MFA Rules not processed for user `eb55b6cbca4945abb21b0e49eb745e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=87955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:54:58.477345 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-8d4d5bac-9899-4824-9883-ec8b0727aec2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:54:58.485618 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 1138/2288] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 30 00:54:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:54:58.490050 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3d0c49-423b-4d19-babe-f7a805afd08b None None] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:54:58.500147 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3d0c49-423b-4d19-babe-f7a805afd08b None None] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:54:58.505061 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7177041-e825-49dd-b226-29ec8c594adc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:54:58.505660 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7177041-e825-49dd-b226-29ec8c594adc admin admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:54:58.505935 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7177041-e825-49dd-b226-29ec8c594adc admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:54:58.506201 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7177041-e825-49dd-b226-29ec8c594adc admin admin] PATH_INFO: `/v3/domains` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:54:58.506844 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7177041-e825-49dd-b226-29ec8c594adc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87956) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:54:58.507143 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7177041-e825-49dd-b226-29ec8c594adc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:54:58.508779 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7177041-e825-49dd-b226-29ec8c594adc admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:54:58.520308 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 1151/2289] 10.222.0.42 () {58 vars in 1153 bytes} [Sun Oct 30 00:54:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:54:58.524685 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4d5bac-9899-4824-9883-ec8b0727aec2 None None] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:54:58.534150 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4d5bac-9899-4824-9883-ec8b0727aec2 None None] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:54:58.538998 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249dc90f-b095-432b-beff-92941b5bcf5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:54:58.539619 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249dc90f-b095-432b-beff-92941b5bcf5a admin admin] REQUEST_METHOD: `POST` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:54:58.539895 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249dc90f-b095-432b-beff-92941b5bcf5a admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:54:58.540164 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249dc90f-b095-432b-beff-92941b5bcf5a admin admin] PATH_INFO: `/v3/projects` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:54:58.540799 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249dc90f-b095-432b-beff-92941b5bcf5a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:54:58.542738 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249dc90f-b095-432b-beff-92941b5bcf5a admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:54:58.573111 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 1139/2290] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 30 00:54:58 2022] POST /identity/v3/projects => generated 385 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 00:54:58.578110 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7177041-e825-49dd-b226-29ec8c594adc admin admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:54:58.592382 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7177041-e825-49dd-b226-29ec8c594adc admin admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:54:58.630618 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:54:58.651230 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6272bc3e-d6b3-41a8-8c6d-f3fdb6cf848c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:54:58.651848 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6272bc3e-d6b3-41a8-8c6d-f3fdb6cf848c admin admin] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:54:58.652124 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6272bc3e-d6b3-41a8-8c6d-f3fdb6cf848c admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:54:58.652393 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6272bc3e-d6b3-41a8-8c6d-f3fdb6cf848c admin admin] PATH_INFO: `/v3/users` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:54:58.653022 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6272bc3e-d6b3-41a8-8c6d-f3fdb6cf848c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:54:58.654932 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6272bc3e-d6b3-41a8-8c6d-f3fdb6cf848c admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:54:58.677601 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 1152/2291] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 30 00:54:58 2022] POST /identity/v3/users => generated 293 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 30 00:54:58.682308 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249dc90f-b095-432b-beff-92941b5bcf5a admin admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:54:58.693162 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249dc90f-b095-432b-beff-92941b5bcf5a admin admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:54:58.698637 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af1b12e-80b3-496e-8ffe-9880837067ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:54:58.699326 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af1b12e-80b3-496e-8ffe-9880837067ee admin admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:54:58.699610 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af1b12e-80b3-496e-8ffe-9880837067ee admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:54:58.699883 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af1b12e-80b3-496e-8ffe-9880837067ee admin admin] PATH_INFO: `/v3/roles` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:54:58.700534 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af1b12e-80b3-496e-8ffe-9880837067ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:54:58.702168 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af1b12e-80b3-496e-8ffe-9880837067ee admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:54:58.712333 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 1140/2292] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 30 00:54:58 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 00:54:58.716460 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6272bc3e-d6b3-41a8-8c6d-f3fdb6cf848c admin admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:54:58.732144 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6272bc3e-d6b3-41a8-8c6d-f3fdb6cf848c admin admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:54:58.737167 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53d5f5e-300a-4838-af39-2c465fbd582c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:54:58.737763 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53d5f5e-300a-4838-af39-2c465fbd582c admin admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:54:58.738037 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53d5f5e-300a-4838-af39-2c465fbd582c admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:54:58.738326 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53d5f5e-300a-4838-af39-2c465fbd582c admin admin] PATH_INFO: `/v3/roles` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:54:58.738967 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53d5f5e-300a-4838-af39-2c465fbd582c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:54:58.740597 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53d5f5e-300a-4838-af39-2c465fbd582c admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:54:58.751491 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 1153/2293] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 30 00:54:58 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 00:54:58.755859 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af1b12e-80b3-496e-8ffe-9880837067ee admin admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:54:58.767562 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af1b12e-80b3-496e-8ffe-9880837067ee admin admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:54:58.775877 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5216269e-dba8-44f0-aad7-f44d4d1f02f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:54:58.776520 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5216269e-dba8-44f0-aad7-f44d4d1f02f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:54:58.776798 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5216269e-dba8-44f0-aad7-f44d4d1f02f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:54:58.777071 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5216269e-dba8-44f0-aad7-f44d4d1f02f0 admin admin] PATH_INFO: `/v3/projects/6eba2e85b9a24f01843db51c15f0acb2/users/74cf5ea0b54c44bd8540252f98010d99/roles/1c93019874174c4b91118d9ce2347e47` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:54:58.797165 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5216269e-dba8-44f0-aad7-f44d4d1f02f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6eba2e85b9a24f01843db51c15f0acb2, user_id=74cf5ea0b54c44bd8540252f98010d99, role_id=1c93019874174c4b91118d9ce2347e47)` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:54:58.801145 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5216269e-dba8-44f0-aad7-f44d4d1f02f0 admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:54:58.818017 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 1141/2294] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 30 00:54:58 2022] PUT /identity/v3/projects/6eba2e85b9a24f01843db51c15f0acb2/users/74cf5ea0b54c44bd8540252f98010d99/roles/1c93019874174c4b91118d9ce2347e47 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 00:54:58.829919 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfadd681-995a-4f95-bbe6-6a1f789ae3fa None None] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:54:58.830218 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfadd681-995a-4f95-bbe6-6a1f789ae3fa None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:54:58.830488 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfadd681-995a-4f95-bbe6-6a1f789ae3fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:54:58.860075 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.auth.core [None req-dfadd681-995a-4f95-bbe6-6a1f789ae3fa None None] MFA Rules not processed for user `74cf5ea0b54c44bd8540252f98010d99`. Rule list: `[]` (Enabled: `True`). {{(pid=87956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:54:58.861282 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-dfadd681-995a-4f95-bbe6-6a1f789ae3fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:54:58.943432 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 1154/2295] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 30 00:54:58 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 30 00:54:58.956622 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5216269e-dba8-44f0-aad7-f44d4d1f02f0 admin admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:54:58.958665 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-5216269e-dba8-44f0-aad7-f44d4d1f02f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:54:59.004848 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:54:59.022132 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5216269e-dba8-44f0-aad7-f44d4d1f02f0 admin admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:54:59.027414 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ceb1eb-e6df-4ba8-bdad-2efb60a37a05 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48d928ff7fe24348ac900f09c56acc20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d2387fdf794d4eaef07bbcd7b39f2a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:54:59.027414 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ceb1eb-e6df-4ba8-bdad-2efb60a37a05 service cinder] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:54:59.027414 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ceb1eb-e6df-4ba8-bdad-2efb60a37a05 service cinder] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:54:59.027414 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ceb1eb-e6df-4ba8-bdad-2efb60a37a05 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:54:59.036552 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ceb1eb-e6df-4ba8-bdad-2efb60a37a05 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:54:59.038066 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ceb1eb-e6df-4ba8-bdad-2efb60a37a05 service cinder] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:54:59.047179 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 1142/2296] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 30 00:54:58 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 00:55:00.271356 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfadd681-995a-4f95-bbe6-6a1f789ae3fa None None] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:55:00.273006 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-dfadd681-995a-4f95-bbe6-6a1f789ae3fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:55:00.286211 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfadd681-995a-4f95-bbe6-6a1f789ae3fa None None] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:55:00.290408 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a04288-f008-41a9-8681-22313186488f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48d928ff7fe24348ac900f09c56acc20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d2387fdf794d4eaef07bbcd7b39f2a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:55:00.291008 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a04288-f008-41a9-8681-22313186488f service cinder] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:55:00.291307 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a04288-f008-41a9-8681-22313186488f service cinder] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:55:00.291579 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a04288-f008-41a9-8681-22313186488f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:55:00.293574 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-d4a04288-f008-41a9-8681-22313186488f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:55:00.368602 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a04288-f008-41a9-8681-22313186488f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:55:00.369937 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a04288-f008-41a9-8681-22313186488f service cinder] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:55:00.380483 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 1155/2297] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 30 00:55:00 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 00:55:04.472290 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ceb1eb-e6df-4ba8-bdad-2efb60a37a05 service cinder] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:55:04.537274 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ceb1eb-e6df-4ba8-bdad-2efb60a37a05 service cinder] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:55:04.543010 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989efefd-b8fc-47ef-9635-70694dc07d7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:55:04.543813 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989efefd-b8fc-47ef-9635-70694dc07d7b admin admin] REQUEST_METHOD: `DELETE` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:55:04.544108 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989efefd-b8fc-47ef-9635-70694dc07d7b admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:55:04.544383 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989efefd-b8fc-47ef-9635-70694dc07d7b admin admin] PATH_INFO: `/v3/users/74cf5ea0b54c44bd8540252f98010d99` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:55:04.545526 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989efefd-b8fc-47ef-9635-70694dc07d7b admin admin] RBAC: Authorizing `identity:delete_user(user_id=74cf5ea0b54c44bd8540252f98010d99)` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:55:04.547483 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989efefd-b8fc-47ef-9635-70694dc07d7b admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:55:04.599486 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-989efefd-b8fc-47ef-9635-70694dc07d7b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '74cf5ea0b54c44bd8540252f98010d99'} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:55:04.600143 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-989efefd-b8fc-47ef-9635-70694dc07d7b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '74cf5ea0b54c44bd8540252f98010d99'} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:55:04.608103 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-989efefd-b8fc-47ef-9635-70694dc07d7b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '74cf5ea0b54c44bd8540252f98010d99'} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:55:04.608839 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-989efefd-b8fc-47ef-9635-70694dc07d7b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '74cf5ea0b54c44bd8540252f98010d99'} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:55:04.622182 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-989efefd-b8fc-47ef-9635-70694dc07d7b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '74cf5ea0b54c44bd8540252f98010d99'} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:55:04.636267 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 1143/2298] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 30 00:55:04 2022] DELETE /identity/v3/users/74cf5ea0b54c44bd8540252f98010d99 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 00:55:04.641012 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f11c9a9-176d-4bf2-83fe-efc7edb03a95 None None] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:55:04.641521 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f11c9a9-176d-4bf2-83fe-efc7edb03a95 None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:55:04.641521 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f11c9a9-176d-4bf2-83fe-efc7edb03a95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:55:04.661315 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.auth.core [None req-1f11c9a9-176d-4bf2-83fe-efc7edb03a95 None None] MFA Rules not processed for user `eb55b6cbca4945abb21b0e49eb745e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=87956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:55:04.662559 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-1f11c9a9-176d-4bf2-83fe-efc7edb03a95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:55:04.703865 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:55:04.726082 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 1156/2299] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 30 00:55:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:55:04.736016 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989efefd-b8fc-47ef-9635-70694dc07d7b admin admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:55:04.737633 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-989efefd-b8fc-47ef-9635-70694dc07d7b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:55:04.796426 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989efefd-b8fc-47ef-9635-70694dc07d7b admin admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:55:04.800464 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57f2255-1f33-47f8-b8d7-4dfe38fbd37c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5693f186c6ad4d9394f02ee3477cdcd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d2387fdf794d4eaef07bbcd7b39f2a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:55:04.801035 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57f2255-1f33-47f8-b8d7-4dfe38fbd37c service neutron] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:55:04.801275 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57f2255-1f33-47f8-b8d7-4dfe38fbd37c service neutron] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:55:04.801572 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57f2255-1f33-47f8-b8d7-4dfe38fbd37c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:55:04.810821 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57f2255-1f33-47f8-b8d7-4dfe38fbd37c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:55:04.812269 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57f2255-1f33-47f8-b8d7-4dfe38fbd37c service neutron] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:55:04.821578 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 1144/2300] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 30 00:55:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 00:55:05.100753 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f11c9a9-176d-4bf2-83fe-efc7edb03a95 None None] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:55:05.102270 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-1f11c9a9-176d-4bf2-83fe-efc7edb03a95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:55:05.114581 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f11c9a9-176d-4bf2-83fe-efc7edb03a95 None None] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:55:05.119697 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9293f16f-b8db-497c-bbb8-339c23788673 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:55:05.120364 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9293f16f-b8db-497c-bbb8-339c23788673 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:55:05.120610 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9293f16f-b8db-497c-bbb8-339c23788673 admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:55:05.120951 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9293f16f-b8db-497c-bbb8-339c23788673 admin admin] PATH_INFO: `/v3/projects/6eba2e85b9a24f01843db51c15f0acb2` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:55:05.122111 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9293f16f-b8db-497c-bbb8-339c23788673 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6eba2e85b9a24f01843db51c15f0acb2)` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:55:05.124101 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9293f16f-b8db-497c-bbb8-339c23788673 admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:55:05.173357 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-9293f16f-b8db-497c-bbb8-339c23788673 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6eba2e85b9a24f01843db51c15f0acb2', 'request_id': 'req-9293f16f-b8db-497c-bbb8-339c23788673'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:55:05.180415 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-9293f16f-b8db-497c-bbb8-339c23788673 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6eba2e85b9a24f01843db51c15f0acb2', 'request_id': 'req-9293f16f-b8db-497c-bbb8-339c23788673'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:55:05.187684 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-9293f16f-b8db-497c-bbb8-339c23788673 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6eba2e85b9a24f01843db51c15f0acb2', 'request_id': 'req-9293f16f-b8db-497c-bbb8-339c23788673'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:55:05.198485 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-9293f16f-b8db-497c-bbb8-339c23788673 admin admin] The token cache is being invalidate because project 6eba2e85b9a24f01843db51c15f0acb2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87956) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 00:55:05.198761 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-9293f16f-b8db-497c-bbb8-339c23788673 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:55:05.199450 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-9293f16f-b8db-497c-bbb8-339c23788673 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:55:05.200958 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 1157/2301] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 30 00:55:05 2022] DELETE /identity/v3/projects/6eba2e85b9a24f01843db51c15f0acb2 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 00:55:05.205889 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06feb07-38b5-4821-add2-930adf572eda None None] REQUEST_METHOD: `POST` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:55:05.206192 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06feb07-38b5-4821-add2-930adf572eda None None] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:55:05.206460 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06feb07-38b5-4821-add2-930adf572eda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:55:05.214963 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:55:05.227298 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.auth.core [None req-b06feb07-38b5-4821-add2-930adf572eda None None] MFA Rules not processed for user `eb55b6cbca4945abb21b0e49eb745e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=87955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:55:05.228502 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-b06feb07-38b5-4821-add2-930adf572eda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:55:05.289655 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 1145/2302] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 30 00:55:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:55:05.297852 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95e22c8-3553-4005-92a6-c71138ec1e46 None None] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:55:05.298136 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95e22c8-3553-4005-92a6-c71138ec1e46 None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:55:05.298406 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95e22c8-3553-4005-92a6-c71138ec1e46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:55:05.319339 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.auth.core [None req-a95e22c8-3553-4005-92a6-c71138ec1e46 None None] MFA Rules not processed for user `eb55b6cbca4945abb21b0e49eb745e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=87956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:55:05.320543 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-a95e22c8-3553-4005-92a6-c71138ec1e46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:55:05.330284 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 1158/2303] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 30 00:55:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:55:05.334734 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06feb07-38b5-4821-add2-930adf572eda None None] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:55:05.345280 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06feb07-38b5-4821-add2-930adf572eda None None] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:55:05.350481 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5eea21-1ab2-439b-a666-dca1d98380bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:55:05.351082 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5eea21-1ab2-439b-a666-dca1d98380bd admin admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:55:05.351391 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5eea21-1ab2-439b-a666-dca1d98380bd admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:55:05.351667 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5eea21-1ab2-439b-a666-dca1d98380bd admin admin] PATH_INFO: `/v3/domains` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:55:05.352320 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5eea21-1ab2-439b-a666-dca1d98380bd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:55:05.352616 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5eea21-1ab2-439b-a666-dca1d98380bd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:55:05.354216 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5eea21-1ab2-439b-a666-dca1d98380bd admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:55:05.369689 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 1146/2304] 10.222.0.42 () {58 vars in 1153 bytes} [Sun Oct 30 00:55:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:55:05.370961 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95e22c8-3553-4005-92a6-c71138ec1e46 None None] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:55:05.380485 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95e22c8-3553-4005-92a6-c71138ec1e46 None None] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:55:05.385740 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfc8b46-f11b-4d04-ba76-fa8dc24c25b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:55:05.386335 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfc8b46-f11b-4d04-ba76-fa8dc24c25b0 admin admin] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:55:05.386607 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfc8b46-f11b-4d04-ba76-fa8dc24c25b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:55:05.386872 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfc8b46-f11b-4d04-ba76-fa8dc24c25b0 admin admin] PATH_INFO: `/v3/projects` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:55:05.387610 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfc8b46-f11b-4d04-ba76-fa8dc24c25b0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:55:05.389506 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfc8b46-f11b-4d04-ba76-fa8dc24c25b0 admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:55:05.421408 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 1159/2305] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 30 00:55:05 2022] POST /identity/v3/projects => generated 359 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 00:55:05.422561 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5eea21-1ab2-439b-a666-dca1d98380bd admin admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:55:05.432531 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5eea21-1ab2-439b-a666-dca1d98380bd admin admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:55:05.498576 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d05fd4-b955-42aa-af84-daa185ed6a3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:55:05.499237 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d05fd4-b955-42aa-af84-daa185ed6a3a admin admin] REQUEST_METHOD: `POST` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:55:05.499496 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d05fd4-b955-42aa-af84-daa185ed6a3a admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:55:05.499764 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d05fd4-b955-42aa-af84-daa185ed6a3a admin admin] PATH_INFO: `/v3/users` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:55:05.500400 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d05fd4-b955-42aa-af84-daa185ed6a3a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:55:05.502297 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d05fd4-b955-42aa-af84-daa185ed6a3a admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:55:05.524961 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 1147/2306] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 30 00:55:05 2022] POST /identity/v3/users => generated 280 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 30 00:55:05.529449 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfc8b46-f11b-4d04-ba76-fa8dc24c25b0 admin admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:55:05.539764 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfc8b46-f11b-4d04-ba76-fa8dc24c25b0 admin admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:55:05.544468 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbb11be-5f01-495e-a348-384cdca8da77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:55:05.545069 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbb11be-5f01-495e-a348-384cdca8da77 admin admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:55:05.545343 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbb11be-5f01-495e-a348-384cdca8da77 admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:55:05.545608 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbb11be-5f01-495e-a348-384cdca8da77 admin admin] PATH_INFO: `/v3/roles` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:55:05.546250 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fbb11be-5f01-495e-a348-384cdca8da77 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:55:05.547905 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fbb11be-5f01-495e-a348-384cdca8da77 admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:55:05.560926 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 1160/2307] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 30 00:55:05 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 30 00:55:05.562155 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d05fd4-b955-42aa-af84-daa185ed6a3a admin admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:55:05.572863 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d05fd4-b955-42aa-af84-daa185ed6a3a admin admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:55:05.577828 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341bfac6-5427-451e-9fc2-099c0f8e46e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:55:05.578420 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341bfac6-5427-451e-9fc2-099c0f8e46e3 admin admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:55:05.578717 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341bfac6-5427-451e-9fc2-099c0f8e46e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:55:05.578990 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341bfac6-5427-451e-9fc2-099c0f8e46e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:55:05.579745 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341bfac6-5427-451e-9fc2-099c0f8e46e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:55:05.581879 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341bfac6-5427-451e-9fc2-099c0f8e46e3 admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:55:05.596765 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 1148/2308] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 30 00:55:05 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 30 00:55:05.597852 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbb11be-5f01-495e-a348-384cdca8da77 admin admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:55:05.607911 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbb11be-5f01-495e-a348-384cdca8da77 admin admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:55:05.612953 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55f0801-22bf-4d7a-ad48-41e9b26df156 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:55:05.613583 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55f0801-22bf-4d7a-ad48-41e9b26df156 admin admin] REQUEST_METHOD: `PUT` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:55:05.613998 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55f0801-22bf-4d7a-ad48-41e9b26df156 admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:55:05.614294 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55f0801-22bf-4d7a-ad48-41e9b26df156 admin admin] PATH_INFO: `/v3/projects/5d9876e340d940a7a27ae2b81024b37c/users/3a11ef2509dc437298f519b444c2fbcb/roles/1c93019874174c4b91118d9ce2347e47` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:55:05.640758 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55f0801-22bf-4d7a-ad48-41e9b26df156 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d9876e340d940a7a27ae2b81024b37c, user_id=3a11ef2509dc437298f519b444c2fbcb, role_id=1c93019874174c4b91118d9ce2347e47)` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:55:05.643278 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55f0801-22bf-4d7a-ad48-41e9b26df156 admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:55:05.664108 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 1161/2309] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 30 00:55:05 2022] PUT /identity/v3/projects/5d9876e340d940a7a27ae2b81024b37c/users/3a11ef2509dc437298f519b444c2fbcb/roles/1c93019874174c4b91118d9ce2347e47 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 00:55:05.669815 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6148f50e-9330-4513-862f-0b1b47b4248f None None] REQUEST_METHOD: `POST` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:55:05.670098 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6148f50e-9330-4513-862f-0b1b47b4248f None None] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:55:05.670394 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6148f50e-9330-4513-862f-0b1b47b4248f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:55:05.699585 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.auth.core [None req-6148f50e-9330-4513-862f-0b1b47b4248f None None] MFA Rules not processed for user `3a11ef2509dc437298f519b444c2fbcb`. Rule list: `[]` (Enabled: `True`). {{(pid=87955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:55:05.700782 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-6148f50e-9330-4513-862f-0b1b47b4248f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:55:05.764342 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:55:05.769630 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 1149/2310] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 30 00:55:05 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:55:05.807092 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55f0801-22bf-4d7a-ad48-41e9b26df156 admin admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:55:05.809007 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-d55f0801-22bf-4d7a-ad48-41e9b26df156 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:55:05.869284 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55f0801-22bf-4d7a-ad48-41e9b26df156 admin admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:55:05.873289 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e870f2f8-1a1b-485b-be77-4419fa76d4e2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48d928ff7fe24348ac900f09c56acc20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d2387fdf794d4eaef07bbcd7b39f2a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:55:05.873889 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e870f2f8-1a1b-485b-be77-4419fa76d4e2 service cinder] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:55:05.874160 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e870f2f8-1a1b-485b-be77-4419fa76d4e2 service cinder] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:55:05.874455 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e870f2f8-1a1b-485b-be77-4419fa76d4e2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:55:05.883459 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e870f2f8-1a1b-485b-be77-4419fa76d4e2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:55:05.885007 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e870f2f8-1a1b-485b-be77-4419fa76d4e2 service cinder] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:55:05.894274 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 1162/2311] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 30 00:55:05 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 00:55:05.912503 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6148f50e-9330-4513-862f-0b1b47b4248f None None] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:55:05.992189 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6148f50e-9330-4513-862f-0b1b47b4248f None None] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:55:05.997279 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f2768f-94a2-446b-9991-a2d19de5c9de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:55:05.997913 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f2768f-94a2-446b-9991-a2d19de5c9de admin admin] REQUEST_METHOD: `DELETE` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:55:05.998189 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f2768f-94a2-446b-9991-a2d19de5c9de admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:55:05.998462 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f2768f-94a2-446b-9991-a2d19de5c9de admin admin] PATH_INFO: `/v3/users/3a11ef2509dc437298f519b444c2fbcb` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:55:05.999647 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f2768f-94a2-446b-9991-a2d19de5c9de admin admin] RBAC: Authorizing `identity:delete_user(user_id=3a11ef2509dc437298f519b444c2fbcb)` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:55:06.001581 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f2768f-94a2-446b-9991-a2d19de5c9de admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:55:06.055179 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-a5f2768f-94a2-446b-9991-a2d19de5c9de admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3a11ef2509dc437298f519b444c2fbcb'} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:55:06.055950 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-a5f2768f-94a2-446b-9991-a2d19de5c9de admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3a11ef2509dc437298f519b444c2fbcb'} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:55:06.063380 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-a5f2768f-94a2-446b-9991-a2d19de5c9de admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3a11ef2509dc437298f519b444c2fbcb'} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:55:06.064067 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-a5f2768f-94a2-446b-9991-a2d19de5c9de admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3a11ef2509dc437298f519b444c2fbcb'} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:55:06.076527 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-a5f2768f-94a2-446b-9991-a2d19de5c9de admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3a11ef2509dc437298f519b444c2fbcb'} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:55:06.091921 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 1150/2312] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 30 00:55:05 2022] DELETE /identity/v3/users/3a11ef2509dc437298f519b444c2fbcb => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 00:55:06.096597 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad536876-dbfd-4ee5-a1f1-a6d866c01f9a None None] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:55:06.096884 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad536876-dbfd-4ee5-a1f1-a6d866c01f9a None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:55:06.097184 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad536876-dbfd-4ee5-a1f1-a6d866c01f9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:55:06.105467 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:55:06.118200 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.auth.core [None req-ad536876-dbfd-4ee5-a1f1-a6d866c01f9a None None] MFA Rules not processed for user `eb55b6cbca4945abb21b0e49eb745e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=87956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:55:06.119447 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-ad536876-dbfd-4ee5-a1f1-a6d866c01f9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:55:06.181377 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 1163/2313] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 30 00:55:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:55:06.191191 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f2768f-94a2-446b-9991-a2d19de5c9de admin admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:55:06.192782 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-a5f2768f-94a2-446b-9991-a2d19de5c9de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:55:06.253841 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f2768f-94a2-446b-9991-a2d19de5c9de admin admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:55:06.257946 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a00c946-789b-48ea-a6c5-cac2600508c6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5693f186c6ad4d9394f02ee3477cdcd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d2387fdf794d4eaef07bbcd7b39f2a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:55:06.258549 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a00c946-789b-48ea-a6c5-cac2600508c6 service neutron] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:55:06.258825 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a00c946-789b-48ea-a6c5-cac2600508c6 service neutron] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:55:06.259092 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a00c946-789b-48ea-a6c5-cac2600508c6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:55:06.268728 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a00c946-789b-48ea-a6c5-cac2600508c6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:55:06.270144 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a00c946-789b-48ea-a6c5-cac2600508c6 service neutron] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:55:06.279704 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 1151/2314] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 30 00:55:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 00:55:06.564439 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad536876-dbfd-4ee5-a1f1-a6d866c01f9a None None] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:55:06.565994 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-ad536876-dbfd-4ee5-a1f1-a6d866c01f9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:55:06.579337 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad536876-dbfd-4ee5-a1f1-a6d866c01f9a None None] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:55:06.584389 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b31922-1c7a-447b-8c00-8d8d47cfd364 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:55:06.585103 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b31922-1c7a-447b-8c00-8d8d47cfd364 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:55:06.585442 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b31922-1c7a-447b-8c00-8d8d47cfd364 admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:55:06.585805 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b31922-1c7a-447b-8c00-8d8d47cfd364 admin admin] PATH_INFO: `/v3/projects/5d9876e340d940a7a27ae2b81024b37c` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:55:06.587018 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b31922-1c7a-447b-8c00-8d8d47cfd364 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5d9876e340d940a7a27ae2b81024b37c)` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:55:06.589349 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b31922-1c7a-447b-8c00-8d8d47cfd364 admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:55:06.636412 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-47b31922-1c7a-447b-8c00-8d8d47cfd364 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5d9876e340d940a7a27ae2b81024b37c', 'request_id': 'req-47b31922-1c7a-447b-8c00-8d8d47cfd364'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:55:06.644092 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-47b31922-1c7a-447b-8c00-8d8d47cfd364 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5d9876e340d940a7a27ae2b81024b37c', 'request_id': 'req-47b31922-1c7a-447b-8c00-8d8d47cfd364'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:55:06.650524 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-47b31922-1c7a-447b-8c00-8d8d47cfd364 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5d9876e340d940a7a27ae2b81024b37c', 'request_id': 'req-47b31922-1c7a-447b-8c00-8d8d47cfd364'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:55:06.660731 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-47b31922-1c7a-447b-8c00-8d8d47cfd364 admin admin] The token cache is being invalidate because project 5d9876e340d940a7a27ae2b81024b37c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87956) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 00:55:06.661014 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-47b31922-1c7a-447b-8c00-8d8d47cfd364 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:55:06.661631 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-47b31922-1c7a-447b-8c00-8d8d47cfd364 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:55:06.663117 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 1164/2315] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 30 00:55:06 2022] DELETE /identity/v3/projects/5d9876e340d940a7a27ae2b81024b37c => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 00:55:13.044432 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a00c946-789b-48ea-a6c5-cac2600508c6 service neutron] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:55:13.046053 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-5a00c946-789b-48ea-a6c5-cac2600508c6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:55:13.059929 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a00c946-789b-48ea-a6c5-cac2600508c6 service neutron] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:55:13.079918 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:55:13.120658 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2b7c89-0d9f-4625-993b-ea9629a6fa2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:55:13.121279 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2b7c89-0d9f-4625-993b-ea9629a6fa2f admin admin] REQUEST_METHOD: `DELETE` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:55:13.121550 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2b7c89-0d9f-4625-993b-ea9629a6fa2f admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:55:13.121816 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2b7c89-0d9f-4625-993b-ea9629a6fa2f admin admin] PATH_INFO: `/v3/users/70d3e2d15c0a420aa2ef72e9fcc6bd35` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:55:13.122994 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2b7c89-0d9f-4625-993b-ea9629a6fa2f admin admin] RBAC: Authorizing `identity:delete_user(user_id=70d3e2d15c0a420aa2ef72e9fcc6bd35)` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:55:13.124921 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2b7c89-0d9f-4625-993b-ea9629a6fa2f admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:55:13.171258 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-2e2b7c89-0d9f-4625-993b-ea9629a6fa2f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '70d3e2d15c0a420aa2ef72e9fcc6bd35'} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:55:13.171812 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-2e2b7c89-0d9f-4625-993b-ea9629a6fa2f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '70d3e2d15c0a420aa2ef72e9fcc6bd35'} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:55:13.178948 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-2e2b7c89-0d9f-4625-993b-ea9629a6fa2f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '70d3e2d15c0a420aa2ef72e9fcc6bd35'} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:55:13.179615 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-2e2b7c89-0d9f-4625-993b-ea9629a6fa2f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '70d3e2d15c0a420aa2ef72e9fcc6bd35'} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:55:13.191731 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-2e2b7c89-0d9f-4625-993b-ea9629a6fa2f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '70d3e2d15c0a420aa2ef72e9fcc6bd35'} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:55:13.205586 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 1152/2316] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 30 00:55:13 2022] DELETE /identity/v3/users/70d3e2d15c0a420aa2ef72e9fcc6bd35 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 00:55:13.210117 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8ac11c-0e27-4a1a-8bf3-963c70c20d56 None None] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:55:13.210618 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8ac11c-0e27-4a1a-8bf3-963c70c20d56 None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:55:13.210731 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8ac11c-0e27-4a1a-8bf3-963c70c20d56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:55:13.230797 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.auth.core [None req-6a8ac11c-0e27-4a1a-8bf3-963c70c20d56 None None] MFA Rules not processed for user `eb55b6cbca4945abb21b0e49eb745e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=87956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:55:13.232047 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-6a8ac11c-0e27-4a1a-8bf3-963c70c20d56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:55:13.298057 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 1165/2317] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 30 00:55:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:55:13.308145 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2b7c89-0d9f-4625-993b-ea9629a6fa2f admin admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:55:13.309834 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-2e2b7c89-0d9f-4625-993b-ea9629a6fa2f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:55:13.368001 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2b7c89-0d9f-4625-993b-ea9629a6fa2f admin admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:55:13.371991 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26304e1-ba04-4afd-b9be-2a330925c390 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5693f186c6ad4d9394f02ee3477cdcd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d2387fdf794d4eaef07bbcd7b39f2a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:55:13.372579 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26304e1-ba04-4afd-b9be-2a330925c390 service neutron] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:55:13.372867 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26304e1-ba04-4afd-b9be-2a330925c390 service neutron] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:55:13.373133 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26304e1-ba04-4afd-b9be-2a330925c390 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:55:13.382254 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26304e1-ba04-4afd-b9be-2a330925c390 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:55:13.383709 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26304e1-ba04-4afd-b9be-2a330925c390 service neutron] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:55:13.393390 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 1153/2318] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 30 00:55:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 00:55:13.669395 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8ac11c-0e27-4a1a-8bf3-963c70c20d56 None None] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:55:13.670947 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-6a8ac11c-0e27-4a1a-8bf3-963c70c20d56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:55:13.687159 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8ac11c-0e27-4a1a-8bf3-963c70c20d56 None None] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:55:13.692181 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7427ce-c8ea-4cd9-a25d-5b825402956a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:55:13.692948 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7427ce-c8ea-4cd9-a25d-5b825402956a admin admin] REQUEST_METHOD: `DELETE` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:55:13.693258 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7427ce-c8ea-4cd9-a25d-5b825402956a admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:55:13.693538 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7427ce-c8ea-4cd9-a25d-5b825402956a admin admin] PATH_INFO: `/v3/projects/0122176ef42a4df1b3a06fb28389c996` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:55:13.694755 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7427ce-c8ea-4cd9-a25d-5b825402956a admin admin] RBAC: Authorizing `identity:delete_project(project_id=0122176ef42a4df1b3a06fb28389c996)` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:55:13.696980 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7427ce-c8ea-4cd9-a25d-5b825402956a admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:55:13.722617 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:55:13.745516 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-cf7427ce-c8ea-4cd9-a25d-5b825402956a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0122176ef42a4df1b3a06fb28389c996', 'request_id': 'req-cf7427ce-c8ea-4cd9-a25d-5b825402956a'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:55:13.753913 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-cf7427ce-c8ea-4cd9-a25d-5b825402956a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0122176ef42a4df1b3a06fb28389c996', 'request_id': 'req-cf7427ce-c8ea-4cd9-a25d-5b825402956a'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:55:13.760701 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-cf7427ce-c8ea-4cd9-a25d-5b825402956a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0122176ef42a4df1b3a06fb28389c996', 'request_id': 'req-cf7427ce-c8ea-4cd9-a25d-5b825402956a'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:55:13.773484 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-cf7427ce-c8ea-4cd9-a25d-5b825402956a admin admin] The token cache is being invalidate because project 0122176ef42a4df1b3a06fb28389c996 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87956) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 00:55:13.773777 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-cf7427ce-c8ea-4cd9-a25d-5b825402956a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:55:13.774496 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-cf7427ce-c8ea-4cd9-a25d-5b825402956a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:55:13.776168 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 1166/2319] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 30 00:55:13 2022] DELETE /identity/v3/projects/0122176ef42a4df1b3a06fb28389c996 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 00:55:13.780552 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26304e1-ba04-4afd-b9be-2a330925c390 service neutron] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:55:13.791820 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26304e1-ba04-4afd-b9be-2a330925c390 service neutron] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:55:13.837016 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:55:13.858343 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3d7e49-4ed5-44de-b608-dcc88673b493 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:55:13.859052 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3d7e49-4ed5-44de-b608-dcc88673b493 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:55:13.859412 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3d7e49-4ed5-44de-b608-dcc88673b493 admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:55:13.859734 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3d7e49-4ed5-44de-b608-dcc88673b493 admin admin] PATH_INFO: `/v3/users/51fa80e67da444f7832d2701930af9ec` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:55:13.860973 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3d7e49-4ed5-44de-b608-dcc88673b493 admin admin] RBAC: Authorizing `identity:delete_user(user_id=51fa80e67da444f7832d2701930af9ec)` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:55:13.862917 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3d7e49-4ed5-44de-b608-dcc88673b493 admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:55:13.911019 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-fe3d7e49-4ed5-44de-b608-dcc88673b493 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '51fa80e67da444f7832d2701930af9ec'} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:55:13.911676 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-fe3d7e49-4ed5-44de-b608-dcc88673b493 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '51fa80e67da444f7832d2701930af9ec'} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:55:13.918616 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-fe3d7e49-4ed5-44de-b608-dcc88673b493 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '51fa80e67da444f7832d2701930af9ec'} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:55:13.919310 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-fe3d7e49-4ed5-44de-b608-dcc88673b493 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '51fa80e67da444f7832d2701930af9ec'} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:55:13.933979 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-fe3d7e49-4ed5-44de-b608-dcc88673b493 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '51fa80e67da444f7832d2701930af9ec'} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:55:13.950442 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 1154/2320] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 30 00:55:13 2022] DELETE /identity/v3/users/51fa80e67da444f7832d2701930af9ec => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 00:55:14.240803 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7427ce-c8ea-4cd9-a25d-5b825402956a admin admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:55:14.242355 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-cf7427ce-c8ea-4cd9-a25d-5b825402956a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:55:14.259947 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7427ce-c8ea-4cd9-a25d-5b825402956a admin admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:55:14.320105 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b6277c-f4aa-42b2-87d3-ce7464793f1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:55:14.320733 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b6277c-f4aa-42b2-87d3-ce7464793f1b admin admin] REQUEST_METHOD: `DELETE` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:55:14.321007 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b6277c-f4aa-42b2-87d3-ce7464793f1b admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:55:14.321272 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b6277c-f4aa-42b2-87d3-ce7464793f1b admin admin] PATH_INFO: `/v3/projects/16d0b5e16e8345d192c0d39ae17971bf` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:55:14.322421 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b6277c-f4aa-42b2-87d3-ce7464793f1b admin admin] RBAC: Authorizing `identity:delete_project(project_id=16d0b5e16e8345d192c0d39ae17971bf)` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:55:14.324667 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b6277c-f4aa-42b2-87d3-ce7464793f1b admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:55:14.379342 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-a0b6277c-f4aa-42b2-87d3-ce7464793f1b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '16d0b5e16e8345d192c0d39ae17971bf', 'request_id': 'req-a0b6277c-f4aa-42b2-87d3-ce7464793f1b'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:55:14.389184 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-a0b6277c-f4aa-42b2-87d3-ce7464793f1b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '16d0b5e16e8345d192c0d39ae17971bf', 'request_id': 'req-a0b6277c-f4aa-42b2-87d3-ce7464793f1b'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:55:14.399676 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-a0b6277c-f4aa-42b2-87d3-ce7464793f1b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '16d0b5e16e8345d192c0d39ae17971bf', 'request_id': 'req-a0b6277c-f4aa-42b2-87d3-ce7464793f1b'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:55:14.411791 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-a0b6277c-f4aa-42b2-87d3-ce7464793f1b admin admin] The token cache is being invalidate because project 16d0b5e16e8345d192c0d39ae17971bf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87956) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 00:55:14.412069 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-a0b6277c-f4aa-42b2-87d3-ce7464793f1b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:55:14.412715 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-a0b6277c-f4aa-42b2-87d3-ce7464793f1b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:55:14.414179 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 1167/2321] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 30 00:55:14 2022] DELETE /identity/v3/projects/16d0b5e16e8345d192c0d39ae17971bf => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 00:55:14.419101 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a80662-b4a5-4257-9f49-3d7c7dc4fdfb None None] REQUEST_METHOD: `POST` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:55:14.419590 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a80662-b4a5-4257-9f49-3d7c7dc4fdfb None None] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:55:14.419702 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a80662-b4a5-4257-9f49-3d7c7dc4fdfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:55:14.440064 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.auth.core [None req-22a80662-b4a5-4257-9f49-3d7c7dc4fdfb None None] MFA Rules not processed for user `eb55b6cbca4945abb21b0e49eb745e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=87955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:55:14.441291 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-22a80662-b4a5-4257-9f49-3d7c7dc4fdfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:55:14.511510 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 1155/2322] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 30 00:55:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:55:14.513146 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc21df44-05c8-4e75-a8b6-18209fa7cd8d None None] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:55:14.513434 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc21df44-05c8-4e75-a8b6-18209fa7cd8d None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:55:14.513790 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc21df44-05c8-4e75-a8b6-18209fa7cd8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:55:14.535072 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.auth.core [None req-cc21df44-05c8-4e75-a8b6-18209fa7cd8d None None] MFA Rules not processed for user `eb55b6cbca4945abb21b0e49eb745e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=87956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:55:14.536392 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-cc21df44-05c8-4e75-a8b6-18209fa7cd8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:55:14.544501 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 1168/2323] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 30 00:55:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:55:14.549017 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a80662-b4a5-4257-9f49-3d7c7dc4fdfb None None] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:55:14.559096 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a80662-b4a5-4257-9f49-3d7c7dc4fdfb None None] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:55:14.564490 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a592391-a6da-49b8-ab60-c8926ee1dd02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:55:14.565123 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a592391-a6da-49b8-ab60-c8926ee1dd02 admin admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:55:14.565395 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a592391-a6da-49b8-ab60-c8926ee1dd02 admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:55:14.565661 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a592391-a6da-49b8-ab60-c8926ee1dd02 admin admin] PATH_INFO: `/v3/domains` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:55:14.566330 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a592391-a6da-49b8-ab60-c8926ee1dd02 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:55:14.566648 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a592391-a6da-49b8-ab60-c8926ee1dd02 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:55:14.568327 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a592391-a6da-49b8-ab60-c8926ee1dd02 admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:55:14.580847 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 1156/2324] 10.222.0.42 () {58 vars in 1153 bytes} [Sun Oct 30 00:55:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:55:14.585230 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc21df44-05c8-4e75-a8b6-18209fa7cd8d None None] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:55:14.594950 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc21df44-05c8-4e75-a8b6-18209fa7cd8d None None] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:55:14.599959 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc1e4ec-0f10-4e51-872e-7c5478553379 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:55:14.600555 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc1e4ec-0f10-4e51-872e-7c5478553379 admin admin] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:55:14.600824 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc1e4ec-0f10-4e51-872e-7c5478553379 admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:55:14.601086 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc1e4ec-0f10-4e51-872e-7c5478553379 admin admin] PATH_INFO: `/v3/projects` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:55:14.601717 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc1e4ec-0f10-4e51-872e-7c5478553379 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:55:14.603636 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc1e4ec-0f10-4e51-872e-7c5478553379 admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:55:14.631872 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 1169/2325] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 30 00:55:14 2022] POST /identity/v3/projects => generated 373 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 00:55:14.636186 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a592391-a6da-49b8-ab60-c8926ee1dd02 admin admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:55:14.646514 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a592391-a6da-49b8-ab60-c8926ee1dd02 admin admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:55:14.694957 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:55:14.707330 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343355ac-14a2-4965-af5a-d3af93fee84f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:55:14.707940 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343355ac-14a2-4965-af5a-d3af93fee84f admin admin] REQUEST_METHOD: `POST` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:55:14.708217 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343355ac-14a2-4965-af5a-d3af93fee84f admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:55:14.708490 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343355ac-14a2-4965-af5a-d3af93fee84f admin admin] PATH_INFO: `/v3/users` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:55:14.709120 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343355ac-14a2-4965-af5a-d3af93fee84f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:55:14.711039 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343355ac-14a2-4965-af5a-d3af93fee84f admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:55:14.735778 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 1157/2326] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 30 00:55:14 2022] POST /identity/v3/users => generated 287 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 00:55:14.740211 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc1e4ec-0f10-4e51-872e-7c5478553379 admin admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:55:14.750490 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc1e4ec-0f10-4e51-872e-7c5478553379 admin admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:55:14.755405 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525a5c54-946d-47f2-ad69-8bfa4472cace admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:55:14.755994 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525a5c54-946d-47f2-ad69-8bfa4472cace admin admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:55:14.756265 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525a5c54-946d-47f2-ad69-8bfa4472cace admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:55:14.756530 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525a5c54-946d-47f2-ad69-8bfa4472cace admin admin] PATH_INFO: `/v3/roles` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:55:14.757166 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525a5c54-946d-47f2-ad69-8bfa4472cace admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:55:14.758738 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525a5c54-946d-47f2-ad69-8bfa4472cace admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:55:14.768682 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 1170/2327] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 30 00:55:14 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 00:55:14.772613 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343355ac-14a2-4965-af5a-d3af93fee84f admin admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:55:14.782450 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343355ac-14a2-4965-af5a-d3af93fee84f admin admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:55:14.787331 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc4f4d7-58fb-415e-956b-79955232208d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:55:14.787918 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc4f4d7-58fb-415e-956b-79955232208d admin admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:55:14.788188 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc4f4d7-58fb-415e-956b-79955232208d admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:55:14.788580 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc4f4d7-58fb-415e-956b-79955232208d admin admin] PATH_INFO: `/v3/roles` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:55:14.789209 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc4f4d7-58fb-415e-956b-79955232208d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:55:14.790815 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc4f4d7-58fb-415e-956b-79955232208d admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:55:14.801651 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 1158/2328] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 30 00:55:14 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 00:55:14.805782 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525a5c54-946d-47f2-ad69-8bfa4472cace admin admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:55:14.810918 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=84,keystone:DELETE=13,keystone:INSERT=3 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:55:14.816966 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525a5c54-946d-47f2-ad69-8bfa4472cace admin admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:55:14.822776 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3947d5da-9dc4-44b7-8109-7544f548d77e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:55:14.823966 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3947d5da-9dc4-44b7-8109-7544f548d77e admin admin] REQUEST_METHOD: `PUT` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:55:14.824226 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3947d5da-9dc4-44b7-8109-7544f548d77e admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:55:14.824494 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3947d5da-9dc4-44b7-8109-7544f548d77e admin admin] PATH_INFO: `/v3/projects/cb93d969334a40db97d7c1d2980a0c46/users/0dda68ecca25426fa49d574da075c66c/roles/1c93019874174c4b91118d9ce2347e47` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:55:14.839846 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3947d5da-9dc4-44b7-8109-7544f548d77e admin admin] RBAC: Authorizing `identity:create_grant(project_id=cb93d969334a40db97d7c1d2980a0c46, user_id=0dda68ecca25426fa49d574da075c66c, role_id=1c93019874174c4b91118d9ce2347e47)` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:55:14.842494 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3947d5da-9dc4-44b7-8109-7544f548d77e admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:55:14.857544 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 1171/2329] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 30 00:55:14 2022] PUT /identity/v3/projects/cb93d969334a40db97d7c1d2980a0c46/users/0dda68ecca25426fa49d574da075c66c/roles/1c93019874174c4b91118d9ce2347e47 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 00:55:14.862552 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187f2c4d-8b4f-4477-bec2-60bce1cc0950 None None] REQUEST_METHOD: `POST` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:55:14.862834 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187f2c4d-8b4f-4477-bec2-60bce1cc0950 None None] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:55:14.863103 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187f2c4d-8b4f-4477-bec2-60bce1cc0950 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:55:14.882605 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.auth.core [None req-187f2c4d-8b4f-4477-bec2-60bce1cc0950 None None] MFA Rules not processed for user `eb55b6cbca4945abb21b0e49eb745e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=87955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:55:14.883835 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-187f2c4d-8b4f-4477-bec2-60bce1cc0950 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:55:14.946234 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 1159/2330] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 30 00:55:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:55:14.956645 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3947d5da-9dc4-44b7-8109-7544f548d77e admin admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:55:14.958467 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-3947d5da-9dc4-44b7-8109-7544f548d77e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:55:15.016173 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3947d5da-9dc4-44b7-8109-7544f548d77e admin admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:55:15.020590 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a43cde-45b4-407a-bde8-aa23799d81f2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5693f186c6ad4d9394f02ee3477cdcd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d2387fdf794d4eaef07bbcd7b39f2a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:55:15.021138 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a43cde-45b4-407a-bde8-aa23799d81f2 service neutron] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:55:15.021415 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a43cde-45b4-407a-bde8-aa23799d81f2 service neutron] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:55:15.021685 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a43cde-45b4-407a-bde8-aa23799d81f2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:55:15.031475 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a43cde-45b4-407a-bde8-aa23799d81f2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:55:15.032910 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a43cde-45b4-407a-bde8-aa23799d81f2 service neutron] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:55:15.042955 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 1172/2331] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 30 00:55:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 00:55:15.995144 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1caf9d4-7e3c-4144-aa15-d307bf4d68b0 None None] REQUEST_METHOD: `POST` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:55:15.995699 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1caf9d4-7e3c-4144-aa15-d307bf4d68b0 None None] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:55:15.995823 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1caf9d4-7e3c-4144-aa15-d307bf4d68b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:55:16.023861 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.auth.core [None req-b1caf9d4-7e3c-4144-aa15-d307bf4d68b0 None None] MFA Rules not processed for user `0dda68ecca25426fa49d574da075c66c`. Rule list: `[]` (Enabled: `True`). {{(pid=87955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:55:16.025198 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-b1caf9d4-7e3c-4144-aa15-d307bf4d68b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:55:16.100677 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 1160/2332] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 30 00:55:15 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:55:16.105199 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a43cde-45b4-407a-bde8-aa23799d81f2 service neutron] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:55:16.115208 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a43cde-45b4-407a-bde8-aa23799d81f2 service neutron] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:55:16.120033 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff976beb-6449-4bf6-9073-8716dd7bac69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:55:16.120673 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff976beb-6449-4bf6-9073-8716dd7bac69 admin admin] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:55:16.120952 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff976beb-6449-4bf6-9073-8716dd7bac69 admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:55:16.121226 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff976beb-6449-4bf6-9073-8716dd7bac69 admin admin] PATH_INFO: `/v3/projects` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:55:16.121868 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff976beb-6449-4bf6-9073-8716dd7bac69 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:55:16.123806 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff976beb-6449-4bf6-9073-8716dd7bac69 admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:55:16.157895 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 1173/2333] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 30 00:55:16 2022] POST /identity/v3/projects => generated 373 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 00:55:16.159388 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1caf9d4-7e3c-4144-aa15-d307bf4d68b0 None None] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:55:16.171402 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1caf9d4-7e3c-4144-aa15-d307bf4d68b0 None None] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:55:16.229540 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2156100-328d-40cc-9733-8d88f457f1f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:55:16.230146 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2156100-328d-40cc-9733-8d88f457f1f0 admin admin] REQUEST_METHOD: `POST` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:55:16.230417 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2156100-328d-40cc-9733-8d88f457f1f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:55:16.230675 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2156100-328d-40cc-9733-8d88f457f1f0 admin admin] PATH_INFO: `/v3/users` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:55:16.231347 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2156100-328d-40cc-9733-8d88f457f1f0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:55:16.233254 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2156100-328d-40cc-9733-8d88f457f1f0 admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:55:16.241174 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:55:16.259246 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 1161/2334] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 30 00:55:16 2022] POST /identity/v3/users => generated 293 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 00:55:16.261229 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff976beb-6449-4bf6-9073-8716dd7bac69 admin admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:55:16.271535 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff976beb-6449-4bf6-9073-8716dd7bac69 admin admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:55:16.275997 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fc69b1-245e-41f2-940d-57bfc5931f65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:55:16.276613 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fc69b1-245e-41f2-940d-57bfc5931f65 admin admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:55:16.276886 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fc69b1-245e-41f2-940d-57bfc5931f65 admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:55:16.277149 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fc69b1-245e-41f2-940d-57bfc5931f65 admin admin] PATH_INFO: `/v3/roles` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:55:16.277784 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3fc69b1-245e-41f2-940d-57bfc5931f65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:55:16.279402 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3fc69b1-245e-41f2-940d-57bfc5931f65 admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:55:16.289955 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 1174/2335] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 30 00:55:16 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 00:55:16.294587 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2156100-328d-40cc-9733-8d88f457f1f0 admin admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:55:16.305306 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2156100-328d-40cc-9733-8d88f457f1f0 admin admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:55:16.310273 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8628e368-d236-4f17-8d3b-9f20782a2e47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:55:16.310906 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8628e368-d236-4f17-8d3b-9f20782a2e47 admin admin] REQUEST_METHOD: `PUT` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:55:16.311181 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8628e368-d236-4f17-8d3b-9f20782a2e47 admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:55:16.311488 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8628e368-d236-4f17-8d3b-9f20782a2e47 admin admin] PATH_INFO: `/v3/projects/867922bad4614e57970f52eac4905418/users/0696fdf849c340f2a2697c48ca6ebf0d/roles/6ccaa8c11f29456fb4e4eeccb21616c7` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:55:16.327557 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8628e368-d236-4f17-8d3b-9f20782a2e47 admin admin] RBAC: Authorizing `identity:create_grant(project_id=867922bad4614e57970f52eac4905418, user_id=0696fdf849c340f2a2697c48ca6ebf0d, role_id=6ccaa8c11f29456fb4e4eeccb21616c7)` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:55:16.330302 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8628e368-d236-4f17-8d3b-9f20782a2e47 admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:55:16.344603 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 1162/2336] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 30 00:55:16 2022] PUT /identity/v3/projects/867922bad4614e57970f52eac4905418/users/0696fdf849c340f2a2697c48ca6ebf0d/roles/6ccaa8c11f29456fb4e4eeccb21616c7 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 00:55:16.348682 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fc69b1-245e-41f2-940d-57bfc5931f65 admin admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:55:16.358947 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fc69b1-245e-41f2-940d-57bfc5931f65 admin admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:55:16.417920 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c97b87-f29b-46e2-b423-5f828dbe9bd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:55:16.418584 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c97b87-f29b-46e2-b423-5f828dbe9bd6 admin admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:55:16.418917 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c97b87-f29b-46e2-b423-5f828dbe9bd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:55:16.419134 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c97b87-f29b-46e2-b423-5f828dbe9bd6 admin admin] PATH_INFO: `/v3/roles` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:55:16.419813 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c97b87-f29b-46e2-b423-5f828dbe9bd6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:55:16.421599 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c97b87-f29b-46e2-b423-5f828dbe9bd6 admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:55:16.431902 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 1175/2337] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 30 00:55:16 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 00:55:16.436277 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8628e368-d236-4f17-8d3b-9f20782a2e47 admin admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:55:16.446650 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8628e368-d236-4f17-8d3b-9f20782a2e47 admin admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:55:16.451896 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cb9eb7-4ac9-42cd-9d06-1aa93ff11fef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:55:16.452536 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cb9eb7-4ac9-42cd-9d06-1aa93ff11fef admin admin] REQUEST_METHOD: `PUT` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:55:16.452839 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cb9eb7-4ac9-42cd-9d06-1aa93ff11fef admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:55:16.453112 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cb9eb7-4ac9-42cd-9d06-1aa93ff11fef admin admin] PATH_INFO: `/v3/projects/867922bad4614e57970f52eac4905418/users/0696fdf849c340f2a2697c48ca6ebf0d/roles/6ccaa8c11f29456fb4e4eeccb21616c7` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:55:16.455071 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10cb9eb7-4ac9-42cd-9d06-1aa93ff11fef admin admin] RBAC: Authorizing `identity:create_grant(project_id=867922bad4614e57970f52eac4905418, user_id=0696fdf849c340f2a2697c48ca6ebf0d, role_id=6ccaa8c11f29456fb4e4eeccb21616c7)` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:55:16.457766 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10cb9eb7-4ac9-42cd-9d06-1aa93ff11fef admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:55:16.468201 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 1163/2338] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 30 00:55:16 2022] PUT /identity/v3/projects/867922bad4614e57970f52eac4905418/users/0696fdf849c340f2a2697c48ca6ebf0d/roles/6ccaa8c11f29456fb4e4eeccb21616c7 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 00:55:17.170757 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bdb4f5-450a-438e-acb3-b6d8dd417da5 None None] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:55:17.171317 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bdb4f5-450a-438e-acb3-b6d8dd417da5 None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:55:17.171317 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bdb4f5-450a-438e-acb3-b6d8dd417da5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:55:17.202031 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.auth.core [None req-55bdb4f5-450a-438e-acb3-b6d8dd417da5 None None] MFA Rules not processed for user `0696fdf849c340f2a2697c48ca6ebf0d`. Rule list: `[]` (Enabled: `True`). {{(pid=87956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:55:17.203215 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-55bdb4f5-450a-438e-acb3-b6d8dd417da5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:55:17.237334 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:55:17.282168 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 1176/2339] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 30 00:55:17 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:55:17.292855 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84ed07a-4a1f-4fc8-8529-e66d02ec76fc None None] REQUEST_METHOD: `POST` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:55:17.293349 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84ed07a-4a1f-4fc8-8529-e66d02ec76fc None None] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:55:17.293349 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84ed07a-4a1f-4fc8-8529-e66d02ec76fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:55:17.312894 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.auth.core [None req-b84ed07a-4a1f-4fc8-8529-e66d02ec76fc None None] MFA Rules not processed for user `0dda68ecca25426fa49d574da075c66c`. Rule list: `[]` (Enabled: `True`). {{(pid=87955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:55:17.314160 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-b84ed07a-4a1f-4fc8-8529-e66d02ec76fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:55:17.369674 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 1164/2340] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 30 00:55:17 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 30 00:55:17.381250 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bdb4f5-450a-438e-acb3-b6d8dd417da5 None None] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:55:17.382967 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-55bdb4f5-450a-438e-acb3-b6d8dd417da5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:55:17.463349 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bdb4f5-450a-438e-acb3-b6d8dd417da5 None None] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:55:17.470511 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2c9269-e625-4f3b-8f3e-f31133ac4648 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fde877b6ddc74f4a87baf21471eb31d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d2387fdf794d4eaef07bbcd7b39f2a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:55:17.471116 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2c9269-e625-4f3b-8f3e-f31133ac4648 service nova] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:55:17.471426 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2c9269-e625-4f3b-8f3e-f31133ac4648 service nova] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:55:17.471700 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2c9269-e625-4f3b-8f3e-f31133ac4648 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:55:17.479818 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2c9269-e625-4f3b-8f3e-f31133ac4648 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:55:17.481403 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2c9269-e625-4f3b-8f3e-f31133ac4648 service nova] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:55:17.490538 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 1177/2341] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 30 00:55:17 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 00:55:17.728224 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84ed07a-4a1f-4fc8-8529-e66d02ec76fc None None] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:55:17.783453 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84ed07a-4a1f-4fc8-8529-e66d02ec76fc None None] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:55:17.787424 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe82204-ecfd-4ce5-a5f6-f99d5998122e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5693f186c6ad4d9394f02ee3477cdcd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d2387fdf794d4eaef07bbcd7b39f2a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:55:17.788014 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe82204-ecfd-4ce5-a5f6-f99d5998122e service neutron] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:55:17.788283 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe82204-ecfd-4ce5-a5f6-f99d5998122e service neutron] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:55:17.788550 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe82204-ecfd-4ce5-a5f6-f99d5998122e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:55:17.791596 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-3fe82204-ecfd-4ce5-a5f6-f99d5998122e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:55:17.802679 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe82204-ecfd-4ce5-a5f6-f99d5998122e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:55:17.804147 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe82204-ecfd-4ce5-a5f6-f99d5998122e service neutron] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:55:17.812624 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 1165/2342] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 30 00:55:17 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 00:55:27.486983 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=48 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:55:27.809751 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:INSERT=5,keystone:SELECT=68 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:55:29.426654 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2c9269-e625-4f3b-8f3e-f31133ac4648 service nova] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:55:29.428088 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-ce2c9269-e625-4f3b-8f3e-f31133ac4648 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:55:29.485882 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2c9269-e625-4f3b-8f3e-f31133ac4648 service nova] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:55:29.489715 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebff54e2-5909-4ebc-8db8-22f6dd5f93fd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48d928ff7fe24348ac900f09c56acc20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d2387fdf794d4eaef07bbcd7b39f2a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:55:29.490323 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebff54e2-5909-4ebc-8db8-22f6dd5f93fd service cinder] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:55:29.490602 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebff54e2-5909-4ebc-8db8-22f6dd5f93fd service cinder] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:55:29.490870 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebff54e2-5909-4ebc-8db8-22f6dd5f93fd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:55:29.500475 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebff54e2-5909-4ebc-8db8-22f6dd5f93fd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:55:29.501916 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebff54e2-5909-4ebc-8db8-22f6dd5f93fd service cinder] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:55:29.512429 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 1178/2343] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 30 00:55:29 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 00:55:39.507725 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=26 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:55:49.393456 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe82204-ecfd-4ce5-a5f6-f99d5998122e service neutron] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:55:49.394907 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-3fe82204-ecfd-4ce5-a5f6-f99d5998122e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:55:49.450420 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebff54e2-5909-4ebc-8db8-22f6dd5f93fd service cinder] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:55:49.468733 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe82204-ecfd-4ce5-a5f6-f99d5998122e service neutron] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:55:49.473813 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c1f37e-4b70-4171-b15e-d55c76fabf27 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '202b8b2c0f454297bfb97c1ac4033625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d2387fdf794d4eaef07bbcd7b39f2a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:55:49.474416 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c1f37e-4b70-4171-b15e-d55c76fabf27 service placement] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:55:49.474689 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c1f37e-4b70-4171-b15e-d55c76fabf27 service placement] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:55:49.474954 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c1f37e-4b70-4171-b15e-d55c76fabf27 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:55:49.476769 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-04c1f37e-4b70-4171-b15e-d55c76fabf27 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:55:49.488137 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c1f37e-4b70-4171-b15e-d55c76fabf27 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:55:49.489700 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c1f37e-4b70-4171-b15e-d55c76fabf27 service placement] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:55:49.499670 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 1166/2344] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 30 00:55:49 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 00:55:49.518402 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebff54e2-5909-4ebc-8db8-22f6dd5f93fd service cinder] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:55:49.522847 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bf2242-8a14-4a8d-82b4-af03f69c8f17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:55:49.523510 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bf2242-8a14-4a8d-82b4-af03f69c8f17 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:55:49.523783 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bf2242-8a14-4a8d-82b4-af03f69c8f17 admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:55:49.524045 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bf2242-8a14-4a8d-82b4-af03f69c8f17 admin admin] PATH_INFO: `/v3/users/0dda68ecca25426fa49d574da075c66c` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:55:49.525138 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8bf2242-8a14-4a8d-82b4-af03f69c8f17 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0dda68ecca25426fa49d574da075c66c)` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:55:49.527117 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8bf2242-8a14-4a8d-82b4-af03f69c8f17 admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:55:49.574061 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-a8bf2242-8a14-4a8d-82b4-af03f69c8f17 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0dda68ecca25426fa49d574da075c66c'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:55:49.574692 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-a8bf2242-8a14-4a8d-82b4-af03f69c8f17 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0dda68ecca25426fa49d574da075c66c'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:55:49.587308 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-a8bf2242-8a14-4a8d-82b4-af03f69c8f17 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0dda68ecca25426fa49d574da075c66c'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:55:49.595011 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-a8bf2242-8a14-4a8d-82b4-af03f69c8f17 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0dda68ecca25426fa49d574da075c66c'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:55:49.601923 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-a8bf2242-8a14-4a8d-82b4-af03f69c8f17 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0dda68ecca25426fa49d574da075c66c'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:55:49.607730 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 1179/2345] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 30 00:55:49 2022] DELETE /identity/v3/users/0dda68ecca25426fa49d574da075c66c => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 00:55:49.792502 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c1f37e-4b70-4171-b15e-d55c76fabf27 service placement] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:55:49.803832 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c1f37e-4b70-4171-b15e-d55c76fabf27 service placement] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:55:49.863403 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0f7988-c444-4b2c-91d7-c02942cf428a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:55:49.864030 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0f7988-c444-4b2c-91d7-c02942cf428a admin admin] REQUEST_METHOD: `DELETE` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:55:49.864307 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0f7988-c444-4b2c-91d7-c02942cf428a admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:55:49.864577 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0f7988-c444-4b2c-91d7-c02942cf428a admin admin] PATH_INFO: `/v3/projects/cb93d969334a40db97d7c1d2980a0c46` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:55:49.865693 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0f7988-c444-4b2c-91d7-c02942cf428a admin admin] RBAC: Authorizing `identity:delete_project(project_id=cb93d969334a40db97d7c1d2980a0c46)` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:55:49.867632 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0f7988-c444-4b2c-91d7-c02942cf428a admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:55:49.912857 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-ce0f7988-c444-4b2c-91d7-c02942cf428a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cb93d969334a40db97d7c1d2980a0c46', 'request_id': 'req-ce0f7988-c444-4b2c-91d7-c02942cf428a'} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:55:49.918155 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-ce0f7988-c444-4b2c-91d7-c02942cf428a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cb93d969334a40db97d7c1d2980a0c46', 'request_id': 'req-ce0f7988-c444-4b2c-91d7-c02942cf428a'} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:55:49.926217 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-ce0f7988-c444-4b2c-91d7-c02942cf428a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cb93d969334a40db97d7c1d2980a0c46', 'request_id': 'req-ce0f7988-c444-4b2c-91d7-c02942cf428a'} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:55:49.937773 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-ce0f7988-c444-4b2c-91d7-c02942cf428a admin admin] The token cache is being invalidate because project cb93d969334a40db97d7c1d2980a0c46 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87955) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 00:55:49.938081 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-ce0f7988-c444-4b2c-91d7-c02942cf428a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:55:49.938760 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-ce0f7988-c444-4b2c-91d7-c02942cf428a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:55:49.940351 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 1167/2346] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 30 00:55:49 2022] DELETE /identity/v3/projects/cb93d969334a40db97d7c1d2980a0c46 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 00:55:49.944614 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bf2242-8a14-4a8d-82b4-af03f69c8f17 admin admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:55:49.946121 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-a8bf2242-8a14-4a8d-82b4-af03f69c8f17 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:55:49.960150 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bf2242-8a14-4a8d-82b4-af03f69c8f17 admin admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:55:50.016352 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d142bd80-2edc-4ab2-a96b-bca1c4ce7843 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:55:50.016984 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d142bd80-2edc-4ab2-a96b-bca1c4ce7843 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:55:50.017254 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d142bd80-2edc-4ab2-a96b-bca1c4ce7843 admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:55:50.017530 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d142bd80-2edc-4ab2-a96b-bca1c4ce7843 admin admin] PATH_INFO: `/v3/users/0696fdf849c340f2a2697c48ca6ebf0d` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:55:50.018672 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d142bd80-2edc-4ab2-a96b-bca1c4ce7843 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0696fdf849c340f2a2697c48ca6ebf0d)` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:55:50.020631 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d142bd80-2edc-4ab2-a96b-bca1c4ce7843 admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:55:50.041986 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:55:50.074975 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-d142bd80-2edc-4ab2-a96b-bca1c4ce7843 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0696fdf849c340f2a2697c48ca6ebf0d'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:55:50.075729 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-d142bd80-2edc-4ab2-a96b-bca1c4ce7843 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0696fdf849c340f2a2697c48ca6ebf0d'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:55:50.088767 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-d142bd80-2edc-4ab2-a96b-bca1c4ce7843 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0696fdf849c340f2a2697c48ca6ebf0d'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:55:50.097131 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-d142bd80-2edc-4ab2-a96b-bca1c4ce7843 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0696fdf849c340f2a2697c48ca6ebf0d'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:55:50.104128 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-d142bd80-2edc-4ab2-a96b-bca1c4ce7843 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0696fdf849c340f2a2697c48ca6ebf0d'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:55:50.109959 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 1180/2347] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 30 00:55:49 2022] DELETE /identity/v3/users/0696fdf849c340f2a2697c48ca6ebf0d => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 00:55:50.311989 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0f7988-c444-4b2c-91d7-c02942cf428a admin admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:55:50.313444 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-ce0f7988-c444-4b2c-91d7-c02942cf428a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:55:50.326722 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0f7988-c444-4b2c-91d7-c02942cf428a admin admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:55:50.344228 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:55:50.404506 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c2db3d-baff-48c1-980d-150c2908f2cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:55:50.405219 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c2db3d-baff-48c1-980d-150c2908f2cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:55:50.405419 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c2db3d-baff-48c1-980d-150c2908f2cc admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:55:50.405682 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c2db3d-baff-48c1-980d-150c2908f2cc admin admin] PATH_INFO: `/v3/projects/867922bad4614e57970f52eac4905418` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:55:50.406883 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c2db3d-baff-48c1-980d-150c2908f2cc admin admin] RBAC: Authorizing `identity:delete_project(project_id=867922bad4614e57970f52eac4905418)` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:55:50.408851 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c2db3d-baff-48c1-980d-150c2908f2cc admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:55:50.462902 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-79c2db3d-baff-48c1-980d-150c2908f2cc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '867922bad4614e57970f52eac4905418', 'request_id': 'req-79c2db3d-baff-48c1-980d-150c2908f2cc'} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:55:50.468552 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-79c2db3d-baff-48c1-980d-150c2908f2cc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '867922bad4614e57970f52eac4905418', 'request_id': 'req-79c2db3d-baff-48c1-980d-150c2908f2cc'} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:55:50.477590 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-79c2db3d-baff-48c1-980d-150c2908f2cc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '867922bad4614e57970f52eac4905418', 'request_id': 'req-79c2db3d-baff-48c1-980d-150c2908f2cc'} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:55:50.488983 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-79c2db3d-baff-48c1-980d-150c2908f2cc admin admin] The token cache is being invalidate because project 867922bad4614e57970f52eac4905418 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87955) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 00:55:50.489270 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-79c2db3d-baff-48c1-980d-150c2908f2cc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:55:50.489921 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-79c2db3d-baff-48c1-980d-150c2908f2cc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:55:50.491470 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 1168/2348] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 30 00:55:50 2022] DELETE /identity/v3/projects/867922bad4614e57970f52eac4905418 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 00:55:50.496550 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb77512b-2325-4e30-a7f1-8c3a2d307045 None None] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:55:50.497036 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb77512b-2325-4e30-a7f1-8c3a2d307045 None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:55:50.497159 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb77512b-2325-4e30-a7f1-8c3a2d307045 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:55:50.520363 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.auth.core [None req-cb77512b-2325-4e30-a7f1-8c3a2d307045 None None] MFA Rules not processed for user `eb55b6cbca4945abb21b0e49eb745e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=87956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:55:50.521566 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-cb77512b-2325-4e30-a7f1-8c3a2d307045 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:55:50.581698 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 1181/2349] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 30 00:55:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:55:50.589565 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2103f379-f35f-49c2-91fa-98a16c4c811d None None] REQUEST_METHOD: `POST` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:55:50.589848 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2103f379-f35f-49c2-91fa-98a16c4c811d None None] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:55:50.590123 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2103f379-f35f-49c2-91fa-98a16c4c811d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:55:50.611284 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.auth.core [None req-2103f379-f35f-49c2-91fa-98a16c4c811d None None] MFA Rules not processed for user `eb55b6cbca4945abb21b0e49eb745e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=87955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:55:50.612481 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-2103f379-f35f-49c2-91fa-98a16c4c811d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:55:50.621603 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 1169/2350] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 30 00:55:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:55:50.625803 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb77512b-2325-4e30-a7f1-8c3a2d307045 None None] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:55:50.636107 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb77512b-2325-4e30-a7f1-8c3a2d307045 None None] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:55:50.640886 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fea262-22b2-4fd8-a173-aab0f2219e67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:55:50.641477 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fea262-22b2-4fd8-a173-aab0f2219e67 admin admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:55:50.641774 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fea262-22b2-4fd8-a173-aab0f2219e67 admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:55:50.642039 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fea262-22b2-4fd8-a173-aab0f2219e67 admin admin] PATH_INFO: `/v3/domains` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:55:50.642680 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fea262-22b2-4fd8-a173-aab0f2219e67 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87956) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:55:50.642976 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fea262-22b2-4fd8-a173-aab0f2219e67 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:55:50.644583 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fea262-22b2-4fd8-a173-aab0f2219e67 admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:55:50.656222 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 1182/2351] 10.222.0.42 () {58 vars in 1153 bytes} [Sun Oct 30 00:55:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:55:50.660402 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2103f379-f35f-49c2-91fa-98a16c4c811d None None] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:55:50.669971 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2103f379-f35f-49c2-91fa-98a16c4c811d None None] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:55:50.674992 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f247cca-ac19-404d-82be-cbe003197515 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:55:50.675614 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f247cca-ac19-404d-82be-cbe003197515 admin admin] REQUEST_METHOD: `POST` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:55:50.675887 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f247cca-ac19-404d-82be-cbe003197515 admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:55:50.676158 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f247cca-ac19-404d-82be-cbe003197515 admin admin] PATH_INFO: `/v3/projects` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:55:50.676811 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f247cca-ac19-404d-82be-cbe003197515 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:55:50.678692 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f247cca-ac19-404d-82be-cbe003197515 admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:55:50.708910 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 1170/2352] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 30 00:55:50 2022] POST /identity/v3/projects => generated 375 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 00:55:50.714624 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fea262-22b2-4fd8-a173-aab0f2219e67 admin admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:55:50.725339 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fea262-22b2-4fd8-a173-aab0f2219e67 admin admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:55:50.783097 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17190824-ad42-49c5-9ee6-6acef907535d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:55:50.783723 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17190824-ad42-49c5-9ee6-6acef907535d admin admin] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:55:50.783997 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17190824-ad42-49c5-9ee6-6acef907535d admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:55:50.784262 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17190824-ad42-49c5-9ee6-6acef907535d admin admin] PATH_INFO: `/v3/users` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:55:50.784890 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17190824-ad42-49c5-9ee6-6acef907535d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:55:50.786788 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17190824-ad42-49c5-9ee6-6acef907535d admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:55:50.809698 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 1183/2353] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 30 00:55:50 2022] POST /identity/v3/users => generated 288 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 00:55:50.813921 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f247cca-ac19-404d-82be-cbe003197515 admin admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:55:50.824588 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f247cca-ac19-404d-82be-cbe003197515 admin admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:55:50.829994 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285493fd-5700-468d-b579-28b31b639af7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:55:50.830582 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285493fd-5700-468d-b579-28b31b639af7 admin admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:55:50.830855 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285493fd-5700-468d-b579-28b31b639af7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:55:50.831121 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285493fd-5700-468d-b579-28b31b639af7 admin admin] PATH_INFO: `/v3/roles` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:55:50.831905 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285493fd-5700-468d-b579-28b31b639af7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:55:50.833498 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285493fd-5700-468d-b579-28b31b639af7 admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:55:50.843612 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 1171/2354] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 30 00:55:50 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 00:55:50.847860 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17190824-ad42-49c5-9ee6-6acef907535d admin admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:55:50.858976 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17190824-ad42-49c5-9ee6-6acef907535d admin admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:55:50.863730 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4111f23e-83a6-4e72-a9a5-2d4d1de8de90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:55:50.864308 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4111f23e-83a6-4e72-a9a5-2d4d1de8de90 admin admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:55:50.864611 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4111f23e-83a6-4e72-a9a5-2d4d1de8de90 admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:55:50.864880 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4111f23e-83a6-4e72-a9a5-2d4d1de8de90 admin admin] PATH_INFO: `/v3/roles` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:55:50.865563 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4111f23e-83a6-4e72-a9a5-2d4d1de8de90 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:55:50.867249 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4111f23e-83a6-4e72-a9a5-2d4d1de8de90 admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:55:50.877711 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 1184/2355] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 30 00:55:50 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 00:55:50.881859 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285493fd-5700-468d-b579-28b31b639af7 admin admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:55:50.891973 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285493fd-5700-468d-b579-28b31b639af7 admin admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:55:50.896910 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce04e71c-ad10-4ac9-9eb9-cc971ff45842 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:55:50.897551 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce04e71c-ad10-4ac9-9eb9-cc971ff45842 admin admin] REQUEST_METHOD: `PUT` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:55:50.897816 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce04e71c-ad10-4ac9-9eb9-cc971ff45842 admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:55:50.898086 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce04e71c-ad10-4ac9-9eb9-cc971ff45842 admin admin] PATH_INFO: `/v3/projects/f1534d7f442049ac854a6ac0ea999e28/users/449c371fe7af4d739b7c31ca00a4eed0/roles/1c93019874174c4b91118d9ce2347e47` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:55:50.913002 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce04e71c-ad10-4ac9-9eb9-cc971ff45842 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f1534d7f442049ac854a6ac0ea999e28, user_id=449c371fe7af4d739b7c31ca00a4eed0, role_id=1c93019874174c4b91118d9ce2347e47)` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:55:50.915656 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce04e71c-ad10-4ac9-9eb9-cc971ff45842 admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:55:50.929221 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 1172/2356] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 30 00:55:50 2022] PUT /identity/v3/projects/f1534d7f442049ac854a6ac0ea999e28/users/449c371fe7af4d739b7c31ca00a4eed0/roles/1c93019874174c4b91118d9ce2347e47 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 00:55:50.939623 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5cf343-a652-4142-9244-df31abb49ede None None] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:55:50.939905 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5cf343-a652-4142-9244-df31abb49ede None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:55:50.940170 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5cf343-a652-4142-9244-df31abb49ede None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:55:50.948762 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:55:50.970690 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.auth.core [None req-8b5cf343-a652-4142-9244-df31abb49ede None None] MFA Rules not processed for user `449c371fe7af4d739b7c31ca00a4eed0`. Rule list: `[]` (Enabled: `True`). {{(pid=87956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:55:50.972256 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-8b5cf343-a652-4142-9244-df31abb49ede None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:55:51.035138 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 1185/2357] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 30 00:55:50 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:55:51.047446 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce04e71c-ad10-4ac9-9eb9-cc971ff45842 admin admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:55:51.049564 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-ce04e71c-ad10-4ac9-9eb9-cc971ff45842 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:55:51.104746 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:55:51.110484 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce04e71c-ad10-4ac9-9eb9-cc971ff45842 admin admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:55:51.114751 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60a9c64-e674-4f94-80cf-85a596f50fef service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36a86cf3eaf24b369737b65046142593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d2387fdf794d4eaef07bbcd7b39f2a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:55:51.115394 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60a9c64-e674-4f94-80cf-85a596f50fef service glance] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:55:51.115677 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60a9c64-e674-4f94-80cf-85a596f50fef service glance] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:55:51.116260 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60a9c64-e674-4f94-80cf-85a596f50fef service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:55:51.124889 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60a9c64-e674-4f94-80cf-85a596f50fef service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:55:51.126307 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60a9c64-e674-4f94-80cf-85a596f50fef service glance] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:55:51.135112 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 1173/2358] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 30 00:55:51 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 00:56:01.032221 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=30 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:56:01.130974 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=5 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:56:06.765814 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5cf343-a652-4142-9244-df31abb49ede None None] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:56:06.838782 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5cf343-a652-4142-9244-df31abb49ede None None] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:56:06.843680 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a79c0b-275e-4918-9fe0-a7d4d5b00e43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:56:06.844336 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a79c0b-275e-4918-9fe0-a7d4d5b00e43 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:56:06.844614 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a79c0b-275e-4918-9fe0-a7d4d5b00e43 admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:56:06.844909 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a79c0b-275e-4918-9fe0-a7d4d5b00e43 admin admin] PATH_INFO: `/v3/users/449c371fe7af4d739b7c31ca00a4eed0` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:56:06.846180 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a79c0b-275e-4918-9fe0-a7d4d5b00e43 admin admin] RBAC: Authorizing `identity:delete_user(user_id=449c371fe7af4d739b7c31ca00a4eed0)` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:56:06.848231 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a79c0b-275e-4918-9fe0-a7d4d5b00e43 admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:56:06.899396 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-c7a79c0b-275e-4918-9fe0-a7d4d5b00e43 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '449c371fe7af4d739b7c31ca00a4eed0'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:56:06.900053 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-c7a79c0b-275e-4918-9fe0-a7d4d5b00e43 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '449c371fe7af4d739b7c31ca00a4eed0'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:56:06.912318 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-c7a79c0b-275e-4918-9fe0-a7d4d5b00e43 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '449c371fe7af4d739b7c31ca00a4eed0'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:56:06.921337 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-c7a79c0b-275e-4918-9fe0-a7d4d5b00e43 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '449c371fe7af4d739b7c31ca00a4eed0'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:56:06.929037 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-c7a79c0b-275e-4918-9fe0-a7d4d5b00e43 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '449c371fe7af4d739b7c31ca00a4eed0'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:56:06.935008 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 1186/2359] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 30 00:56:06 2022] DELETE /identity/v3/users/449c371fe7af4d739b7c31ca00a4eed0 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 00:56:06.939549 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b39b3b3-4666-44fd-87a1-378fc42e57b8 None None] REQUEST_METHOD: `POST` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:56:06.940037 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b39b3b3-4666-44fd-87a1-378fc42e57b8 None None] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:56:06.940037 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b39b3b3-4666-44fd-87a1-378fc42e57b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:56:06.959707 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.auth.core [None req-9b39b3b3-4666-44fd-87a1-378fc42e57b8 None None] MFA Rules not processed for user `eb55b6cbca4945abb21b0e49eb745e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=87955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:56:06.960965 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-9b39b3b3-4666-44fd-87a1-378fc42e57b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:56:07.019955 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 1174/2360] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 30 00:56:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:56:07.029769 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a79c0b-275e-4918-9fe0-a7d4d5b00e43 admin admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:56:07.031175 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-c7a79c0b-275e-4918-9fe0-a7d4d5b00e43 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:56:07.090464 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a79c0b-275e-4918-9fe0-a7d4d5b00e43 admin admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:56:07.094322 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3659df0f-fe95-4f5c-815b-524617a49a40 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5693f186c6ad4d9394f02ee3477cdcd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d2387fdf794d4eaef07bbcd7b39f2a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:56:07.094922 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3659df0f-fe95-4f5c-815b-524617a49a40 service neutron] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:56:07.095181 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3659df0f-fe95-4f5c-815b-524617a49a40 service neutron] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:56:07.095485 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3659df0f-fe95-4f5c-815b-524617a49a40 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:56:07.104331 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3659df0f-fe95-4f5c-815b-524617a49a40 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:56:07.105742 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3659df0f-fe95-4f5c-815b-524617a49a40 service neutron] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:56:07.114936 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 1187/2361] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 30 00:56:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 00:56:07.384431 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b39b3b3-4666-44fd-87a1-378fc42e57b8 None None] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:56:07.386091 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-9b39b3b3-4666-44fd-87a1-378fc42e57b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:56:07.398620 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b39b3b3-4666-44fd-87a1-378fc42e57b8 None None] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:56:07.404350 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900c28c5-217b-41a8-9d75-3ea2c23f568b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:56:07.404999 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900c28c5-217b-41a8-9d75-3ea2c23f568b admin admin] REQUEST_METHOD: `DELETE` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:56:07.405274 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900c28c5-217b-41a8-9d75-3ea2c23f568b admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:56:07.405518 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900c28c5-217b-41a8-9d75-3ea2c23f568b admin admin] PATH_INFO: `/v3/projects/f1534d7f442049ac854a6ac0ea999e28` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:56:07.406768 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900c28c5-217b-41a8-9d75-3ea2c23f568b admin admin] RBAC: Authorizing `identity:delete_project(project_id=f1534d7f442049ac854a6ac0ea999e28)` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:56:07.408742 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900c28c5-217b-41a8-9d75-3ea2c23f568b admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:56:07.460049 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-900c28c5-217b-41a8-9d75-3ea2c23f568b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f1534d7f442049ac854a6ac0ea999e28', 'request_id': 'req-900c28c5-217b-41a8-9d75-3ea2c23f568b'} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:56:07.465572 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-900c28c5-217b-41a8-9d75-3ea2c23f568b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f1534d7f442049ac854a6ac0ea999e28', 'request_id': 'req-900c28c5-217b-41a8-9d75-3ea2c23f568b'} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:56:07.474720 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-900c28c5-217b-41a8-9d75-3ea2c23f568b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f1534d7f442049ac854a6ac0ea999e28', 'request_id': 'req-900c28c5-217b-41a8-9d75-3ea2c23f568b'} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:56:07.486821 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-900c28c5-217b-41a8-9d75-3ea2c23f568b admin admin] The token cache is being invalidate because project f1534d7f442049ac854a6ac0ea999e28 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87955) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 00:56:07.487105 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-900c28c5-217b-41a8-9d75-3ea2c23f568b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:56:07.487861 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-900c28c5-217b-41a8-9d75-3ea2c23f568b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:56:07.489397 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 1175/2362] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 30 00:56:07 2022] DELETE /identity/v3/projects/f1534d7f442049ac854a6ac0ea999e28 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 00:56:07.494534 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b846a11-40d1-4e0a-96c0-110ce1ec8d4b None None] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:56:07.494818 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b846a11-40d1-4e0a-96c0-110ce1ec8d4b None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:56:07.495083 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b846a11-40d1-4e0a-96c0-110ce1ec8d4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:56:07.515698 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.auth.core [None req-8b846a11-40d1-4e0a-96c0-110ce1ec8d4b None None] MFA Rules not processed for user `eb55b6cbca4945abb21b0e49eb745e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=87956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:56:07.516831 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-8b846a11-40d1-4e0a-96c0-110ce1ec8d4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:56:07.534470 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:56:07.581902 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 1188/2363] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 30 00:56:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:56:07.591228 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9942ce10-0f33-4bd8-8c1a-be9e19c3a3eb None None] REQUEST_METHOD: `POST` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:56:07.591557 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9942ce10-0f33-4bd8-8c1a-be9e19c3a3eb None None] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:56:07.591827 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9942ce10-0f33-4bd8-8c1a-be9e19c3a3eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:56:07.614457 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.auth.core [None req-9942ce10-0f33-4bd8-8c1a-be9e19c3a3eb None None] MFA Rules not processed for user `eb55b6cbca4945abb21b0e49eb745e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=87955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:56:07.615704 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-9942ce10-0f33-4bd8-8c1a-be9e19c3a3eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:56:07.625235 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 1176/2364] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 30 00:56:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:56:07.629621 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b846a11-40d1-4e0a-96c0-110ce1ec8d4b None None] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:56:07.639576 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b846a11-40d1-4e0a-96c0-110ce1ec8d4b None None] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:56:07.644512 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d597977-1d30-4c02-b8b4-33a8616251f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:56:07.645104 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d597977-1d30-4c02-b8b4-33a8616251f1 admin admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:56:07.645374 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d597977-1d30-4c02-b8b4-33a8616251f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:56:07.645644 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d597977-1d30-4c02-b8b4-33a8616251f1 admin admin] PATH_INFO: `/v3/domains` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:56:07.646276 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d597977-1d30-4c02-b8b4-33a8616251f1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87956) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:56:07.646571 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d597977-1d30-4c02-b8b4-33a8616251f1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:56:07.648183 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d597977-1d30-4c02-b8b4-33a8616251f1 admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:56:07.660080 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 1189/2365] 10.222.0.42 () {58 vars in 1153 bytes} [Sun Oct 30 00:56:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 30 00:56:07.664326 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9942ce10-0f33-4bd8-8c1a-be9e19c3a3eb None None] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:56:07.673587 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9942ce10-0f33-4bd8-8c1a-be9e19c3a3eb None None] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:56:07.678628 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d968b2-4026-4787-a4a7-6d55094d0e83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:56:07.679230 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d968b2-4026-4787-a4a7-6d55094d0e83 admin admin] REQUEST_METHOD: `POST` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:56:07.679518 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d968b2-4026-4787-a4a7-6d55094d0e83 admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:56:07.679780 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d968b2-4026-4787-a4a7-6d55094d0e83 admin admin] PATH_INFO: `/v3/projects` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:56:07.680484 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d968b2-4026-4787-a4a7-6d55094d0e83 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:56:07.682375 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d968b2-4026-4787-a4a7-6d55094d0e83 admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:56:07.711750 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 1177/2366] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 30 00:56:07 2022] POST /identity/v3/projects => generated 385 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 00:56:07.715906 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d597977-1d30-4c02-b8b4-33a8616251f1 admin admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:56:07.726380 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d597977-1d30-4c02-b8b4-33a8616251f1 admin admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:56:07.786045 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bcd195-9ba5-4abd-8bb5-2806b79e9e90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:56:07.786741 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bcd195-9ba5-4abd-8bb5-2806b79e9e90 admin admin] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:56:07.786961 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bcd195-9ba5-4abd-8bb5-2806b79e9e90 admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:56:07.787260 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bcd195-9ba5-4abd-8bb5-2806b79e9e90 admin admin] PATH_INFO: `/v3/users` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:56:07.787918 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18bcd195-9ba5-4abd-8bb5-2806b79e9e90 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:56:07.789846 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18bcd195-9ba5-4abd-8bb5-2806b79e9e90 admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:56:07.812000 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 1190/2367] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 30 00:56:07 2022] POST /identity/v3/users => generated 293 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 00:56:07.816393 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d968b2-4026-4787-a4a7-6d55094d0e83 admin admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:56:07.827456 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d968b2-4026-4787-a4a7-6d55094d0e83 admin admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:56:07.833459 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378fdfca-7719-4352-af7b-5cb5555c4a46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:56:07.834052 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378fdfca-7719-4352-af7b-5cb5555c4a46 admin admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:56:07.834304 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378fdfca-7719-4352-af7b-5cb5555c4a46 admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:56:07.834594 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378fdfca-7719-4352-af7b-5cb5555c4a46 admin admin] PATH_INFO: `/v3/roles` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:56:07.835245 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378fdfca-7719-4352-af7b-5cb5555c4a46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:56:07.836859 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378fdfca-7719-4352-af7b-5cb5555c4a46 admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:56:07.848099 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 1178/2368] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 30 00:56:07 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 00:56:07.852359 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bcd195-9ba5-4abd-8bb5-2806b79e9e90 admin admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:56:07.863002 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bcd195-9ba5-4abd-8bb5-2806b79e9e90 admin admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:56:07.867782 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2beccc97-b47d-4676-91c8-b58baafef5b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:56:07.868373 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2beccc97-b47d-4676-91c8-b58baafef5b0 admin admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:56:07.868648 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2beccc97-b47d-4676-91c8-b58baafef5b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:56:07.868915 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2beccc97-b47d-4676-91c8-b58baafef5b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:56:07.869554 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2beccc97-b47d-4676-91c8-b58baafef5b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:56:07.871150 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2beccc97-b47d-4676-91c8-b58baafef5b0 admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:56:07.882083 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 1191/2369] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 30 00:56:07 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 00:56:07.886530 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378fdfca-7719-4352-af7b-5cb5555c4a46 admin admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:56:07.896670 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378fdfca-7719-4352-af7b-5cb5555c4a46 admin admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:56:07.901827 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab00a70b-e538-4569-af73-996785fde982 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:56:07.902500 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab00a70b-e538-4569-af73-996785fde982 admin admin] REQUEST_METHOD: `PUT` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:56:07.902761 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab00a70b-e538-4569-af73-996785fde982 admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:56:07.903035 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab00a70b-e538-4569-af73-996785fde982 admin admin] PATH_INFO: `/v3/projects/50a720fcf10e4957b36b8c59a119caa2/users/154912c72f124d55a57a3a9992bccfa2/roles/1c93019874174c4b91118d9ce2347e47` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:56:07.917752 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab00a70b-e538-4569-af73-996785fde982 admin admin] RBAC: Authorizing `identity:create_grant(project_id=50a720fcf10e4957b36b8c59a119caa2, user_id=154912c72f124d55a57a3a9992bccfa2, role_id=1c93019874174c4b91118d9ce2347e47)` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:56:07.920430 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab00a70b-e538-4569-af73-996785fde982 admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:56:07.934990 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 1179/2370] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 30 00:56:07 2022] PUT /identity/v3/projects/50a720fcf10e4957b36b8c59a119caa2/users/154912c72f124d55a57a3a9992bccfa2/roles/1c93019874174c4b91118d9ce2347e47 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 00:56:07.945300 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24e179e-e87b-47a8-b509-b80faf0d9fb2 None None] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:56:07.945657 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24e179e-e87b-47a8-b509-b80faf0d9fb2 None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:56:07.945931 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24e179e-e87b-47a8-b509-b80faf0d9fb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:56:07.973389 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.auth.core [None req-f24e179e-e87b-47a8-b509-b80faf0d9fb2 None None] MFA Rules not processed for user `154912c72f124d55a57a3a9992bccfa2`. Rule list: `[]` (Enabled: `True`). {{(pid=87956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:56:07.974615 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-f24e179e-e87b-47a8-b509-b80faf0d9fb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:56:08.041668 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 1192/2371] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 30 00:56:07 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:56:08.046434 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab00a70b-e538-4569-af73-996785fde982 admin admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:56:08.074243 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:56:08.119081 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab00a70b-e538-4569-af73-996785fde982 admin admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:56:08.124566 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ae9f50-7a7c-4b82-bbf8-6ed2710bf06d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:56:08.125179 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ae9f50-7a7c-4b82-bbf8-6ed2710bf06d admin admin] REQUEST_METHOD: `POST` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:56:08.125458 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ae9f50-7a7c-4b82-bbf8-6ed2710bf06d admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:56:08.125744 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ae9f50-7a7c-4b82-bbf8-6ed2710bf06d admin admin] PATH_INFO: `/v3/projects` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:56:08.126372 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ae9f50-7a7c-4b82-bbf8-6ed2710bf06d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:56:08.128307 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ae9f50-7a7c-4b82-bbf8-6ed2710bf06d admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:56:08.160051 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 1180/2372] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 30 00:56:08 2022] POST /identity/v3/projects => generated 385 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 00:56:08.164141 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24e179e-e87b-47a8-b509-b80faf0d9fb2 None None] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:56:08.176291 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24e179e-e87b-47a8-b509-b80faf0d9fb2 None None] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:56:08.194737 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:56:08.240788 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6a1b22-8e5b-4ff7-86c0-85dc3b02bf89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:56:08.241397 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6a1b22-8e5b-4ff7-86c0-85dc3b02bf89 admin admin] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:56:08.241671 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6a1b22-8e5b-4ff7-86c0-85dc3b02bf89 admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:56:08.241936 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6a1b22-8e5b-4ff7-86c0-85dc3b02bf89 admin admin] PATH_INFO: `/v3/users` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:56:08.242625 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6a1b22-8e5b-4ff7-86c0-85dc3b02bf89 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:56:08.244590 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6a1b22-8e5b-4ff7-86c0-85dc3b02bf89 admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:56:08.268860 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 1193/2373] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 30 00:56:08 2022] POST /identity/v3/users => generated 293 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 00:56:08.272957 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ae9f50-7a7c-4b82-bbf8-6ed2710bf06d admin admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:56:08.283695 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ae9f50-7a7c-4b82-bbf8-6ed2710bf06d admin admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:56:08.288562 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a4a7fe-fda3-47ac-9e57-ec1d95303542 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:56:08.290764 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a4a7fe-fda3-47ac-9e57-ec1d95303542 admin admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:56:08.290764 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a4a7fe-fda3-47ac-9e57-ec1d95303542 admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:56:08.290764 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a4a7fe-fda3-47ac-9e57-ec1d95303542 admin admin] PATH_INFO: `/v3/roles` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:56:08.290764 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a4a7fe-fda3-47ac-9e57-ec1d95303542 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:56:08.298140 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a4a7fe-fda3-47ac-9e57-ec1d95303542 admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:56:08.311418 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 1181/2374] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 30 00:56:08 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 00:56:08.315350 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6a1b22-8e5b-4ff7-86c0-85dc3b02bf89 admin admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:56:08.325729 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6a1b22-8e5b-4ff7-86c0-85dc3b02bf89 admin admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:56:08.330341 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bf8adf-7f5b-4ddc-8ecc-037e42a55f6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:56:08.330945 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bf8adf-7f5b-4ddc-8ecc-037e42a55f6d admin admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:56:08.331277 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bf8adf-7f5b-4ddc-8ecc-037e42a55f6d admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:56:08.331561 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bf8adf-7f5b-4ddc-8ecc-037e42a55f6d admin admin] PATH_INFO: `/v3/roles` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:56:08.332208 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7bf8adf-7f5b-4ddc-8ecc-037e42a55f6d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:56:08.333804 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7bf8adf-7f5b-4ddc-8ecc-037e42a55f6d admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:56:08.347761 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 1194/2375] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 30 00:56:08 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 30 00:56:08.348919 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a4a7fe-fda3-47ac-9e57-ec1d95303542 admin admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:56:08.358992 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a4a7fe-fda3-47ac-9e57-ec1d95303542 admin admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:56:08.365061 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0ef503-3ced-441c-b0a6-f093a09a021d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:56:08.365756 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0ef503-3ced-441c-b0a6-f093a09a021d admin admin] REQUEST_METHOD: `PUT` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:56:08.366057 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0ef503-3ced-441c-b0a6-f093a09a021d admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:56:08.366323 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0ef503-3ced-441c-b0a6-f093a09a021d admin admin] PATH_INFO: `/v3/projects/d9f92ca243e549cc89d0573d1b825fc5/users/bce6290507f94d2ab6c41b7b17720e5b/roles/1c93019874174c4b91118d9ce2347e47` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:56:08.381135 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0ef503-3ced-441c-b0a6-f093a09a021d admin admin] RBAC: Authorizing `identity:create_grant(project_id=d9f92ca243e549cc89d0573d1b825fc5, user_id=bce6290507f94d2ab6c41b7b17720e5b, role_id=1c93019874174c4b91118d9ce2347e47)` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:56:08.383814 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0ef503-3ced-441c-b0a6-f093a09a021d admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:56:08.398114 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 1182/2376] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 30 00:56:08 2022] PUT /identity/v3/projects/d9f92ca243e549cc89d0573d1b825fc5/users/bce6290507f94d2ab6c41b7b17720e5b/roles/1c93019874174c4b91118d9ce2347e47 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 00:56:08.408681 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37739f79-6621-4526-abe9-0b387d428b1a None None] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:56:08.408965 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37739f79-6621-4526-abe9-0b387d428b1a None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:56:08.409233 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37739f79-6621-4526-abe9-0b387d428b1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:56:08.438589 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.auth.core [None req-37739f79-6621-4526-abe9-0b387d428b1a None None] MFA Rules not processed for user `bce6290507f94d2ab6c41b7b17720e5b`. Rule list: `[]` (Enabled: `True`). {{(pid=87956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:56:08.439849 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-37739f79-6621-4526-abe9-0b387d428b1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:56:08.507166 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 1195/2377] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 30 00:56:08 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:56:08.511756 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0ef503-3ced-441c-b0a6-f093a09a021d admin admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:56:08.576789 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0ef503-3ced-441c-b0a6-f093a09a021d admin admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:56:08.581754 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ad5220-8f4f-4e72-8a15-fdb23b4fdfea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:56:08.582385 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ad5220-8f4f-4e72-8a15-fdb23b4fdfea admin admin] REQUEST_METHOD: `POST` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:56:08.582685 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ad5220-8f4f-4e72-8a15-fdb23b4fdfea admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:56:08.582976 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ad5220-8f4f-4e72-8a15-fdb23b4fdfea admin admin] PATH_INFO: `/v3/projects` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:56:08.583665 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ad5220-8f4f-4e72-8a15-fdb23b4fdfea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:56:08.585567 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ad5220-8f4f-4e72-8a15-fdb23b4fdfea admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:56:08.613841 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 1183/2378] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 30 00:56:08 2022] POST /identity/v3/projects => generated 383 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 00:56:08.618194 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37739f79-6621-4526-abe9-0b387d428b1a None None] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:56:08.629423 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37739f79-6621-4526-abe9-0b387d428b1a None None] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:56:08.690181 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7006cbe7-ad79-4d58-bdad-204ad0132b12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:56:08.690971 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7006cbe7-ad79-4d58-bdad-204ad0132b12 admin admin] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:56:08.691336 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7006cbe7-ad79-4d58-bdad-204ad0132b12 admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:56:08.691611 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7006cbe7-ad79-4d58-bdad-204ad0132b12 admin admin] PATH_INFO: `/v3/users` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:56:08.692248 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7006cbe7-ad79-4d58-bdad-204ad0132b12 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:56:08.694846 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7006cbe7-ad79-4d58-bdad-204ad0132b12 admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:56:08.719101 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 1196/2379] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 30 00:56:08 2022] POST /identity/v3/users => generated 298 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 00:56:08.724923 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ad5220-8f4f-4e72-8a15-fdb23b4fdfea admin admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:56:08.740923 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ad5220-8f4f-4e72-8a15-fdb23b4fdfea admin admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:56:08.747654 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98d56d7-906a-415f-90dc-cb94b00d7b8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:56:08.748410 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98d56d7-906a-415f-90dc-cb94b00d7b8a admin admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:56:08.748688 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98d56d7-906a-415f-90dc-cb94b00d7b8a admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:56:08.748953 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98d56d7-906a-415f-90dc-cb94b00d7b8a admin admin] PATH_INFO: `/v3/roles` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:56:08.749599 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98d56d7-906a-415f-90dc-cb94b00d7b8a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:56:08.751262 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98d56d7-906a-415f-90dc-cb94b00d7b8a admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:56:08.762537 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 1184/2380] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 30 00:56:08 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 30 00:56:08.766976 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7006cbe7-ad79-4d58-bdad-204ad0132b12 admin admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:56:08.778093 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7006cbe7-ad79-4d58-bdad-204ad0132b12 admin admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:56:08.783580 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51c66a9-694c-44d2-a7c2-6c2e9be25f19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:56:08.784251 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51c66a9-694c-44d2-a7c2-6c2e9be25f19 admin admin] REQUEST_METHOD: `PUT` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:56:08.784531 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51c66a9-694c-44d2-a7c2-6c2e9be25f19 admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:56:08.784944 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51c66a9-694c-44d2-a7c2-6c2e9be25f19 admin admin] PATH_INFO: `/v3/projects/e58b0844dbcf4996bd4f9728d279295d/users/159c6defe193481f81290586a0eec4a2/roles/6ccaa8c11f29456fb4e4eeccb21616c7` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:56:08.798359 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:56:08.801616 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51c66a9-694c-44d2-a7c2-6c2e9be25f19 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e58b0844dbcf4996bd4f9728d279295d, user_id=159c6defe193481f81290586a0eec4a2, role_id=6ccaa8c11f29456fb4e4eeccb21616c7)` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:56:08.804726 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51c66a9-694c-44d2-a7c2-6c2e9be25f19 admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:56:08.819051 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 1197/2381] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 30 00:56:08 2022] PUT /identity/v3/projects/e58b0844dbcf4996bd4f9728d279295d/users/159c6defe193481f81290586a0eec4a2/roles/6ccaa8c11f29456fb4e4eeccb21616c7 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 00:56:08.823438 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98d56d7-906a-415f-90dc-cb94b00d7b8a admin admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:56:08.833337 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98d56d7-906a-415f-90dc-cb94b00d7b8a admin admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:56:08.874926 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:56:08.891856 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3a7885-099e-45d0-a6ae-30ee19f05dbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:56:08.892469 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3a7885-099e-45d0-a6ae-30ee19f05dbd admin admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:56:08.892740 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3a7885-099e-45d0-a6ae-30ee19f05dbd admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:56:08.893021 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3a7885-099e-45d0-a6ae-30ee19f05dbd admin admin] PATH_INFO: `/v3/roles` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:56:08.893644 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3a7885-099e-45d0-a6ae-30ee19f05dbd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:56:08.895241 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3a7885-099e-45d0-a6ae-30ee19f05dbd admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:56:08.905748 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 1185/2382] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 30 00:56:08 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 00:56:08.910297 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51c66a9-694c-44d2-a7c2-6c2e9be25f19 admin admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:56:08.921561 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51c66a9-694c-44d2-a7c2-6c2e9be25f19 admin admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:56:08.927212 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4549e40a-e805-4c5f-a030-bdbfda228317 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:56:08.928109 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4549e40a-e805-4c5f-a030-bdbfda228317 admin admin] REQUEST_METHOD: `PUT` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:56:08.928388 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4549e40a-e805-4c5f-a030-bdbfda228317 admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:56:08.928655 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4549e40a-e805-4c5f-a030-bdbfda228317 admin admin] PATH_INFO: `/v3/projects/e58b0844dbcf4996bd4f9728d279295d/users/159c6defe193481f81290586a0eec4a2/roles/6ccaa8c11f29456fb4e4eeccb21616c7` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:56:08.930643 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4549e40a-e805-4c5f-a030-bdbfda228317 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e58b0844dbcf4996bd4f9728d279295d, user_id=159c6defe193481f81290586a0eec4a2, role_id=6ccaa8c11f29456fb4e4eeccb21616c7)` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:56:08.933286 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4549e40a-e805-4c5f-a030-bdbfda228317 admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:56:08.943846 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 1198/2383] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 30 00:56:08 2022] PUT /identity/v3/projects/e58b0844dbcf4996bd4f9728d279295d/users/159c6defe193481f81290586a0eec4a2/roles/6ccaa8c11f29456fb4e4eeccb21616c7 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 00:56:08.956872 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae1d3b9-6a42-4372-950a-1b4202eebfb5 None None] REQUEST_METHOD: `POST` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:56:08.957217 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae1d3b9-6a42-4372-950a-1b4202eebfb5 None None] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:56:08.957505 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae1d3b9-6a42-4372-950a-1b4202eebfb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:56:08.988028 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.auth.core [None req-5ae1d3b9-6a42-4372-950a-1b4202eebfb5 None None] MFA Rules not processed for user `159c6defe193481f81290586a0eec4a2`. Rule list: `[]` (Enabled: `True`). {{(pid=87955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:56:08.989271 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-5ae1d3b9-6a42-4372-950a-1b4202eebfb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:56:09.081392 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 1186/2384] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 30 00:56:08 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:56:09.094299 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4549e40a-e805-4c5f-a030-bdbfda228317 admin admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:56:09.096512 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-4549e40a-e805-4c5f-a030-bdbfda228317 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:56:09.169200 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4549e40a-e805-4c5f-a030-bdbfda228317 admin admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:56:09.172909 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8a50e5-582e-4872-aab5-76d16eeb0292 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48d928ff7fe24348ac900f09c56acc20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d2387fdf794d4eaef07bbcd7b39f2a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:56:09.173525 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8a50e5-582e-4872-aab5-76d16eeb0292 service cinder] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:56:09.173796 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8a50e5-582e-4872-aab5-76d16eeb0292 service cinder] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:56:09.174065 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8a50e5-582e-4872-aab5-76d16eeb0292 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:56:09.246910 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8a50e5-582e-4872-aab5-76d16eeb0292 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:56:09.248836 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8a50e5-582e-4872-aab5-76d16eeb0292 service cinder] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:56:09.285360 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 1199/2385] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 30 00:56:09 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 00:56:10.795515 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae1d3b9-6a42-4372-950a-1b4202eebfb5 None None] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:56:10.796950 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-5ae1d3b9-6a42-4372-950a-1b4202eebfb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:56:10.809602 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae1d3b9-6a42-4372-950a-1b4202eebfb5 None None] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:56:10.813368 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88d345d-0825-4d04-8573-1ba28099abe9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48d928ff7fe24348ac900f09c56acc20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d2387fdf794d4eaef07bbcd7b39f2a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:56:10.813965 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88d345d-0825-4d04-8573-1ba28099abe9 service cinder] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:56:10.814241 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88d345d-0825-4d04-8573-1ba28099abe9 service cinder] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:56:10.814512 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88d345d-0825-4d04-8573-1ba28099abe9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:56:10.872651 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88d345d-0825-4d04-8573-1ba28099abe9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:56:10.874017 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88d345d-0825-4d04-8573-1ba28099abe9 service cinder] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:56:10.883308 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 1187/2386] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 30 00:56:10 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 00:56:11.475937 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8a50e5-582e-4872-aab5-76d16eeb0292 service cinder] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:56:11.485226 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8a50e5-582e-4872-aab5-76d16eeb0292 service cinder] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:56:11.489350 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8e17a2-22b4-4148-901a-aa9f89347944 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48d928ff7fe24348ac900f09c56acc20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d2387fdf794d4eaef07bbcd7b39f2a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:56:11.490079 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8e17a2-22b4-4148-901a-aa9f89347944 service cinder] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:56:11.490443 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8e17a2-22b4-4148-901a-aa9f89347944 service cinder] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:56:11.490788 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8e17a2-22b4-4148-901a-aa9f89347944 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:56:11.500341 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8e17a2-22b4-4148-901a-aa9f89347944 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:56:11.501763 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8e17a2-22b4-4148-901a-aa9f89347944 service cinder] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:56:11.511990 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 1200/2387] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 30 00:56:11 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 00:56:12.334015 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cffe00-5d85-4807-8620-8175b31854d5 None None] REQUEST_METHOD: `POST` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:56:12.334566 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cffe00-5d85-4807-8620-8175b31854d5 None None] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:56:12.334566 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cffe00-5d85-4807-8620-8175b31854d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:56:12.359019 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.auth.core [None req-62cffe00-5d85-4807-8620-8175b31854d5 None None] MFA Rules not processed for user `8fb18a4735734c1e8db3ee7960e983d4`. Rule list: `[]` (Enabled: `True`). {{(pid=87955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:56:12.360323 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-62cffe00-5d85-4807-8620-8175b31854d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:56:12.424315 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 1188/2388] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 30 00:56:12 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:56:15.447772 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8e17a2-22b4-4148-901a-aa9f89347944 service cinder] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:56:15.513482 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8e17a2-22b4-4148-901a-aa9f89347944 service cinder] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:56:15.518236 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc35f68-81e8-4643-81b3-5155dd8a20e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:56:15.518881 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc35f68-81e8-4643-81b3-5155dd8a20e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:56:15.519167 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc35f68-81e8-4643-81b3-5155dd8a20e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:56:15.519460 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc35f68-81e8-4643-81b3-5155dd8a20e5 admin admin] PATH_INFO: `/v3/users/154912c72f124d55a57a3a9992bccfa2` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:56:15.520696 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc35f68-81e8-4643-81b3-5155dd8a20e5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=154912c72f124d55a57a3a9992bccfa2)` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:56:15.522622 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc35f68-81e8-4643-81b3-5155dd8a20e5 admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:56:15.545063 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:56:15.572692 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-3cc35f68-81e8-4643-81b3-5155dd8a20e5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '154912c72f124d55a57a3a9992bccfa2'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:56:15.573352 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-3cc35f68-81e8-4643-81b3-5155dd8a20e5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '154912c72f124d55a57a3a9992bccfa2'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:56:15.585280 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-3cc35f68-81e8-4643-81b3-5155dd8a20e5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '154912c72f124d55a57a3a9992bccfa2'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:56:15.593172 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-3cc35f68-81e8-4643-81b3-5155dd8a20e5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '154912c72f124d55a57a3a9992bccfa2'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:56:15.600469 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-3cc35f68-81e8-4643-81b3-5155dd8a20e5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '154912c72f124d55a57a3a9992bccfa2'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:56:15.606633 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 1201/2389] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 30 00:56:15 2022] DELETE /identity/v3/users/154912c72f124d55a57a3a9992bccfa2 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 00:56:15.611053 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4937beb-2001-474d-9dd0-7c42d74d5a6e None None] REQUEST_METHOD: `POST` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:56:15.611542 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4937beb-2001-474d-9dd0-7c42d74d5a6e None None] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:56:15.612272 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4937beb-2001-474d-9dd0-7c42d74d5a6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:56:15.632333 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.auth.core [None req-a4937beb-2001-474d-9dd0-7c42d74d5a6e None None] MFA Rules not processed for user `eb55b6cbca4945abb21b0e49eb745e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=87955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:56:15.633541 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-a4937beb-2001-474d-9dd0-7c42d74d5a6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:56:15.637893 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=100 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:56:15.697175 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 1189/2390] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 30 00:56:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 30 00:56:15.707541 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc35f68-81e8-4643-81b3-5155dd8a20e5 admin admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:56:15.708909 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-3cc35f68-81e8-4643-81b3-5155dd8a20e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:56:15.766631 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc35f68-81e8-4643-81b3-5155dd8a20e5 admin admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:56:15.770236 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98c70ef-07ee-43e6-a57a-5ca483e380e7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5693f186c6ad4d9394f02ee3477cdcd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d2387fdf794d4eaef07bbcd7b39f2a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:56:15.770843 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98c70ef-07ee-43e6-a57a-5ca483e380e7 service neutron] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:56:15.771118 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98c70ef-07ee-43e6-a57a-5ca483e380e7 service neutron] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:56:15.771443 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98c70ef-07ee-43e6-a57a-5ca483e380e7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:56:15.780764 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98c70ef-07ee-43e6-a57a-5ca483e380e7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:56:15.782191 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98c70ef-07ee-43e6-a57a-5ca483e380e7 service neutron] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:56:15.792273 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 1202/2391] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 30 00:56:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 00:56:16.064484 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4937beb-2001-474d-9dd0-7c42d74d5a6e None None] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:56:16.067253 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-a4937beb-2001-474d-9dd0-7c42d74d5a6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:56:16.079133 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4937beb-2001-474d-9dd0-7c42d74d5a6e None None] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:56:16.083957 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901145c7-b39d-46b8-a84c-fe36c344a958 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:56:16.084588 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901145c7-b39d-46b8-a84c-fe36c344a958 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:56:16.084864 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901145c7-b39d-46b8-a84c-fe36c344a958 admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:56:16.085167 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901145c7-b39d-46b8-a84c-fe36c344a958 admin admin] PATH_INFO: `/v3/projects/50a720fcf10e4957b36b8c59a119caa2` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:56:16.086321 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901145c7-b39d-46b8-a84c-fe36c344a958 admin admin] RBAC: Authorizing `identity:delete_project(project_id=50a720fcf10e4957b36b8c59a119caa2)` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:56:16.088268 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901145c7-b39d-46b8-a84c-fe36c344a958 admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:56:16.142489 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-901145c7-b39d-46b8-a84c-fe36c344a958 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '50a720fcf10e4957b36b8c59a119caa2', 'request_id': 'req-901145c7-b39d-46b8-a84c-fe36c344a958'} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:56:16.148349 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-901145c7-b39d-46b8-a84c-fe36c344a958 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '50a720fcf10e4957b36b8c59a119caa2', 'request_id': 'req-901145c7-b39d-46b8-a84c-fe36c344a958'} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:56:16.157409 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-901145c7-b39d-46b8-a84c-fe36c344a958 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '50a720fcf10e4957b36b8c59a119caa2', 'request_id': 'req-901145c7-b39d-46b8-a84c-fe36c344a958'} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:56:16.169763 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-901145c7-b39d-46b8-a84c-fe36c344a958 admin admin] The token cache is being invalidate because project 50a720fcf10e4957b36b8c59a119caa2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87955) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 00:56:16.170048 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-901145c7-b39d-46b8-a84c-fe36c344a958 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:56:16.170693 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-901145c7-b39d-46b8-a84c-fe36c344a958 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:56:16.172247 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 1190/2392] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 30 00:56:16 2022] DELETE /identity/v3/projects/50a720fcf10e4957b36b8c59a119caa2 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 00:56:16.176182 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98c70ef-07ee-43e6-a57a-5ca483e380e7 service neutron] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:56:16.186169 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98c70ef-07ee-43e6-a57a-5ca483e380e7 service neutron] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:56:16.242711 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d02eeb-6549-4071-8723-246a9125dd97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:56:16.243381 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d02eeb-6549-4071-8723-246a9125dd97 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:56:16.243663 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d02eeb-6549-4071-8723-246a9125dd97 admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:56:16.243930 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d02eeb-6549-4071-8723-246a9125dd97 admin admin] PATH_INFO: `/v3/users/bce6290507f94d2ab6c41b7b17720e5b` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:56:16.245041 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d02eeb-6549-4071-8723-246a9125dd97 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bce6290507f94d2ab6c41b7b17720e5b)` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:56:16.246963 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d02eeb-6549-4071-8723-246a9125dd97 admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:56:16.291960 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:56:16.295049 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-22d02eeb-6549-4071-8723-246a9125dd97 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bce6290507f94d2ab6c41b7b17720e5b'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:56:16.296216 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-22d02eeb-6549-4071-8723-246a9125dd97 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bce6290507f94d2ab6c41b7b17720e5b'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:56:16.310704 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-22d02eeb-6549-4071-8723-246a9125dd97 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bce6290507f94d2ab6c41b7b17720e5b'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:56:16.320055 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-22d02eeb-6549-4071-8723-246a9125dd97 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bce6290507f94d2ab6c41b7b17720e5b'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:56:16.327993 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-22d02eeb-6549-4071-8723-246a9125dd97 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bce6290507f94d2ab6c41b7b17720e5b'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:56:16.334006 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 1203/2393] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 30 00:56:16 2022] DELETE /identity/v3/users/bce6290507f94d2ab6c41b7b17720e5b => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 00:56:16.619961 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901145c7-b39d-46b8-a84c-fe36c344a958 admin admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:56:16.621459 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-901145c7-b39d-46b8-a84c-fe36c344a958 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:56:16.716642 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901145c7-b39d-46b8-a84c-fe36c344a958 admin admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:56:16.746986 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:56:16.780508 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b974728-239e-45c3-affa-bcbe4ad1c746 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:56:16.781128 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b974728-239e-45c3-affa-bcbe4ad1c746 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:56:16.781405 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b974728-239e-45c3-affa-bcbe4ad1c746 admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:56:16.781670 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b974728-239e-45c3-affa-bcbe4ad1c746 admin admin] PATH_INFO: `/v3/projects/d9f92ca243e549cc89d0573d1b825fc5` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:56:16.782820 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b974728-239e-45c3-affa-bcbe4ad1c746 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d9f92ca243e549cc89d0573d1b825fc5)` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:56:16.784749 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b974728-239e-45c3-affa-bcbe4ad1c746 admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:56:16.833211 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-4b974728-239e-45c3-affa-bcbe4ad1c746 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd9f92ca243e549cc89d0573d1b825fc5', 'request_id': 'req-4b974728-239e-45c3-affa-bcbe4ad1c746'} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:56:16.838676 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-4b974728-239e-45c3-affa-bcbe4ad1c746 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd9f92ca243e549cc89d0573d1b825fc5', 'request_id': 'req-4b974728-239e-45c3-affa-bcbe4ad1c746'} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:56:16.849000 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-4b974728-239e-45c3-affa-bcbe4ad1c746 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd9f92ca243e549cc89d0573d1b825fc5', 'request_id': 'req-4b974728-239e-45c3-affa-bcbe4ad1c746'} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:56:16.860794 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-4b974728-239e-45c3-affa-bcbe4ad1c746 admin admin] The token cache is being invalidate because project d9f92ca243e549cc89d0573d1b825fc5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87955) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 00:56:16.861075 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-4b974728-239e-45c3-affa-bcbe4ad1c746 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:56:16.861685 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-4b974728-239e-45c3-affa-bcbe4ad1c746 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:56:16.863264 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 1191/2394] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 30 00:56:16 2022] DELETE /identity/v3/projects/d9f92ca243e549cc89d0573d1b825fc5 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 00:56:16.867600 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d02eeb-6549-4071-8723-246a9125dd97 admin admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:56:16.869108 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-22d02eeb-6549-4071-8723-246a9125dd97 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:56:16.928572 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d02eeb-6549-4071-8723-246a9125dd97 admin admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:56:16.986483 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25feeb2d-7367-4d76-9b75-cff40dabed18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:56:16.987105 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25feeb2d-7367-4d76-9b75-cff40dabed18 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:56:16.987409 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25feeb2d-7367-4d76-9b75-cff40dabed18 admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:56:16.987677 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25feeb2d-7367-4d76-9b75-cff40dabed18 admin admin] PATH_INFO: `/v3/users/159c6defe193481f81290586a0eec4a2` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:56:16.988858 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25feeb2d-7367-4d76-9b75-cff40dabed18 admin admin] RBAC: Authorizing `identity:delete_user(user_id=159c6defe193481f81290586a0eec4a2)` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:56:16.990790 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25feeb2d-7367-4d76-9b75-cff40dabed18 admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:56:17.040224 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-25feeb2d-7367-4d76-9b75-cff40dabed18 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '159c6defe193481f81290586a0eec4a2'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:56:17.040912 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-25feeb2d-7367-4d76-9b75-cff40dabed18 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '159c6defe193481f81290586a0eec4a2'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:56:17.053420 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-25feeb2d-7367-4d76-9b75-cff40dabed18 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '159c6defe193481f81290586a0eec4a2'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:56:17.062321 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-25feeb2d-7367-4d76-9b75-cff40dabed18 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '159c6defe193481f81290586a0eec4a2'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:56:17.069997 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-25feeb2d-7367-4d76-9b75-cff40dabed18 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '159c6defe193481f81290586a0eec4a2'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:56:17.071937 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:56:17.077569 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 1204/2395] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 30 00:56:16 2022] DELETE /identity/v3/users/159c6defe193481f81290586a0eec4a2 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 00:56:17.693302 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b974728-239e-45c3-affa-bcbe4ad1c746 admin admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:56:17.696008 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-4b974728-239e-45c3-affa-bcbe4ad1c746 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:56:17.715605 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b974728-239e-45c3-affa-bcbe4ad1c746 admin admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:56:17.803701 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4ffd17-b666-4453-abe7-591a96d62ef7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:56:17.804426 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4ffd17-b666-4453-abe7-591a96d62ef7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:56:17.804774 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4ffd17-b666-4453-abe7-591a96d62ef7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:56:17.805271 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4ffd17-b666-4453-abe7-591a96d62ef7 admin admin] PATH_INFO: `/v3/projects/e58b0844dbcf4996bd4f9728d279295d` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:56:17.806514 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4ffd17-b666-4453-abe7-591a96d62ef7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e58b0844dbcf4996bd4f9728d279295d)` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:56:17.808557 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4ffd17-b666-4453-abe7-591a96d62ef7 admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:56:17.867299 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-9f4ffd17-b666-4453-abe7-591a96d62ef7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e58b0844dbcf4996bd4f9728d279295d', 'request_id': 'req-9f4ffd17-b666-4453-abe7-591a96d62ef7'} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:56:17.877618 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-9f4ffd17-b666-4453-abe7-591a96d62ef7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e58b0844dbcf4996bd4f9728d279295d', 'request_id': 'req-9f4ffd17-b666-4453-abe7-591a96d62ef7'} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:56:17.881305 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:56:17.887434 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-9f4ffd17-b666-4453-abe7-591a96d62ef7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e58b0844dbcf4996bd4f9728d279295d', 'request_id': 'req-9f4ffd17-b666-4453-abe7-591a96d62ef7'} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:56:17.899748 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-9f4ffd17-b666-4453-abe7-591a96d62ef7 admin admin] The token cache is being invalidate because project e58b0844dbcf4996bd4f9728d279295d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87955) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 00:56:17.900030 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-9f4ffd17-b666-4453-abe7-591a96d62ef7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:56:17.900647 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-9f4ffd17-b666-4453-abe7-591a96d62ef7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:56:17.902235 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 1192/2396] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 30 00:56:17 2022] DELETE /identity/v3/projects/e58b0844dbcf4996bd4f9728d279295d => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 00:56:17.908431 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a89348c-879c-4b6a-8e45-fd2909064fd9 None None] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:56:17.908930 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a89348c-879c-4b6a-8e45-fd2909064fd9 None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:56:17.909027 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a89348c-879c-4b6a-8e45-fd2909064fd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:56:17.966971 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.auth.core [None req-1a89348c-879c-4b6a-8e45-fd2909064fd9 None None] MFA Rules not processed for user `eb55b6cbca4945abb21b0e49eb745e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=87956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:56:17.968220 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-1a89348c-879c-4b6a-8e45-fd2909064fd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:56:18.028506 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 1205/2397] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 30 00:56:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:56:18.036611 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc47d3e6-6a59-4505-8709-40b0dd65a28d None None] REQUEST_METHOD: `POST` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:56:18.036894 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc47d3e6-6a59-4505-8709-40b0dd65a28d None None] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:56:18.037166 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc47d3e6-6a59-4505-8709-40b0dd65a28d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:56:18.057389 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.auth.core [None req-cc47d3e6-6a59-4505-8709-40b0dd65a28d None None] MFA Rules not processed for user `eb55b6cbca4945abb21b0e49eb745e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=87955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:56:18.058586 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-cc47d3e6-6a59-4505-8709-40b0dd65a28d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:56:18.066981 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 1193/2398] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 30 00:56:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 30 00:56:18.072624 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a89348c-879c-4b6a-8e45-fd2909064fd9 None None] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:56:18.082844 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a89348c-879c-4b6a-8e45-fd2909064fd9 None None] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:56:18.088713 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535da207-37d0-4e71-ab46-2484da1aa8be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:56:18.089315 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535da207-37d0-4e71-ab46-2484da1aa8be admin admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:56:18.089586 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535da207-37d0-4e71-ab46-2484da1aa8be admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:56:18.089848 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535da207-37d0-4e71-ab46-2484da1aa8be admin admin] PATH_INFO: `/v3/domains` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:56:18.090488 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535da207-37d0-4e71-ab46-2484da1aa8be admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87956) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:56:18.090785 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535da207-37d0-4e71-ab46-2484da1aa8be admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:56:18.092482 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535da207-37d0-4e71-ab46-2484da1aa8be admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:56:18.104746 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 1206/2399] 10.222.0.42 () {58 vars in 1153 bytes} [Sun Oct 30 00:56:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:56:18.109233 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc47d3e6-6a59-4505-8709-40b0dd65a28d None None] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:56:18.118982 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc47d3e6-6a59-4505-8709-40b0dd65a28d None None] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:56:18.124082 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81555c12-a7bf-4552-8063-4f7e0c965b2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:56:18.124679 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81555c12-a7bf-4552-8063-4f7e0c965b2c admin admin] REQUEST_METHOD: `POST` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:56:18.124925 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81555c12-a7bf-4552-8063-4f7e0c965b2c admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:56:18.125194 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81555c12-a7bf-4552-8063-4f7e0c965b2c admin admin] PATH_INFO: `/v3/projects` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:56:18.125819 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81555c12-a7bf-4552-8063-4f7e0c965b2c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:56:18.127728 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81555c12-a7bf-4552-8063-4f7e0c965b2c admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:56:18.156094 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 1194/2400] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 30 00:56:18 2022] POST /identity/v3/projects => generated 385 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 00:56:18.160349 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535da207-37d0-4e71-ab46-2484da1aa8be admin admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:56:18.171082 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535da207-37d0-4e71-ab46-2484da1aa8be admin admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:56:18.228244 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f93b0d-0b2d-4b35-be8e-6520978c5233 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:56:18.228760 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f93b0d-0b2d-4b35-be8e-6520978c5233 admin admin] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:56:18.229055 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f93b0d-0b2d-4b35-be8e-6520978c5233 admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:56:18.229372 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f93b0d-0b2d-4b35-be8e-6520978c5233 admin admin] PATH_INFO: `/v3/users` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:56:18.230005 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f93b0d-0b2d-4b35-be8e-6520978c5233 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:56:18.231951 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f93b0d-0b2d-4b35-be8e-6520978c5233 admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:56:18.255969 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 1207/2401] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 30 00:56:18 2022] POST /identity/v3/users => generated 293 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 00:56:18.260346 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81555c12-a7bf-4552-8063-4f7e0c965b2c admin admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:56:18.271231 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81555c12-a7bf-4552-8063-4f7e0c965b2c admin admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:56:18.276301 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5218c931-5b16-468c-80d1-f0721d96ca30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:56:18.276905 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5218c931-5b16-468c-80d1-f0721d96ca30 admin admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:56:18.277180 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5218c931-5b16-468c-80d1-f0721d96ca30 admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:56:18.277450 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5218c931-5b16-468c-80d1-f0721d96ca30 admin admin] PATH_INFO: `/v3/roles` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:56:18.278127 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5218c931-5b16-468c-80d1-f0721d96ca30 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:56:18.279822 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5218c931-5b16-468c-80d1-f0721d96ca30 admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:56:18.289933 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 1195/2402] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 30 00:56:18 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 00:56:18.293957 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f93b0d-0b2d-4b35-be8e-6520978c5233 admin admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:56:18.309032 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f93b0d-0b2d-4b35-be8e-6520978c5233 admin admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:56:18.314343 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1092a7ae-9dc9-4a82-ae4b-a1a054dd86d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:56:18.314992 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1092a7ae-9dc9-4a82-ae4b-a1a054dd86d3 admin admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:56:18.315303 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1092a7ae-9dc9-4a82-ae4b-a1a054dd86d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:56:18.315578 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1092a7ae-9dc9-4a82-ae4b-a1a054dd86d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:56:18.316294 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1092a7ae-9dc9-4a82-ae4b-a1a054dd86d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:56:18.317990 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1092a7ae-9dc9-4a82-ae4b-a1a054dd86d3 admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:56:18.329335 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 1208/2403] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 30 00:56:18 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 00:56:18.333670 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5218c931-5b16-468c-80d1-f0721d96ca30 admin admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:56:18.344511 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5218c931-5b16-468c-80d1-f0721d96ca30 admin admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:56:18.351364 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a983c8e-2f46-4a0a-b572-7e6273f53473 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:56:18.352006 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a983c8e-2f46-4a0a-b572-7e6273f53473 admin admin] REQUEST_METHOD: `PUT` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:56:18.352277 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a983c8e-2f46-4a0a-b572-7e6273f53473 admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:56:18.352539 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a983c8e-2f46-4a0a-b572-7e6273f53473 admin admin] PATH_INFO: `/v3/projects/f9730985e6b444a8b344093607a9cd95/users/35adfeb50b9d4944b51e540977978756/roles/1c93019874174c4b91118d9ce2347e47` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:56:18.368050 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a983c8e-2f46-4a0a-b572-7e6273f53473 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f9730985e6b444a8b344093607a9cd95, user_id=35adfeb50b9d4944b51e540977978756, role_id=1c93019874174c4b91118d9ce2347e47)` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:56:18.370664 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a983c8e-2f46-4a0a-b572-7e6273f53473 admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:56:18.387391 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 1196/2404] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 30 00:56:18 2022] PUT /identity/v3/projects/f9730985e6b444a8b344093607a9cd95/users/35adfeb50b9d4944b51e540977978756/roles/1c93019874174c4b91118d9ce2347e47 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 00:56:18.392424 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95652729-ffef-4fec-90e5-49529099c9d7 None None] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:56:18.392734 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95652729-ffef-4fec-90e5-49529099c9d7 None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:56:18.393021 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95652729-ffef-4fec-90e5-49529099c9d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:56:18.412172 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.auth.core [None req-95652729-ffef-4fec-90e5-49529099c9d7 None None] MFA Rules not processed for user `eb55b6cbca4945abb21b0e49eb745e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=87956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:56:18.413474 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-95652729-ffef-4fec-90e5-49529099c9d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:56:18.448471 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:56:18.481513 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 1209/2405] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 30 00:56:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:56:18.491221 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a983c8e-2f46-4a0a-b572-7e6273f53473 admin admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:56:18.493120 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-4a983c8e-2f46-4a0a-b572-7e6273f53473 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:56:18.569911 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a983c8e-2f46-4a0a-b572-7e6273f53473 admin admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:56:18.574203 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f41e1cc-97a2-467f-a482-48bf2eef2cf4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5693f186c6ad4d9394f02ee3477cdcd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d2387fdf794d4eaef07bbcd7b39f2a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:56:18.574799 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f41e1cc-97a2-467f-a482-48bf2eef2cf4 service neutron] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:56:18.575070 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f41e1cc-97a2-467f-a482-48bf2eef2cf4 service neutron] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:56:18.575363 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f41e1cc-97a2-467f-a482-48bf2eef2cf4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:56:18.584895 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f41e1cc-97a2-467f-a482-48bf2eef2cf4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:56:18.586454 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f41e1cc-97a2-467f-a482-48bf2eef2cf4 service neutron] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:56:18.596352 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 1197/2406] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 30 00:56:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 00:56:22.736411 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debad191-3c46-4a1f-b044-a7bd4e16d4ef None None] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:56:22.737002 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debad191-3c46-4a1f-b044-a7bd4e16d4ef None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:56:22.737002 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debad191-3c46-4a1f-b044-a7bd4e16d4ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:56:22.771743 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.auth.core [None req-debad191-3c46-4a1f-b044-a7bd4e16d4ef None None] MFA Rules not processed for user `35adfeb50b9d4944b51e540977978756`. Rule list: `[]` (Enabled: `True`). {{(pid=87956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:56:22.773019 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-debad191-3c46-4a1f-b044-a7bd4e16d4ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:56:22.846466 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 1210/2407] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 30 00:56:22 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:56:22.851062 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f41e1cc-97a2-467f-a482-48bf2eef2cf4 service neutron] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:56:22.861551 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f41e1cc-97a2-467f-a482-48bf2eef2cf4 service neutron] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:56:22.866077 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63346d5f-8839-401d-a957-68e5805291da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:56:22.866676 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63346d5f-8839-401d-a957-68e5805291da admin admin] REQUEST_METHOD: `POST` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:56:22.866955 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63346d5f-8839-401d-a957-68e5805291da admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:56:22.867253 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63346d5f-8839-401d-a957-68e5805291da admin admin] PATH_INFO: `/v3/projects` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:56:22.867899 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63346d5f-8839-401d-a957-68e5805291da admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:56:22.869834 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63346d5f-8839-401d-a957-68e5805291da admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:56:22.902107 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 1198/2408] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 30 00:56:22 2022] POST /identity/v3/projects => generated 383 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 30 00:56:22.903572 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debad191-3c46-4a1f-b044-a7bd4e16d4ef None None] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:56:22.914487 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debad191-3c46-4a1f-b044-a7bd4e16d4ef None None] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:56:22.979001 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da96be76-eed4-4f0d-97d1-6be83dc900d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:56:22.979881 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da96be76-eed4-4f0d-97d1-6be83dc900d4 admin admin] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:56:22.980307 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da96be76-eed4-4f0d-97d1-6be83dc900d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:56:22.980841 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da96be76-eed4-4f0d-97d1-6be83dc900d4 admin admin] PATH_INFO: `/v3/users` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:56:22.981496 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da96be76-eed4-4f0d-97d1-6be83dc900d4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:56:22.983423 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da96be76-eed4-4f0d-97d1-6be83dc900d4 admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:56:23.017554 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 1211/2409] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 30 00:56:22 2022] POST /identity/v3/users => generated 298 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 00:56:23.018862 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63346d5f-8839-401d-a957-68e5805291da admin admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:56:23.030126 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63346d5f-8839-401d-a957-68e5805291da admin admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:56:23.035522 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c9a520-740a-403a-8bd4-41b776241e80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:56:23.036839 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c9a520-740a-403a-8bd4-41b776241e80 admin admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:56:23.037109 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c9a520-740a-403a-8bd4-41b776241e80 admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:56:23.037438 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c9a520-740a-403a-8bd4-41b776241e80 admin admin] PATH_INFO: `/v3/roles` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:56:23.038099 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c9a520-740a-403a-8bd4-41b776241e80 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:56:23.039731 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c9a520-740a-403a-8bd4-41b776241e80 admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:56:23.054679 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 1199/2410] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 30 00:56:23 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 00:56:23.058814 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da96be76-eed4-4f0d-97d1-6be83dc900d4 admin admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:56:23.076310 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da96be76-eed4-4f0d-97d1-6be83dc900d4 admin admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:56:23.082740 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555229a4-9284-451f-99cb-e29d8bb3f1a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:56:23.083466 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555229a4-9284-451f-99cb-e29d8bb3f1a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:56:23.083732 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555229a4-9284-451f-99cb-e29d8bb3f1a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:56:23.084007 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555229a4-9284-451f-99cb-e29d8bb3f1a5 admin admin] PATH_INFO: `/v3/projects/d17f7f7526f74401a2782adc57dab96e/users/7055c493b3904dbbb27ba0ca15db8a6a/roles/6ccaa8c11f29456fb4e4eeccb21616c7` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:56:23.102290 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555229a4-9284-451f-99cb-e29d8bb3f1a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d17f7f7526f74401a2782adc57dab96e, user_id=7055c493b3904dbbb27ba0ca15db8a6a, role_id=6ccaa8c11f29456fb4e4eeccb21616c7)` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:56:23.107036 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555229a4-9284-451f-99cb-e29d8bb3f1a5 admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:56:23.126542 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 1212/2411] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 30 00:56:23 2022] PUT /identity/v3/projects/d17f7f7526f74401a2782adc57dab96e/users/7055c493b3904dbbb27ba0ca15db8a6a/roles/6ccaa8c11f29456fb4e4eeccb21616c7 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 00:56:23.128385 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c9a520-740a-403a-8bd4-41b776241e80 admin admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:56:23.150982 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c9a520-740a-403a-8bd4-41b776241e80 admin admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:56:23.220280 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:56:23.237677 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ca2551-3abc-476c-99f7-cc2f476c1b9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:56:23.238291 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ca2551-3abc-476c-99f7-cc2f476c1b9a admin admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:56:23.238563 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ca2551-3abc-476c-99f7-cc2f476c1b9a admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:56:23.238839 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ca2551-3abc-476c-99f7-cc2f476c1b9a admin admin] PATH_INFO: `/v3/roles` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:56:23.239536 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ca2551-3abc-476c-99f7-cc2f476c1b9a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:56:23.241217 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ca2551-3abc-476c-99f7-cc2f476c1b9a admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:56:23.252159 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 1200/2412] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 30 00:56:23 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 00:56:23.256344 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555229a4-9284-451f-99cb-e29d8bb3f1a5 admin admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:56:23.269044 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555229a4-9284-451f-99cb-e29d8bb3f1a5 admin admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:56:23.274012 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1544a88-0813-4120-910d-8413a53a9c8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:56:23.274694 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1544a88-0813-4120-910d-8413a53a9c8e admin admin] REQUEST_METHOD: `PUT` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:56:23.274974 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1544a88-0813-4120-910d-8413a53a9c8e admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:56:23.275297 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1544a88-0813-4120-910d-8413a53a9c8e admin admin] PATH_INFO: `/v3/projects/d17f7f7526f74401a2782adc57dab96e/users/7055c493b3904dbbb27ba0ca15db8a6a/roles/6ccaa8c11f29456fb4e4eeccb21616c7` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:56:23.277287 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1544a88-0813-4120-910d-8413a53a9c8e admin admin] RBAC: Authorizing `identity:create_grant(project_id=d17f7f7526f74401a2782adc57dab96e, user_id=7055c493b3904dbbb27ba0ca15db8a6a, role_id=6ccaa8c11f29456fb4e4eeccb21616c7)` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:56:23.280006 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1544a88-0813-4120-910d-8413a53a9c8e admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:56:23.291186 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 1213/2413] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 30 00:56:23 2022] PUT /identity/v3/projects/d17f7f7526f74401a2782adc57dab96e/users/7055c493b3904dbbb27ba0ca15db8a6a/roles/6ccaa8c11f29456fb4e4eeccb21616c7 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 00:56:27.680728 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ca2551-3abc-476c-99f7-cc2f476c1b9a admin admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:56:27.683180 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-03ca2551-3abc-476c-99f7-cc2f476c1b9a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:56:27.849658 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ca2551-3abc-476c-99f7-cc2f476c1b9a admin admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:56:27.971887 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df51e4c3-8d61-4fcc-a9ab-441729efcd73 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fde877b6ddc74f4a87baf21471eb31d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d2387fdf794d4eaef07bbcd7b39f2a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:56:27.972842 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df51e4c3-8d61-4fcc-a9ab-441729efcd73 service nova] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:56:27.973533 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df51e4c3-8d61-4fcc-a9ab-441729efcd73 service nova] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:56:27.973994 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df51e4c3-8d61-4fcc-a9ab-441729efcd73 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:56:27.976305 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-df51e4c3-8d61-4fcc-a9ab-441729efcd73 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:56:27.991214 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df51e4c3-8d61-4fcc-a9ab-441729efcd73 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:56:27.993309 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df51e4c3-8d61-4fcc-a9ab-441729efcd73 service nova] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:56:28.006680 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 1201/2414] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 30 00:56:27 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 00:56:29.263538 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b045418-71e6-444b-ab8b-10f4dd1faa92 None None] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:56:29.264017 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b045418-71e6-444b-ab8b-10f4dd1faa92 None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:56:29.264120 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b045418-71e6-444b-ab8b-10f4dd1faa92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:56:29.297908 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.auth.core [None req-6b045418-71e6-444b-ab8b-10f4dd1faa92 None None] MFA Rules not processed for user `7055c493b3904dbbb27ba0ca15db8a6a`. Rule list: `[]` (Enabled: `True`). {{(pid=87956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:56:29.299273 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-6b045418-71e6-444b-ab8b-10f4dd1faa92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:56:29.303877 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:56:29.399778 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 1214/2415] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 30 00:56:29 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:56:29.414760 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df51e4c3-8d61-4fcc-a9ab-441729efcd73 service nova] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:56:29.416305 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-df51e4c3-8d61-4fcc-a9ab-441729efcd73 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:56:29.468198 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=100 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:56:29.488323 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df51e4c3-8d61-4fcc-a9ab-441729efcd73 service nova] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:56:29.492288 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56cc5c3-60f9-49e6-8e9f-1f58ccd6fe90 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36a86cf3eaf24b369737b65046142593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d2387fdf794d4eaef07bbcd7b39f2a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:56:29.492897 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56cc5c3-60f9-49e6-8e9f-1f58ccd6fe90 service glance] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:56:29.493175 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56cc5c3-60f9-49e6-8e9f-1f58ccd6fe90 service glance] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:56:29.493442 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56cc5c3-60f9-49e6-8e9f-1f58ccd6fe90 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:56:29.554071 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56cc5c3-60f9-49e6-8e9f-1f58ccd6fe90 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:56:29.555568 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56cc5c3-60f9-49e6-8e9f-1f58ccd6fe90 service glance] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:56:29.565851 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 1202/2416] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 30 00:56:29 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 00:56:29.704154 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc40ded-40ff-403c-a499-51cff556a523 None None] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:56:29.705157 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc40ded-40ff-403c-a499-51cff556a523 None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:56:29.705497 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc40ded-40ff-403c-a499-51cff556a523 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:56:29.737429 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.auth.core [None req-adc40ded-40ff-403c-a499-51cff556a523 None None] MFA Rules not processed for user `3e7b21b55fb84a6cad507a8954492d48`. Rule list: `[]` (Enabled: `True`). {{(pid=87956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:56:29.738629 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-adc40ded-40ff-403c-a499-51cff556a523 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:56:29.793277 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 1215/2417] 10.222.0.42 () {58 vars in 1009 bytes} [Sun Oct 30 00:56:29 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:56:29.845907 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56cc5c3-60f9-49e6-8e9f-1f58ccd6fe90 service glance] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:56:29.847761 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-a56cc5c3-60f9-49e6-8e9f-1f58ccd6fe90 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:56:29.919666 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56cc5c3-60f9-49e6-8e9f-1f58ccd6fe90 service glance] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:56:29.925068 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750d1d12-1525-4148-8923-45cc3a3a6591 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6d6e884a8104a428e4de6be1cfa467c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d2387fdf794d4eaef07bbcd7b39f2a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:56:29.925676 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750d1d12-1525-4148-8923-45cc3a3a6591 service swift] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:56:29.925945 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750d1d12-1525-4148-8923-45cc3a3a6591 service swift] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:56:29.926214 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750d1d12-1525-4148-8923-45cc3a3a6591 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:56:29.935295 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750d1d12-1525-4148-8923-45cc3a3a6591 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:56:29.936911 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750d1d12-1525-4148-8923-45cc3a3a6591 service swift] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:56:29.945897 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 1203/2418] 10.222.0.42 () {60 vars in 1384 bytes} [Sun Oct 30 00:56:29 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 30 00:56:38.447032 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc64eac-2e72-4f66-a3c2-d8fbac3b2d91 None None] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:56:38.447661 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc64eac-2e72-4f66-a3c2-d8fbac3b2d91 None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:56:38.447661 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc64eac-2e72-4f66-a3c2-d8fbac3b2d91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:56:38.466422 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.auth.core [None req-9dc64eac-2e72-4f66-a3c2-d8fbac3b2d91 None None] MFA Rules not processed for user `35adfeb50b9d4944b51e540977978756`. Rule list: `[]` (Enabled: `True`). {{(pid=87956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:56:38.467640 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-9dc64eac-2e72-4f66-a3c2-d8fbac3b2d91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:56:38.474738 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 1216/2419] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 30 00:56:38 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:56:38.746530 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750d1d12-1525-4148-8923-45cc3a3a6591 service swift] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:56:38.822950 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750d1d12-1525-4148-8923-45cc3a3a6591 service swift] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:56:38.827729 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11230582-abf5-49ea-a98f-d95007f3346e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5693f186c6ad4d9394f02ee3477cdcd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d2387fdf794d4eaef07bbcd7b39f2a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:56:38.828308 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11230582-abf5-49ea-a98f-d95007f3346e service neutron] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:56:38.828584 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11230582-abf5-49ea-a98f-d95007f3346e service neutron] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:56:38.828864 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11230582-abf5-49ea-a98f-d95007f3346e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:56:38.830790 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-11230582-abf5-49ea-a98f-d95007f3346e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:56:38.856070 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11230582-abf5-49ea-a98f-d95007f3346e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:56:38.857507 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11230582-abf5-49ea-a98f-d95007f3346e service neutron] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:56:38.866368 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 1204/2420] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 30 00:56:38 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 00:56:40.666813 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ec98fb-0997-4516-8fb0-1280aae1f83b None None] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:56:40.667342 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ec98fb-0997-4516-8fb0-1280aae1f83b None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:56:40.667951 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ec98fb-0997-4516-8fb0-1280aae1f83b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:56:40.688208 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.auth.core [None req-66ec98fb-0997-4516-8fb0-1280aae1f83b None None] MFA Rules not processed for user `3e7b21b55fb84a6cad507a8954492d48`. Rule list: `[]` (Enabled: `True`). {{(pid=87956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:56:40.689443 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-66ec98fb-0997-4516-8fb0-1280aae1f83b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:56:40.697888 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 1217/2421] 10.222.0.42 () {58 vars in 1009 bytes} [Sun Oct 30 00:56:40 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:56:40.711406 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11230582-abf5-49ea-a98f-d95007f3346e service neutron] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:56:40.718614 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=100 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:56:40.724989 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11230582-abf5-49ea-a98f-d95007f3346e service neutron] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:56:40.730581 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5419a4-54c7-441b-8725-993e24c3c475 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6d6e884a8104a428e4de6be1cfa467c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d2387fdf794d4eaef07bbcd7b39f2a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:56:40.731185 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5419a4-54c7-441b-8725-993e24c3c475 service swift] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:56:40.731503 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5419a4-54c7-441b-8725-993e24c3c475 service swift] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:56:40.731776 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5419a4-54c7-441b-8725-993e24c3c475 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:56:40.741324 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5419a4-54c7-441b-8725-993e24c3c475 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:56:40.743004 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5419a4-54c7-441b-8725-993e24c3c475 service swift] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:56:40.752171 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 1205/2422] 10.222.0.42 () {60 vars in 1384 bytes} [Sun Oct 30 00:56:40 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 30 00:56:50.682213 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=62 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:56:50.748963 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=5 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:57:01.912844 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ec98fb-0997-4516-8fb0-1280aae1f83b None None] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:57:01.914498 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-66ec98fb-0997-4516-8fb0-1280aae1f83b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:57:01.926451 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ec98fb-0997-4516-8fb0-1280aae1f83b None None] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:57:01.930783 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a076c286-ffc9-40a2-bd95-18169c970bef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5693f186c6ad4d9394f02ee3477cdcd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d2387fdf794d4eaef07bbcd7b39f2a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:57:01.931410 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a076c286-ffc9-40a2-bd95-18169c970bef service neutron] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:57:01.931683 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a076c286-ffc9-40a2-bd95-18169c970bef service neutron] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:57:01.931949 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a076c286-ffc9-40a2-bd95-18169c970bef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:57:01.941936 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a076c286-ffc9-40a2-bd95-18169c970bef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:57:01.943426 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a076c286-ffc9-40a2-bd95-18169c970bef service neutron] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:57:01.952742 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 1218/2423] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 30 00:57:01 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 00:57:11.948781 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=6 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:57:18.922166 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5419a4-54c7-441b-8725-993e24c3c475 service swift] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:57:18.923627 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-8e5419a4-54c7-441b-8725-993e24c3c475 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:57:19.019972 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5419a4-54c7-441b-8725-993e24c3c475 service swift] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:57:19.025091 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86de6704-f36b-4f20-92a6-c8414aeb2db9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '202b8b2c0f454297bfb97c1ac4033625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d2387fdf794d4eaef07bbcd7b39f2a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:57:19.025743 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86de6704-f36b-4f20-92a6-c8414aeb2db9 service placement] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:57:19.026018 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86de6704-f36b-4f20-92a6-c8414aeb2db9 service placement] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:57:19.026288 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86de6704-f36b-4f20-92a6-c8414aeb2db9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:57:19.028307 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-86de6704-f36b-4f20-92a6-c8414aeb2db9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:57:19.040819 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86de6704-f36b-4f20-92a6-c8414aeb2db9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:57:19.042395 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86de6704-f36b-4f20-92a6-c8414aeb2db9 service placement] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:57:19.052640 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 1206/2424] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 30 00:57:18 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 00:57:27.834105 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a076c286-ffc9-40a2-bd95-18169c970bef service neutron] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:57:27.835686 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-a076c286-ffc9-40a2-bd95-18169c970bef service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:57:27.909773 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a076c286-ffc9-40a2-bd95-18169c970bef service neutron] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:57:27.914424 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0722b0-16ac-4479-ad9d-677f05959fff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:57:27.915079 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0722b0-16ac-4479-ad9d-677f05959fff admin admin] REQUEST_METHOD: `DELETE` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:57:27.915403 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0722b0-16ac-4479-ad9d-677f05959fff admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:57:27.915673 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0722b0-16ac-4479-ad9d-677f05959fff admin admin] PATH_INFO: `/v3/users/8fb18a4735734c1e8db3ee7960e983d4` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:57:27.916844 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0722b0-16ac-4479-ad9d-677f05959fff admin admin] RBAC: Authorizing `identity:delete_user(user_id=8fb18a4735734c1e8db3ee7960e983d4)` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:57:27.919091 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0722b0-16ac-4479-ad9d-677f05959fff admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:57:27.968127 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-fc0722b0-16ac-4479-ad9d-677f05959fff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8fb18a4735734c1e8db3ee7960e983d4'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:57:27.968794 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-fc0722b0-16ac-4479-ad9d-677f05959fff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8fb18a4735734c1e8db3ee7960e983d4'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:57:27.981559 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-fc0722b0-16ac-4479-ad9d-677f05959fff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8fb18a4735734c1e8db3ee7960e983d4'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:57:27.991063 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-fc0722b0-16ac-4479-ad9d-677f05959fff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8fb18a4735734c1e8db3ee7960e983d4'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:57:27.997899 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-fc0722b0-16ac-4479-ad9d-677f05959fff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8fb18a4735734c1e8db3ee7960e983d4'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:57:28.004114 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 1219/2425] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 30 00:57:27 2022] DELETE /identity/v3/users/8fb18a4735734c1e8db3ee7960e983d4 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 00:57:28.194278 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86de6704-f36b-4f20-92a6-c8414aeb2db9 service placement] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:57:28.207490 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86de6704-f36b-4f20-92a6-c8414aeb2db9 service placement] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:57:28.270716 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb5e36b-d3a0-4702-9a94-a9095cd02b18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:57:28.271380 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb5e36b-d3a0-4702-9a94-a9095cd02b18 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:57:28.271657 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb5e36b-d3a0-4702-9a94-a9095cd02b18 admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:57:28.271924 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb5e36b-d3a0-4702-9a94-a9095cd02b18 admin admin] PATH_INFO: `/v3/projects/068dde3247574ea6b36561a62c98ad24` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:57:28.273023 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb5e36b-d3a0-4702-9a94-a9095cd02b18 admin admin] RBAC: Authorizing `identity:delete_project(project_id=068dde3247574ea6b36561a62c98ad24)` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:57:28.274910 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb5e36b-d3a0-4702-9a94-a9095cd02b18 admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:57:28.320991 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-bcb5e36b-d3a0-4702-9a94-a9095cd02b18 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '068dde3247574ea6b36561a62c98ad24', 'request_id': 'req-bcb5e36b-d3a0-4702-9a94-a9095cd02b18'} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:57:28.326381 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-bcb5e36b-d3a0-4702-9a94-a9095cd02b18 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '068dde3247574ea6b36561a62c98ad24', 'request_id': 'req-bcb5e36b-d3a0-4702-9a94-a9095cd02b18'} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:57:28.334968 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-bcb5e36b-d3a0-4702-9a94-a9095cd02b18 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '068dde3247574ea6b36561a62c98ad24', 'request_id': 'req-bcb5e36b-d3a0-4702-9a94-a9095cd02b18'} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:57:28.343456 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:57:28.347292 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-bcb5e36b-d3a0-4702-9a94-a9095cd02b18 admin admin] The token cache is being invalidate because project 068dde3247574ea6b36561a62c98ad24 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87955) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 00:57:28.347916 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-bcb5e36b-d3a0-4702-9a94-a9095cd02b18 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:57:28.349313 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-bcb5e36b-d3a0-4702-9a94-a9095cd02b18 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:57:28.350947 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 1207/2426] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 30 00:57:28 2022] DELETE /identity/v3/projects/068dde3247574ea6b36561a62c98ad24 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 00:57:28.356177 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0989b0d6-8372-458b-af06-bd8d8d012c2c None None] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:57:28.356468 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0989b0d6-8372-458b-af06-bd8d8d012c2c None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:57:28.356742 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0989b0d6-8372-458b-af06-bd8d8d012c2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:57:28.377609 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.auth.core [None req-0989b0d6-8372-458b-af06-bd8d8d012c2c None None] MFA Rules not processed for user `eb55b6cbca4945abb21b0e49eb745e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=87956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:57:28.378856 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-0989b0d6-8372-458b-af06-bd8d8d012c2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:57:28.443370 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 1220/2427] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 30 00:57:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:57:28.452731 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dfb99f-3c49-4046-8b16-602df0981ccc None None] REQUEST_METHOD: `POST` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:57:28.453019 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dfb99f-3c49-4046-8b16-602df0981ccc None None] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:57:28.453289 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dfb99f-3c49-4046-8b16-602df0981ccc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:57:28.475385 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.auth.core [None req-f1dfb99f-3c49-4046-8b16-602df0981ccc None None] MFA Rules not processed for user `eb55b6cbca4945abb21b0e49eb745e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=87955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:57:28.476607 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-f1dfb99f-3c49-4046-8b16-602df0981ccc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:57:28.486067 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 1208/2428] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 30 00:57:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:57:28.490517 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0989b0d6-8372-458b-af06-bd8d8d012c2c None None] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:57:28.500759 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0989b0d6-8372-458b-af06-bd8d8d012c2c None None] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:57:28.508017 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ad261a-8b1d-4755-8824-4758e16061b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:57:28.508884 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ad261a-8b1d-4755-8824-4758e16061b9 admin admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:57:28.509252 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ad261a-8b1d-4755-8824-4758e16061b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:57:28.509572 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ad261a-8b1d-4755-8824-4758e16061b9 admin admin] PATH_INFO: `/v3/domains` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:57:28.510544 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ad261a-8b1d-4755-8824-4758e16061b9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87956) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:57:28.510951 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ad261a-8b1d-4755-8824-4758e16061b9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:57:28.513369 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ad261a-8b1d-4755-8824-4758e16061b9 admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:57:28.531622 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 1221/2429] 10.222.0.42 () {58 vars in 1153 bytes} [Sun Oct 30 00:57:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:57:28.535977 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1dfb99f-3c49-4046-8b16-602df0981ccc None None] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:57:28.545451 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1dfb99f-3c49-4046-8b16-602df0981ccc None None] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:57:28.551112 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da1eb40-169b-475e-80bb-beca18b66011 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:57:28.551731 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da1eb40-169b-475e-80bb-beca18b66011 admin admin] REQUEST_METHOD: `POST` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:57:28.551997 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da1eb40-169b-475e-80bb-beca18b66011 admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:57:28.552244 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da1eb40-169b-475e-80bb-beca18b66011 admin admin] PATH_INFO: `/v3/projects` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:57:28.552866 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da1eb40-169b-475e-80bb-beca18b66011 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:57:28.554755 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da1eb40-169b-475e-80bb-beca18b66011 admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:57:28.587686 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 1209/2430] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 30 00:57:28 2022] POST /identity/v3/projects => generated 385 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 00:57:28.592593 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ad261a-8b1d-4755-8824-4758e16061b9 admin admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:57:28.603454 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ad261a-8b1d-4755-8824-4758e16061b9 admin admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:57:28.607317 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:57:28.664172 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e337ab-3c64-453f-af56-cf78f98cb6da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:57:28.664793 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e337ab-3c64-453f-af56-cf78f98cb6da admin admin] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:57:28.665048 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e337ab-3c64-453f-af56-cf78f98cb6da admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:57:28.665331 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e337ab-3c64-453f-af56-cf78f98cb6da admin admin] PATH_INFO: `/v3/users` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:57:28.665965 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e337ab-3c64-453f-af56-cf78f98cb6da admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:57:28.667976 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e337ab-3c64-453f-af56-cf78f98cb6da admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:57:28.692363 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 1222/2431] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 30 00:57:28 2022] POST /identity/v3/users => generated 293 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 00:57:28.696835 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da1eb40-169b-475e-80bb-beca18b66011 admin admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:57:28.707484 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da1eb40-169b-475e-80bb-beca18b66011 admin admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:57:28.713644 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0132575a-8a66-4a46-8617-3ba0097fa64a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:57:28.714345 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0132575a-8a66-4a46-8617-3ba0097fa64a admin admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:57:28.714691 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0132575a-8a66-4a46-8617-3ba0097fa64a admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:57:28.715033 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0132575a-8a66-4a46-8617-3ba0097fa64a admin admin] PATH_INFO: `/v3/roles` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:57:28.715884 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0132575a-8a66-4a46-8617-3ba0097fa64a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:57:28.717490 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0132575a-8a66-4a46-8617-3ba0097fa64a admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:57:28.728688 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 1210/2432] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 30 00:57:28 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 30 00:57:28.732871 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e337ab-3c64-453f-af56-cf78f98cb6da admin admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:57:28.743114 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e337ab-3c64-453f-af56-cf78f98cb6da admin admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:57:28.748380 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fcbd36-f274-4107-b6e9-2addd982bec2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:57:28.748969 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fcbd36-f274-4107-b6e9-2addd982bec2 admin admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:57:28.749253 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fcbd36-f274-4107-b6e9-2addd982bec2 admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:57:28.749595 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fcbd36-f274-4107-b6e9-2addd982bec2 admin admin] PATH_INFO: `/v3/roles` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:57:28.750259 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fcbd36-f274-4107-b6e9-2addd982bec2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:57:28.751953 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fcbd36-f274-4107-b6e9-2addd982bec2 admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:57:28.763174 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 1223/2433] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 30 00:57:28 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 00:57:28.767374 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0132575a-8a66-4a46-8617-3ba0097fa64a admin admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:57:28.778327 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0132575a-8a66-4a46-8617-3ba0097fa64a admin admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:57:28.784237 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730a193a-c92f-447f-b44b-f884323d9c0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:57:28.784916 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730a193a-c92f-447f-b44b-f884323d9c0a admin admin] REQUEST_METHOD: `PUT` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:57:28.785197 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730a193a-c92f-447f-b44b-f884323d9c0a admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:57:28.785457 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730a193a-c92f-447f-b44b-f884323d9c0a admin admin] PATH_INFO: `/v3/projects/03701223e600437ab57be1c841217eef/users/5918c106fb27472db3edcc1bc886c1d7/roles/1c93019874174c4b91118d9ce2347e47` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:57:28.803954 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730a193a-c92f-447f-b44b-f884323d9c0a admin admin] RBAC: Authorizing `identity:create_grant(project_id=03701223e600437ab57be1c841217eef, user_id=5918c106fb27472db3edcc1bc886c1d7, role_id=1c93019874174c4b91118d9ce2347e47)` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:57:28.806670 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730a193a-c92f-447f-b44b-f884323d9c0a admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:57:28.821179 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 1211/2434] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 30 00:57:28 2022] PUT /identity/v3/projects/03701223e600437ab57be1c841217eef/users/5918c106fb27472db3edcc1bc886c1d7/roles/1c93019874174c4b91118d9ce2347e47 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 00:57:28.831764 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3523b8de-2755-4ed2-8624-d070b0a4a5e7 None None] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:57:28.832044 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3523b8de-2755-4ed2-8624-d070b0a4a5e7 None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:57:28.832317 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3523b8de-2755-4ed2-8624-d070b0a4a5e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:57:28.862394 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.auth.core [None req-3523b8de-2755-4ed2-8624-d070b0a4a5e7 None None] MFA Rules not processed for user `5918c106fb27472db3edcc1bc886c1d7`. Rule list: `[]` (Enabled: `True`). {{(pid=87956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:57:28.863664 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-3523b8de-2755-4ed2-8624-d070b0a4a5e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:57:28.935283 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 1224/2435] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 30 00:57:28 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:57:28.940349 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730a193a-c92f-447f-b44b-f884323d9c0a admin admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:57:29.008581 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730a193a-c92f-447f-b44b-f884323d9c0a admin admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:57:29.015040 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f6e41b-c0a9-4326-a06f-cd16b3acdfed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:57:29.015708 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f6e41b-c0a9-4326-a06f-cd16b3acdfed admin admin] REQUEST_METHOD: `POST` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:57:29.015982 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f6e41b-c0a9-4326-a06f-cd16b3acdfed admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:57:29.016248 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f6e41b-c0a9-4326-a06f-cd16b3acdfed admin admin] PATH_INFO: `/v3/projects` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:57:29.016897 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f6e41b-c0a9-4326-a06f-cd16b3acdfed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:57:29.018853 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f6e41b-c0a9-4326-a06f-cd16b3acdfed admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:57:29.046990 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 1212/2436] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 30 00:57:28 2022] POST /identity/v3/projects => generated 385 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 00:57:29.051025 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3523b8de-2755-4ed2-8624-d070b0a4a5e7 None None] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:57:29.062396 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3523b8de-2755-4ed2-8624-d070b0a4a5e7 None None] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:57:29.123574 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3f6ad5-a8f4-44fb-98fe-e6c9a3c190cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:57:29.124165 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3f6ad5-a8f4-44fb-98fe-e6c9a3c190cd admin admin] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:57:29.124455 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3f6ad5-a8f4-44fb-98fe-e6c9a3c190cd admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:57:29.124730 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3f6ad5-a8f4-44fb-98fe-e6c9a3c190cd admin admin] PATH_INFO: `/v3/users` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:57:29.125346 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3f6ad5-a8f4-44fb-98fe-e6c9a3c190cd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:57:29.127362 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3f6ad5-a8f4-44fb-98fe-e6c9a3c190cd admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:57:29.149113 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 1225/2437] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 30 00:57:29 2022] POST /identity/v3/users => generated 299 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 00:57:29.153422 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f6e41b-c0a9-4326-a06f-cd16b3acdfed admin admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:57:29.164348 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f6e41b-c0a9-4326-a06f-cd16b3acdfed admin admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:57:29.169590 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d152750c-0cf7-451d-a431-694891719002 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:57:29.170193 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d152750c-0cf7-451d-a431-694891719002 admin admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:57:29.170469 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d152750c-0cf7-451d-a431-694891719002 admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:57:29.170766 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d152750c-0cf7-451d-a431-694891719002 admin admin] PATH_INFO: `/v3/roles` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:57:29.171446 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d152750c-0cf7-451d-a431-694891719002 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:57:29.173064 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d152750c-0cf7-451d-a431-694891719002 admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:57:29.183611 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 1213/2438] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 30 00:57:29 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 00:57:29.187957 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3f6ad5-a8f4-44fb-98fe-e6c9a3c190cd admin admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:57:29.195014 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:57:29.198991 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3f6ad5-a8f4-44fb-98fe-e6c9a3c190cd admin admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:57:29.204776 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e902de84-2d2e-428e-825f-16a5c5995a33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:57:29.205463 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e902de84-2d2e-428e-825f-16a5c5995a33 admin admin] REQUEST_METHOD: `PUT` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:57:29.205746 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e902de84-2d2e-428e-825f-16a5c5995a33 admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:57:29.206020 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e902de84-2d2e-428e-825f-16a5c5995a33 admin admin] PATH_INFO: `/v3/projects/8d4e7e8aecab464f931ee0ac0afa43f6/users/04c77747a83d42f783cc915ea83432b4/roles/6ccaa8c11f29456fb4e4eeccb21616c7` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:57:29.222306 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e902de84-2d2e-428e-825f-16a5c5995a33 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d4e7e8aecab464f931ee0ac0afa43f6, user_id=04c77747a83d42f783cc915ea83432b4, role_id=6ccaa8c11f29456fb4e4eeccb21616c7)` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:57:29.224961 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e902de84-2d2e-428e-825f-16a5c5995a33 admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:57:29.243520 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 1226/2439] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 30 00:57:29 2022] PUT /identity/v3/projects/8d4e7e8aecab464f931ee0ac0afa43f6/users/04c77747a83d42f783cc915ea83432b4/roles/6ccaa8c11f29456fb4e4eeccb21616c7 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 00:57:29.248818 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d152750c-0cf7-451d-a431-694891719002 admin admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:57:29.259150 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d152750c-0cf7-451d-a431-694891719002 admin admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:57:29.333288 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8428c6e-2379-4e46-9048-39f0b4f74ec2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:57:29.333892 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8428c6e-2379-4e46-9048-39f0b4f74ec2 admin admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:57:29.334166 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8428c6e-2379-4e46-9048-39f0b4f74ec2 admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:57:29.334432 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8428c6e-2379-4e46-9048-39f0b4f74ec2 admin admin] PATH_INFO: `/v3/roles` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:57:29.335065 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8428c6e-2379-4e46-9048-39f0b4f74ec2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:57:29.336711 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8428c6e-2379-4e46-9048-39f0b4f74ec2 admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:57:29.346736 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 1214/2440] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 30 00:57:29 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 00:57:29.353460 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e902de84-2d2e-428e-825f-16a5c5995a33 admin admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:57:29.369704 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e902de84-2d2e-428e-825f-16a5c5995a33 admin admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:57:29.377086 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68faf0c3-cd46-4204-ac16-6bdf3a24c488 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:57:29.377779 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68faf0c3-cd46-4204-ac16-6bdf3a24c488 admin admin] REQUEST_METHOD: `PUT` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:57:29.378019 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68faf0c3-cd46-4204-ac16-6bdf3a24c488 admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:57:29.378286 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68faf0c3-cd46-4204-ac16-6bdf3a24c488 admin admin] PATH_INFO: `/v3/projects/8d4e7e8aecab464f931ee0ac0afa43f6/users/04c77747a83d42f783cc915ea83432b4/roles/6ccaa8c11f29456fb4e4eeccb21616c7` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:57:29.380243 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68faf0c3-cd46-4204-ac16-6bdf3a24c488 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d4e7e8aecab464f931ee0ac0afa43f6, user_id=04c77747a83d42f783cc915ea83432b4, role_id=6ccaa8c11f29456fb4e4eeccb21616c7)` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:57:29.382864 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68faf0c3-cd46-4204-ac16-6bdf3a24c488 admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:57:29.393636 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 1227/2441] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 30 00:57:29 2022] PUT /identity/v3/projects/8d4e7e8aecab464f931ee0ac0afa43f6/users/04c77747a83d42f783cc915ea83432b4/roles/6ccaa8c11f29456fb4e4eeccb21616c7 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 00:57:29.404152 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e00d677-868f-4f62-947a-30e46bd64eba None None] REQUEST_METHOD: `POST` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:57:29.404670 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e00d677-868f-4f62-947a-30e46bd64eba None None] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:57:29.404820 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e00d677-868f-4f62-947a-30e46bd64eba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:57:29.419063 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:57:29.435171 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.auth.core [None req-0e00d677-868f-4f62-947a-30e46bd64eba None None] MFA Rules not processed for user `04c77747a83d42f783cc915ea83432b4`. Rule list: `[]` (Enabled: `True`). {{(pid=87955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:57:29.436456 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-0e00d677-868f-4f62-947a-30e46bd64eba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:57:29.512176 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 1215/2442] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 30 00:57:29 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:57:29.524344 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68faf0c3-cd46-4204-ac16-6bdf3a24c488 admin admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:57:29.526502 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-68faf0c3-cd46-4204-ac16-6bdf3a24c488 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:57:29.609300 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68faf0c3-cd46-4204-ac16-6bdf3a24c488 admin admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:57:29.613261 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197fa986-f494-4228-b329-3f7905eea019 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48d928ff7fe24348ac900f09c56acc20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d2387fdf794d4eaef07bbcd7b39f2a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:57:29.613882 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197fa986-f494-4228-b329-3f7905eea019 service cinder] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:57:29.614162 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197fa986-f494-4228-b329-3f7905eea019 service cinder] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:57:29.614431 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197fa986-f494-4228-b329-3f7905eea019 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:57:29.623688 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197fa986-f494-4228-b329-3f7905eea019 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:57:29.625143 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197fa986-f494-4228-b329-3f7905eea019 service cinder] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:57:29.634491 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 1228/2443] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 30 00:57:29 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 00:57:29.701390 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e00d677-868f-4f62-947a-30e46bd64eba None None] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:57:29.767028 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e00d677-868f-4f62-947a-30e46bd64eba None None] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:57:29.771916 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea6c775-2e55-4f0a-949b-597f7cd5f205 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:57:29.772548 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea6c775-2e55-4f0a-949b-597f7cd5f205 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:57:29.772816 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea6c775-2e55-4f0a-949b-597f7cd5f205 admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:57:29.773095 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea6c775-2e55-4f0a-949b-597f7cd5f205 admin admin] PATH_INFO: `/v3/users/5918c106fb27472db3edcc1bc886c1d7` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:57:29.774246 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea6c775-2e55-4f0a-949b-597f7cd5f205 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5918c106fb27472db3edcc1bc886c1d7)` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:57:29.776285 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea6c775-2e55-4f0a-949b-597f7cd5f205 admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:57:29.826924 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-fea6c775-2e55-4f0a-949b-597f7cd5f205 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5918c106fb27472db3edcc1bc886c1d7'} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:57:29.827644 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-fea6c775-2e55-4f0a-949b-597f7cd5f205 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5918c106fb27472db3edcc1bc886c1d7'} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:57:29.834573 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-fea6c775-2e55-4f0a-949b-597f7cd5f205 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5918c106fb27472db3edcc1bc886c1d7'} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:57:29.835193 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-fea6c775-2e55-4f0a-949b-597f7cd5f205 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5918c106fb27472db3edcc1bc886c1d7'} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:57:29.847858 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-fea6c775-2e55-4f0a-949b-597f7cd5f205 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5918c106fb27472db3edcc1bc886c1d7'} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:57:29.863367 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 1216/2444] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 30 00:57:29 2022] DELETE /identity/v3/users/5918c106fb27472db3edcc1bc886c1d7 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 00:57:29.868007 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0dc764-cd54-435a-86b7-d3244bb8c43f None None] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:57:29.868498 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0dc764-cd54-435a-86b7-d3244bb8c43f None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:57:29.868611 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0dc764-cd54-435a-86b7-d3244bb8c43f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:57:29.888703 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.auth.core [None req-6b0dc764-cd54-435a-86b7-d3244bb8c43f None None] MFA Rules not processed for user `eb55b6cbca4945abb21b0e49eb745e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=87956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:57:29.889917 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-6b0dc764-cd54-435a-86b7-d3244bb8c43f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:57:29.951446 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 1229/2445] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 30 00:57:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 30 00:57:29.961381 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea6c775-2e55-4f0a-949b-597f7cd5f205 admin admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:57:29.962859 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-fea6c775-2e55-4f0a-949b-597f7cd5f205 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:57:29.977042 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:57:30.022069 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea6c775-2e55-4f0a-949b-597f7cd5f205 admin admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:57:30.026045 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984fd266-172a-417b-99a7-7061ef6ef079 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5693f186c6ad4d9394f02ee3477cdcd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d2387fdf794d4eaef07bbcd7b39f2a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:57:30.026644 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984fd266-172a-417b-99a7-7061ef6ef079 service neutron] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:57:30.026921 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984fd266-172a-417b-99a7-7061ef6ef079 service neutron] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:57:30.027210 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984fd266-172a-417b-99a7-7061ef6ef079 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:57:30.036932 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984fd266-172a-417b-99a7-7061ef6ef079 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:57:30.038423 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984fd266-172a-417b-99a7-7061ef6ef079 service neutron] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:57:30.048223 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 1217/2446] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 30 00:57:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 00:57:30.333100 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0dc764-cd54-435a-86b7-d3244bb8c43f None None] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:57:30.334645 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-6b0dc764-cd54-435a-86b7-d3244bb8c43f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:57:30.347063 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0dc764-cd54-435a-86b7-d3244bb8c43f None None] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:57:30.352971 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e38ae0-12a6-4b41-873f-516a41684c67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:57:30.353618 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e38ae0-12a6-4b41-873f-516a41684c67 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:57:30.353892 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e38ae0-12a6-4b41-873f-516a41684c67 admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:57:30.354122 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e38ae0-12a6-4b41-873f-516a41684c67 admin admin] PATH_INFO: `/v3/projects/03701223e600437ab57be1c841217eef` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:57:30.356054 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e38ae0-12a6-4b41-873f-516a41684c67 admin admin] RBAC: Authorizing `identity:delete_project(project_id=03701223e600437ab57be1c841217eef)` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:57:30.358640 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e38ae0-12a6-4b41-873f-516a41684c67 admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:57:30.410731 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:57:30.414412 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-73e38ae0-12a6-4b41-873f-516a41684c67 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '03701223e600437ab57be1c841217eef', 'request_id': 'req-73e38ae0-12a6-4b41-873f-516a41684c67'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:57:30.423516 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-73e38ae0-12a6-4b41-873f-516a41684c67 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '03701223e600437ab57be1c841217eef', 'request_id': 'req-73e38ae0-12a6-4b41-873f-516a41684c67'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:57:30.429991 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-73e38ae0-12a6-4b41-873f-516a41684c67 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '03701223e600437ab57be1c841217eef', 'request_id': 'req-73e38ae0-12a6-4b41-873f-516a41684c67'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:57:30.440858 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-73e38ae0-12a6-4b41-873f-516a41684c67 admin admin] The token cache is being invalidate because project 03701223e600437ab57be1c841217eef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87956) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 00:57:30.441137 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-73e38ae0-12a6-4b41-873f-516a41684c67 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:57:30.441772 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-73e38ae0-12a6-4b41-873f-516a41684c67 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:57:30.443285 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 1230/2447] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 30 00:57:30 2022] DELETE /identity/v3/projects/03701223e600437ab57be1c841217eef => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 00:57:30.448053 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984fd266-172a-417b-99a7-7061ef6ef079 service neutron] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:57:30.460808 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984fd266-172a-417b-99a7-7061ef6ef079 service neutron] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:57:30.520306 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e500477-f691-45d7-87c8-aa83f6049856 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:57:30.520916 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e500477-f691-45d7-87c8-aa83f6049856 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:57:30.521197 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e500477-f691-45d7-87c8-aa83f6049856 admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:57:30.521475 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e500477-f691-45d7-87c8-aa83f6049856 admin admin] PATH_INFO: `/v3/users/04c77747a83d42f783cc915ea83432b4` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:57:30.522621 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e500477-f691-45d7-87c8-aa83f6049856 admin admin] RBAC: Authorizing `identity:delete_user(user_id=04c77747a83d42f783cc915ea83432b4)` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:57:30.524561 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e500477-f691-45d7-87c8-aa83f6049856 admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:57:30.574259 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-5e500477-f691-45d7-87c8-aa83f6049856 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '04c77747a83d42f783cc915ea83432b4'} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:57:30.574916 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-5e500477-f691-45d7-87c8-aa83f6049856 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '04c77747a83d42f783cc915ea83432b4'} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:57:30.582133 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-5e500477-f691-45d7-87c8-aa83f6049856 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '04c77747a83d42f783cc915ea83432b4'} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:57:30.582760 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-5e500477-f691-45d7-87c8-aa83f6049856 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '04c77747a83d42f783cc915ea83432b4'} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:57:30.594765 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-5e500477-f691-45d7-87c8-aa83f6049856 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '04c77747a83d42f783cc915ea83432b4'} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:57:30.607763 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 1218/2448] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 30 00:57:30 2022] DELETE /identity/v3/users/04c77747a83d42f783cc915ea83432b4 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 00:57:30.892505 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e38ae0-12a6-4b41-873f-516a41684c67 admin admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:57:30.894094 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-73e38ae0-12a6-4b41-873f-516a41684c67 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:57:30.908137 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e38ae0-12a6-4b41-873f-516a41684c67 admin admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:57:30.976731 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f415b8-f023-4ec9-8433-c55398b28bc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:57:30.977379 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f415b8-f023-4ec9-8433-c55398b28bc2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:57:30.977679 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f415b8-f023-4ec9-8433-c55398b28bc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:57:30.977944 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f415b8-f023-4ec9-8433-c55398b28bc2 admin admin] PATH_INFO: `/v3/projects/8d4e7e8aecab464f931ee0ac0afa43f6` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:57:30.979088 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f415b8-f023-4ec9-8433-c55398b28bc2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8d4e7e8aecab464f931ee0ac0afa43f6)` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:57:30.981320 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f415b8-f023-4ec9-8433-c55398b28bc2 admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:57:31.034925 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-36f415b8-f023-4ec9-8433-c55398b28bc2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8d4e7e8aecab464f931ee0ac0afa43f6', 'request_id': 'req-36f415b8-f023-4ec9-8433-c55398b28bc2'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:57:31.044533 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-36f415b8-f023-4ec9-8433-c55398b28bc2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8d4e7e8aecab464f931ee0ac0afa43f6', 'request_id': 'req-36f415b8-f023-4ec9-8433-c55398b28bc2'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:57:31.051711 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-36f415b8-f023-4ec9-8433-c55398b28bc2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8d4e7e8aecab464f931ee0ac0afa43f6', 'request_id': 'req-36f415b8-f023-4ec9-8433-c55398b28bc2'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:57:31.063776 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-36f415b8-f023-4ec9-8433-c55398b28bc2 admin admin] The token cache is being invalidate because project 8d4e7e8aecab464f931ee0ac0afa43f6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87956) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 00:57:31.064149 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-36f415b8-f023-4ec9-8433-c55398b28bc2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:57:31.065124 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-36f415b8-f023-4ec9-8433-c55398b28bc2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:57:31.070348 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 1231/2449] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 30 00:57:30 2022] DELETE /identity/v3/projects/8d4e7e8aecab464f931ee0ac0afa43f6 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 00:57:31.072147 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d345bed-79ff-4053-97a1-e8c4ad80d7dc None None] REQUEST_METHOD: `POST` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:57:31.072498 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d345bed-79ff-4053-97a1-e8c4ad80d7dc None None] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:57:31.072725 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d345bed-79ff-4053-97a1-e8c4ad80d7dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:57:31.094076 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.auth.core [None req-6d345bed-79ff-4053-97a1-e8c4ad80d7dc None None] MFA Rules not processed for user `eb55b6cbca4945abb21b0e49eb745e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=87955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:57:31.095114 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-6d345bed-79ff-4053-97a1-e8c4ad80d7dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:57:31.125328 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:57:31.156721 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 1219/2450] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 30 00:57:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:57:31.166196 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6673fa-0c1b-417d-9812-b2fc34c73524 None None] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:57:31.166485 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6673fa-0c1b-417d-9812-b2fc34c73524 None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:57:31.166758 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6673fa-0c1b-417d-9812-b2fc34c73524 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:57:31.188653 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.auth.core [None req-ba6673fa-0c1b-417d-9812-b2fc34c73524 None None] MFA Rules not processed for user `eb55b6cbca4945abb21b0e49eb745e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=87956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:57:31.190241 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-ba6673fa-0c1b-417d-9812-b2fc34c73524 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:57:31.199367 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 1232/2451] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 30 00:57:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:57:31.203855 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d345bed-79ff-4053-97a1-e8c4ad80d7dc None None] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:57:31.213763 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d345bed-79ff-4053-97a1-e8c4ad80d7dc None None] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:57:31.219158 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945a7e6f-a49f-480f-ae3d-97d2fb55457b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:57:31.219788 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945a7e6f-a49f-480f-ae3d-97d2fb55457b admin admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:57:31.220088 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945a7e6f-a49f-480f-ae3d-97d2fb55457b admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:57:31.220478 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945a7e6f-a49f-480f-ae3d-97d2fb55457b admin admin] PATH_INFO: `/v3/domains` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:57:31.221131 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945a7e6f-a49f-480f-ae3d-97d2fb55457b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:57:31.221426 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945a7e6f-a49f-480f-ae3d-97d2fb55457b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:57:31.222999 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945a7e6f-a49f-480f-ae3d-97d2fb55457b admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:57:31.235136 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 1220/2452] 10.222.0.42 () {58 vars in 1153 bytes} [Sun Oct 30 00:57:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:57:31.241142 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6673fa-0c1b-417d-9812-b2fc34c73524 None None] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:57:31.250660 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6673fa-0c1b-417d-9812-b2fc34c73524 None None] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:57:31.255722 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310845c1-9fff-4dc7-becf-a38c2098f71d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:57:31.256331 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310845c1-9fff-4dc7-becf-a38c2098f71d admin admin] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:57:31.256604 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310845c1-9fff-4dc7-becf-a38c2098f71d admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:57:31.256975 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310845c1-9fff-4dc7-becf-a38c2098f71d admin admin] PATH_INFO: `/v3/projects` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:57:31.257587 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310845c1-9fff-4dc7-becf-a38c2098f71d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:57:31.259551 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310845c1-9fff-4dc7-becf-a38c2098f71d admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:57:31.292579 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 1233/2453] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 30 00:57:31 2022] POST /identity/v3/projects => generated 377 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 00:57:31.293835 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945a7e6f-a49f-480f-ae3d-97d2fb55457b admin admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:57:31.308254 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945a7e6f-a49f-480f-ae3d-97d2fb55457b admin admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:57:31.369036 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045a2e0a-9253-4039-92c1-2a02fa226ed6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:57:31.369660 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045a2e0a-9253-4039-92c1-2a02fa226ed6 admin admin] REQUEST_METHOD: `POST` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:57:31.369936 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045a2e0a-9253-4039-92c1-2a02fa226ed6 admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:57:31.370207 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045a2e0a-9253-4039-92c1-2a02fa226ed6 admin admin] PATH_INFO: `/v3/users` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:57:31.370832 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045a2e0a-9253-4039-92c1-2a02fa226ed6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:57:31.372831 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045a2e0a-9253-4039-92c1-2a02fa226ed6 admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:57:31.400749 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 1221/2454] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 30 00:57:31 2022] POST /identity/v3/users => generated 289 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 00:57:31.402023 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310845c1-9fff-4dc7-becf-a38c2098f71d admin admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:57:31.412869 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310845c1-9fff-4dc7-becf-a38c2098f71d admin admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:57:31.417810 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9077f6d4-68ee-4bde-aa88-155e5b2adce3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:57:31.418433 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9077f6d4-68ee-4bde-aa88-155e5b2adce3 admin admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:57:31.418714 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9077f6d4-68ee-4bde-aa88-155e5b2adce3 admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:57:31.418976 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9077f6d4-68ee-4bde-aa88-155e5b2adce3 admin admin] PATH_INFO: `/v3/roles` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:57:31.419651 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9077f6d4-68ee-4bde-aa88-155e5b2adce3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:57:31.421279 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9077f6d4-68ee-4bde-aa88-155e5b2adce3 admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:57:31.432656 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 1234/2455] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 30 00:57:31 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 30 00:57:31.436684 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045a2e0a-9253-4039-92c1-2a02fa226ed6 admin admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:57:31.448505 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045a2e0a-9253-4039-92c1-2a02fa226ed6 admin admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:57:31.455612 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a944bb7e-71d8-4cf3-9dc9-5c290a18d1b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:57:31.456412 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a944bb7e-71d8-4cf3-9dc9-5c290a18d1b4 admin admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:57:31.456534 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a944bb7e-71d8-4cf3-9dc9-5c290a18d1b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:57:31.456800 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a944bb7e-71d8-4cf3-9dc9-5c290a18d1b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:57:31.457451 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a944bb7e-71d8-4cf3-9dc9-5c290a18d1b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:57:31.459077 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a944bb7e-71d8-4cf3-9dc9-5c290a18d1b4 admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:57:31.470409 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 1222/2456] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 30 00:57:31 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 00:57:31.474586 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9077f6d4-68ee-4bde-aa88-155e5b2adce3 admin admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:57:31.485598 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9077f6d4-68ee-4bde-aa88-155e5b2adce3 admin admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:57:31.490401 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c88dedf-1855-403c-89b0-b1af897d13c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:57:31.491152 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c88dedf-1855-403c-89b0-b1af897d13c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:57:31.491529 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c88dedf-1855-403c-89b0-b1af897d13c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:57:31.491869 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c88dedf-1855-403c-89b0-b1af897d13c1 admin admin] PATH_INFO: `/v3/projects/7a0a515faaaa4b80b4e17f50ac10c2c9/users/ed42b9e0e6d943cabb4f685adb853c8c/roles/1c93019874174c4b91118d9ce2347e47` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:57:31.512010 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c88dedf-1855-403c-89b0-b1af897d13c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7a0a515faaaa4b80b4e17f50ac10c2c9, user_id=ed42b9e0e6d943cabb4f685adb853c8c, role_id=1c93019874174c4b91118d9ce2347e47)` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:57:31.514797 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c88dedf-1855-403c-89b0-b1af897d13c1 admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:57:31.524833 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:DELETE=11,keystone:SELECT=85,keystone:INSERT=4 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:57:31.530412 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 1235/2457] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 30 00:57:31 2022] PUT /identity/v3/projects/7a0a515faaaa4b80b4e17f50ac10c2c9/users/ed42b9e0e6d943cabb4f685adb853c8c/roles/1c93019874174c4b91118d9ce2347e47 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 00:57:31.541237 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ba056a-74d2-4860-a8b6-720f6f54fb32 None None] REQUEST_METHOD: `POST` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:57:31.541522 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ba056a-74d2-4860-a8b6-720f6f54fb32 None None] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:57:31.541915 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ba056a-74d2-4860-a8b6-720f6f54fb32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:57:31.569932 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.auth.core [None req-32ba056a-74d2-4860-a8b6-720f6f54fb32 None None] MFA Rules not processed for user `ed42b9e0e6d943cabb4f685adb853c8c`. Rule list: `[]` (Enabled: `True`). {{(pid=87955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:57:31.571144 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-32ba056a-74d2-4860-a8b6-720f6f54fb32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:57:31.636006 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 1223/2458] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 30 00:57:31 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:57:31.640599 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c88dedf-1855-403c-89b0-b1af897d13c1 admin admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:57:31.705101 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c88dedf-1855-403c-89b0-b1af897d13c1 admin admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:57:31.710023 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af76b057-17a3-4722-82b3-e5db302c7f73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:57:31.710761 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af76b057-17a3-4722-82b3-e5db302c7f73 admin admin] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:57:31.711124 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af76b057-17a3-4722-82b3-e5db302c7f73 admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:57:31.711457 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af76b057-17a3-4722-82b3-e5db302c7f73 admin admin] PATH_INFO: `/v3/projects` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:57:31.712192 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af76b057-17a3-4722-82b3-e5db302c7f73 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:57:31.714388 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af76b057-17a3-4722-82b3-e5db302c7f73 admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:57:31.741414 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 1236/2459] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 30 00:57:31 2022] POST /identity/v3/projects => generated 379 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 00:57:31.745609 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ba056a-74d2-4860-a8b6-720f6f54fb32 None None] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:57:31.756980 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ba056a-74d2-4860-a8b6-720f6f54fb32 None None] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:57:31.783962 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:57:31.818827 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cfe688-4dac-4d9a-b813-84b9a0859cce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:57:31.819618 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cfe688-4dac-4d9a-b813-84b9a0859cce admin admin] REQUEST_METHOD: `POST` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:57:31.819947 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cfe688-4dac-4d9a-b813-84b9a0859cce admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:57:31.820318 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cfe688-4dac-4d9a-b813-84b9a0859cce admin admin] PATH_INFO: `/v3/users` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:57:31.821316 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60cfe688-4dac-4d9a-b813-84b9a0859cce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:57:31.824278 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60cfe688-4dac-4d9a-b813-84b9a0859cce admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:57:31.848285 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 1224/2460] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 30 00:57:31 2022] POST /identity/v3/users => generated 290 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 30 00:57:31.852410 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af76b057-17a3-4722-82b3-e5db302c7f73 admin admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:57:31.863524 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af76b057-17a3-4722-82b3-e5db302c7f73 admin admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:57:31.868048 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bce970a-2f5a-4b04-a896-7acbaf455b43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:57:31.868775 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bce970a-2f5a-4b04-a896-7acbaf455b43 admin admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:57:31.869058 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bce970a-2f5a-4b04-a896-7acbaf455b43 admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:57:31.869328 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bce970a-2f5a-4b04-a896-7acbaf455b43 admin admin] PATH_INFO: `/v3/roles` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:57:31.870008 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bce970a-2f5a-4b04-a896-7acbaf455b43 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:57:31.871646 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bce970a-2f5a-4b04-a896-7acbaf455b43 admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:57:31.882417 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 1237/2461] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 30 00:57:31 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 00:57:31.886672 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cfe688-4dac-4d9a-b813-84b9a0859cce admin admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:57:31.897290 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cfe688-4dac-4d9a-b813-84b9a0859cce admin admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:57:31.902253 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64327738-75a3-48e7-9f83-a8b7b9e3ccaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:57:31.902872 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64327738-75a3-48e7-9f83-a8b7b9e3ccaa admin admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:57:31.903148 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64327738-75a3-48e7-9f83-a8b7b9e3ccaa admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:57:31.903467 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64327738-75a3-48e7-9f83-a8b7b9e3ccaa admin admin] PATH_INFO: `/v3/roles` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:57:31.904116 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64327738-75a3-48e7-9f83-a8b7b9e3ccaa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:57:31.905737 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64327738-75a3-48e7-9f83-a8b7b9e3ccaa admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:57:31.916480 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 1225/2462] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 30 00:57:31 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 00:57:31.920931 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bce970a-2f5a-4b04-a896-7acbaf455b43 admin admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:57:31.931036 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bce970a-2f5a-4b04-a896-7acbaf455b43 admin admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:57:31.935950 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d028b3ba-049e-4974-ac6b-0e2bf9ae6416 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:57:31.936619 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d028b3ba-049e-4974-ac6b-0e2bf9ae6416 admin admin] REQUEST_METHOD: `PUT` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:57:31.936896 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d028b3ba-049e-4974-ac6b-0e2bf9ae6416 admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:57:31.937201 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d028b3ba-049e-4974-ac6b-0e2bf9ae6416 admin admin] PATH_INFO: `/v3/projects/5214c8455208476e92bfa238e4c7656d/users/5c8a96509e6c4aa097f7cd166858bb30/roles/1c93019874174c4b91118d9ce2347e47` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:57:31.953098 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d028b3ba-049e-4974-ac6b-0e2bf9ae6416 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5214c8455208476e92bfa238e4c7656d, user_id=5c8a96509e6c4aa097f7cd166858bb30, role_id=1c93019874174c4b91118d9ce2347e47)` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:57:31.955970 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d028b3ba-049e-4974-ac6b-0e2bf9ae6416 admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:57:31.969571 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 1238/2463] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 30 00:57:31 2022] PUT /identity/v3/projects/5214c8455208476e92bfa238e4c7656d/users/5c8a96509e6c4aa097f7cd166858bb30/roles/1c93019874174c4b91118d9ce2347e47 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 00:57:31.981197 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51cfe82-732d-455f-a6fa-412c5058292e None None] REQUEST_METHOD: `POST` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:57:31.981485 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51cfe82-732d-455f-a6fa-412c5058292e None None] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:57:31.981760 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51cfe82-732d-455f-a6fa-412c5058292e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:57:32.010764 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.auth.core [None req-f51cfe82-732d-455f-a6fa-412c5058292e None None] MFA Rules not processed for user `5c8a96509e6c4aa097f7cd166858bb30`. Rule list: `[]` (Enabled: `True`). {{(pid=87955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:57:32.012050 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-f51cfe82-732d-455f-a6fa-412c5058292e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:57:32.080610 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 1226/2464] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 30 00:57:31 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:57:32.085201 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d028b3ba-049e-4974-ac6b-0e2bf9ae6416 admin admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:57:32.148714 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d028b3ba-049e-4974-ac6b-0e2bf9ae6416 admin admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:57:32.153993 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bc901f-c7e3-4fae-a0ef-4fc2a993b6a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:57:32.154601 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bc901f-c7e3-4fae-a0ef-4fc2a993b6a3 admin admin] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:57:32.154879 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bc901f-c7e3-4fae-a0ef-4fc2a993b6a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:57:32.155145 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bc901f-c7e3-4fae-a0ef-4fc2a993b6a3 admin admin] PATH_INFO: `/v3/projects` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:57:32.155810 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23bc901f-c7e3-4fae-a0ef-4fc2a993b6a3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:57:32.157909 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23bc901f-c7e3-4fae-a0ef-4fc2a993b6a3 admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:57:32.189234 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 1239/2465] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 30 00:57:32 2022] POST /identity/v3/projects => generated 377 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 00:57:32.193918 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51cfe82-732d-455f-a6fa-412c5058292e None None] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:57:32.205137 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51cfe82-732d-455f-a6fa-412c5058292e None None] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:57:32.263532 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef81257-19cd-4849-91d9-65c99f12c45d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:57:32.264152 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef81257-19cd-4849-91d9-65c99f12c45d admin admin] REQUEST_METHOD: `POST` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:57:32.264433 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef81257-19cd-4849-91d9-65c99f12c45d admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:57:32.264712 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef81257-19cd-4849-91d9-65c99f12c45d admin admin] PATH_INFO: `/v3/users` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:57:32.265347 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef81257-19cd-4849-91d9-65c99f12c45d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:57:32.267303 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef81257-19cd-4849-91d9-65c99f12c45d admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:57:32.290866 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 1227/2466] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 30 00:57:32 2022] POST /identity/v3/users => generated 295 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 00:57:32.295303 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bc901f-c7e3-4fae-a0ef-4fc2a993b6a3 admin admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:57:32.306283 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bc901f-c7e3-4fae-a0ef-4fc2a993b6a3 admin admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:57:32.311565 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3e95fc-a562-402a-b1ec-e03e73422746 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:57:32.312187 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3e95fc-a562-402a-b1ec-e03e73422746 admin admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:57:32.312461 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3e95fc-a562-402a-b1ec-e03e73422746 admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:57:32.312704 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3e95fc-a562-402a-b1ec-e03e73422746 admin admin] PATH_INFO: `/v3/roles` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:57:32.313381 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3e95fc-a562-402a-b1ec-e03e73422746 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:57:32.315517 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3e95fc-a562-402a-b1ec-e03e73422746 admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:57:32.326412 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 1240/2467] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 30 00:57:32 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 00:57:32.330800 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef81257-19cd-4849-91d9-65c99f12c45d admin admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:57:32.341300 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef81257-19cd-4849-91d9-65c99f12c45d admin admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:57:32.346589 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d5abcc-93e7-41e5-99d8-b4c8ada8b7e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:57:32.347284 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d5abcc-93e7-41e5-99d8-b4c8ada8b7e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:57:32.347557 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d5abcc-93e7-41e5-99d8-b4c8ada8b7e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:57:32.347822 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d5abcc-93e7-41e5-99d8-b4c8ada8b7e8 admin admin] PATH_INFO: `/v3/projects/24d5538d38bb4a4384517fa5fcb33f8b/users/434e7cd1a8664eddbc40c20c7731e7d5/roles/6ccaa8c11f29456fb4e4eeccb21616c7` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:57:32.363291 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d5abcc-93e7-41e5-99d8-b4c8ada8b7e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=24d5538d38bb4a4384517fa5fcb33f8b, user_id=434e7cd1a8664eddbc40c20c7731e7d5, role_id=6ccaa8c11f29456fb4e4eeccb21616c7)` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:57:32.365924 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d5abcc-93e7-41e5-99d8-b4c8ada8b7e8 admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:57:32.381046 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 1228/2468] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 30 00:57:32 2022] PUT /identity/v3/projects/24d5538d38bb4a4384517fa5fcb33f8b/users/434e7cd1a8664eddbc40c20c7731e7d5/roles/6ccaa8c11f29456fb4e4eeccb21616c7 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 00:57:32.385126 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3e95fc-a562-402a-b1ec-e03e73422746 admin admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:57:32.395782 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3e95fc-a562-402a-b1ec-e03e73422746 admin admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:57:32.417289 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:57:32.457450 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427249ae-c92e-40fa-8009-9e177ad3cf66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:57:32.458050 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427249ae-c92e-40fa-8009-9e177ad3cf66 admin admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:57:32.458320 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427249ae-c92e-40fa-8009-9e177ad3cf66 admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:57:32.458592 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427249ae-c92e-40fa-8009-9e177ad3cf66 admin admin] PATH_INFO: `/v3/roles` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:57:32.459243 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427249ae-c92e-40fa-8009-9e177ad3cf66 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:57:32.460856 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427249ae-c92e-40fa-8009-9e177ad3cf66 admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:57:32.471908 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 1241/2469] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 30 00:57:32 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 00:57:32.476422 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d5abcc-93e7-41e5-99d8-b4c8ada8b7e8 admin admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:57:32.482154 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:57:32.488445 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d5abcc-93e7-41e5-99d8-b4c8ada8b7e8 admin admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:57:32.493980 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f291d2ad-b412-4f97-a49c-d56c3e2d8ea2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:57:32.494639 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f291d2ad-b412-4f97-a49c-d56c3e2d8ea2 admin admin] REQUEST_METHOD: `PUT` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:57:32.495590 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f291d2ad-b412-4f97-a49c-d56c3e2d8ea2 admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:57:32.495882 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f291d2ad-b412-4f97-a49c-d56c3e2d8ea2 admin admin] PATH_INFO: `/v3/projects/24d5538d38bb4a4384517fa5fcb33f8b/users/434e7cd1a8664eddbc40c20c7731e7d5/roles/6ccaa8c11f29456fb4e4eeccb21616c7` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:57:32.498104 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f291d2ad-b412-4f97-a49c-d56c3e2d8ea2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=24d5538d38bb4a4384517fa5fcb33f8b, user_id=434e7cd1a8664eddbc40c20c7731e7d5, role_id=6ccaa8c11f29456fb4e4eeccb21616c7)` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:57:32.500815 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f291d2ad-b412-4f97-a49c-d56c3e2d8ea2 admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:57:32.512241 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 1229/2470] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 30 00:57:32 2022] PUT /identity/v3/projects/24d5538d38bb4a4384517fa5fcb33f8b/users/434e7cd1a8664eddbc40c20c7731e7d5/roles/6ccaa8c11f29456fb4e4eeccb21616c7 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 00:57:32.523002 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd3ddad-82ee-4941-bfe4-97f7aedbc9b5 None None] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:57:32.523372 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd3ddad-82ee-4941-bfe4-97f7aedbc9b5 None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:57:32.523657 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd3ddad-82ee-4941-bfe4-97f7aedbc9b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:57:32.554343 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.auth.core [None req-cbd3ddad-82ee-4941-bfe4-97f7aedbc9b5 None None] MFA Rules not processed for user `434e7cd1a8664eddbc40c20c7731e7d5`. Rule list: `[]` (Enabled: `True`). {{(pid=87956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:57:32.555626 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-cbd3ddad-82ee-4941-bfe4-97f7aedbc9b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:57:32.627724 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 1242/2471] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 30 00:57:32 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:57:32.642176 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f291d2ad-b412-4f97-a49c-d56c3e2d8ea2 admin admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:57:32.644244 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-f291d2ad-b412-4f97-a49c-d56c3e2d8ea2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:57:32.704790 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f291d2ad-b412-4f97-a49c-d56c3e2d8ea2 admin admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:57:32.708321 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50875d4f-6735-48eb-9456-5b2419196bf8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48d928ff7fe24348ac900f09c56acc20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d2387fdf794d4eaef07bbcd7b39f2a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:57:32.709066 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50875d4f-6735-48eb-9456-5b2419196bf8 service cinder] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:57:32.709342 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50875d4f-6735-48eb-9456-5b2419196bf8 service cinder] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:57:32.709488 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50875d4f-6735-48eb-9456-5b2419196bf8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:57:32.720346 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50875d4f-6735-48eb-9456-5b2419196bf8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:57:32.721801 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50875d4f-6735-48eb-9456-5b2419196bf8 service cinder] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:57:32.732594 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 1230/2472] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 30 00:57:32 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 00:57:32.777646 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd3ddad-82ee-4941-bfe4-97f7aedbc9b5 None None] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:57:32.779170 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-cbd3ddad-82ee-4941-bfe4-97f7aedbc9b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:57:32.791595 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd3ddad-82ee-4941-bfe4-97f7aedbc9b5 None None] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:57:32.795553 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865fa83e-7d59-4329-b623-14ddc6057fe6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48d928ff7fe24348ac900f09c56acc20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d2387fdf794d4eaef07bbcd7b39f2a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:57:32.796170 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865fa83e-7d59-4329-b623-14ddc6057fe6 service cinder] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:57:32.796447 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865fa83e-7d59-4329-b623-14ddc6057fe6 service cinder] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:57:32.796714 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865fa83e-7d59-4329-b623-14ddc6057fe6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:57:32.852851 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865fa83e-7d59-4329-b623-14ddc6057fe6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:57:32.854284 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865fa83e-7d59-4329-b623-14ddc6057fe6 service cinder] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:57:32.863167 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 1243/2473] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 30 00:57:32 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 00:57:35.803307 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50875d4f-6735-48eb-9456-5b2419196bf8 service cinder] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:57:35.867077 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50875d4f-6735-48eb-9456-5b2419196bf8 service cinder] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:57:35.872277 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a66826-f5a1-4f04-939a-00ef9e1abb70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:57:35.872929 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a66826-f5a1-4f04-939a-00ef9e1abb70 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:57:35.873211 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a66826-f5a1-4f04-939a-00ef9e1abb70 admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:57:35.873475 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a66826-f5a1-4f04-939a-00ef9e1abb70 admin admin] PATH_INFO: `/v3/users/ed42b9e0e6d943cabb4f685adb853c8c` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:57:35.874708 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a66826-f5a1-4f04-939a-00ef9e1abb70 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ed42b9e0e6d943cabb4f685adb853c8c)` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:57:35.876732 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a66826-f5a1-4f04-939a-00ef9e1abb70 admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:57:35.924908 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-59a66826-f5a1-4f04-939a-00ef9e1abb70 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ed42b9e0e6d943cabb4f685adb853c8c'} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:57:35.925543 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-59a66826-f5a1-4f04-939a-00ef9e1abb70 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ed42b9e0e6d943cabb4f685adb853c8c'} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:57:35.932657 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-59a66826-f5a1-4f04-939a-00ef9e1abb70 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ed42b9e0e6d943cabb4f685adb853c8c'} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:57:35.933275 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-59a66826-f5a1-4f04-939a-00ef9e1abb70 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ed42b9e0e6d943cabb4f685adb853c8c'} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:57:35.945195 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-59a66826-f5a1-4f04-939a-00ef9e1abb70 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ed42b9e0e6d943cabb4f685adb853c8c'} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:57:35.959283 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 1231/2474] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 30 00:57:35 2022] DELETE /identity/v3/users/ed42b9e0e6d943cabb4f685adb853c8c => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 00:57:35.963977 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3c53b4-a63f-4af1-b184-4327dc7a1980 None None] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:57:35.964509 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3c53b4-a63f-4af1-b184-4327dc7a1980 None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:57:35.964616 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3c53b4-a63f-4af1-b184-4327dc7a1980 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:57:35.985166 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.auth.core [None req-8a3c53b4-a63f-4af1-b184-4327dc7a1980 None None] MFA Rules not processed for user `eb55b6cbca4945abb21b0e49eb745e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=87956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:57:35.986378 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-8a3c53b4-a63f-4af1-b184-4327dc7a1980 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:57:36.034979 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=100 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:57:36.055160 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 1244/2475] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 30 00:57:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:57:36.065931 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a66826-f5a1-4f04-939a-00ef9e1abb70 admin admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:57:36.067613 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-59a66826-f5a1-4f04-939a-00ef9e1abb70 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:57:36.082774 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:57:36.128840 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a66826-f5a1-4f04-939a-00ef9e1abb70 admin admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:57:36.133066 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a5886e-4541-4fa7-b66e-405420fbd334 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5693f186c6ad4d9394f02ee3477cdcd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d2387fdf794d4eaef07bbcd7b39f2a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:57:36.133698 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a5886e-4541-4fa7-b66e-405420fbd334 service neutron] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:57:36.133974 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a5886e-4541-4fa7-b66e-405420fbd334 service neutron] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:57:36.134241 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a5886e-4541-4fa7-b66e-405420fbd334 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:57:36.143280 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a5886e-4541-4fa7-b66e-405420fbd334 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:57:36.144705 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a5886e-4541-4fa7-b66e-405420fbd334 service neutron] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:57:36.154436 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 1232/2476] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 30 00:57:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 00:57:36.525602 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3c53b4-a63f-4af1-b184-4327dc7a1980 None None] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:57:36.527085 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-8a3c53b4-a63f-4af1-b184-4327dc7a1980 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:57:36.542616 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3c53b4-a63f-4af1-b184-4327dc7a1980 None None] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:57:36.548343 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ab0237-9c43-4032-b3a3-7c56eb9fb71c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:57:36.549065 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ab0237-9c43-4032-b3a3-7c56eb9fb71c admin admin] REQUEST_METHOD: `DELETE` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:57:36.549338 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ab0237-9c43-4032-b3a3-7c56eb9fb71c admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:57:36.549604 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ab0237-9c43-4032-b3a3-7c56eb9fb71c admin admin] PATH_INFO: `/v3/projects/7a0a515faaaa4b80b4e17f50ac10c2c9` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:57:36.551979 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ab0237-9c43-4032-b3a3-7c56eb9fb71c admin admin] RBAC: Authorizing `identity:delete_project(project_id=7a0a515faaaa4b80b4e17f50ac10c2c9)` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:57:36.553854 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ab0237-9c43-4032-b3a3-7c56eb9fb71c admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:57:36.606044 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-63ab0237-9c43-4032-b3a3-7c56eb9fb71c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7a0a515faaaa4b80b4e17f50ac10c2c9', 'request_id': 'req-63ab0237-9c43-4032-b3a3-7c56eb9fb71c'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:57:36.614228 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-63ab0237-9c43-4032-b3a3-7c56eb9fb71c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7a0a515faaaa4b80b4e17f50ac10c2c9', 'request_id': 'req-63ab0237-9c43-4032-b3a3-7c56eb9fb71c'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:57:36.620829 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-63ab0237-9c43-4032-b3a3-7c56eb9fb71c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7a0a515faaaa4b80b4e17f50ac10c2c9', 'request_id': 'req-63ab0237-9c43-4032-b3a3-7c56eb9fb71c'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:57:36.632887 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-63ab0237-9c43-4032-b3a3-7c56eb9fb71c admin admin] The token cache is being invalidate because project 7a0a515faaaa4b80b4e17f50ac10c2c9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87956) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 00:57:36.633180 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-63ab0237-9c43-4032-b3a3-7c56eb9fb71c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:57:36.633890 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-63ab0237-9c43-4032-b3a3-7c56eb9fb71c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:57:36.635504 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 1245/2477] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 30 00:57:36 2022] DELETE /identity/v3/projects/7a0a515faaaa4b80b4e17f50ac10c2c9 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 00:57:36.640207 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a5886e-4541-4fa7-b66e-405420fbd334 service neutron] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:57:36.651788 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a5886e-4541-4fa7-b66e-405420fbd334 service neutron] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:57:36.717801 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3428a7d-5947-44e1-a72e-0de2adbd69d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:57:36.718448 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3428a7d-5947-44e1-a72e-0de2adbd69d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:57:36.718842 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3428a7d-5947-44e1-a72e-0de2adbd69d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:57:36.719114 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3428a7d-5947-44e1-a72e-0de2adbd69d4 admin admin] PATH_INFO: `/v3/users/5c8a96509e6c4aa097f7cd166858bb30` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:57:36.720313 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3428a7d-5947-44e1-a72e-0de2adbd69d4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5c8a96509e6c4aa097f7cd166858bb30)` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:57:36.723747 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3428a7d-5947-44e1-a72e-0de2adbd69d4 admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:57:36.786784 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-a3428a7d-5947-44e1-a72e-0de2adbd69d4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5c8a96509e6c4aa097f7cd166858bb30'} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:57:36.787784 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-a3428a7d-5947-44e1-a72e-0de2adbd69d4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5c8a96509e6c4aa097f7cd166858bb30'} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:57:36.798423 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-a3428a7d-5947-44e1-a72e-0de2adbd69d4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5c8a96509e6c4aa097f7cd166858bb30'} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:57:36.799186 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-a3428a7d-5947-44e1-a72e-0de2adbd69d4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5c8a96509e6c4aa097f7cd166858bb30'} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:57:36.818276 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-a3428a7d-5947-44e1-a72e-0de2adbd69d4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5c8a96509e6c4aa097f7cd166858bb30'} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:57:36.834168 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 1233/2478] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 30 00:57:36 2022] DELETE /identity/v3/users/5c8a96509e6c4aa097f7cd166858bb30 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 00:57:37.128731 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ab0237-9c43-4032-b3a3-7c56eb9fb71c admin admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:57:37.130239 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-63ab0237-9c43-4032-b3a3-7c56eb9fb71c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:57:37.145391 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ab0237-9c43-4032-b3a3-7c56eb9fb71c admin admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:57:37.219368 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c8b97d-2317-407a-82e0-6725c498c911 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:57:37.220019 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c8b97d-2317-407a-82e0-6725c498c911 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:57:37.220299 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c8b97d-2317-407a-82e0-6725c498c911 admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:57:37.220599 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c8b97d-2317-407a-82e0-6725c498c911 admin admin] PATH_INFO: `/v3/projects/5214c8455208476e92bfa238e4c7656d` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:57:37.221757 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c8b97d-2317-407a-82e0-6725c498c911 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5214c8455208476e92bfa238e4c7656d)` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:57:37.224868 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c8b97d-2317-407a-82e0-6725c498c911 admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:57:37.278150 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-85c8b97d-2317-407a-82e0-6725c498c911 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5214c8455208476e92bfa238e4c7656d', 'request_id': 'req-85c8b97d-2317-407a-82e0-6725c498c911'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:57:37.288160 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-85c8b97d-2317-407a-82e0-6725c498c911 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5214c8455208476e92bfa238e4c7656d', 'request_id': 'req-85c8b97d-2317-407a-82e0-6725c498c911'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:57:37.295754 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-85c8b97d-2317-407a-82e0-6725c498c911 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5214c8455208476e92bfa238e4c7656d', 'request_id': 'req-85c8b97d-2317-407a-82e0-6725c498c911'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:57:37.302422 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:57:37.307640 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-85c8b97d-2317-407a-82e0-6725c498c911 admin admin] The token cache is being invalidate because project 5214c8455208476e92bfa238e4c7656d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87956) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 00:57:37.308168 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-85c8b97d-2317-407a-82e0-6725c498c911 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:57:37.310719 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-85c8b97d-2317-407a-82e0-6725c498c911 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:57:37.313388 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 1246/2479] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 30 00:57:37 2022] DELETE /identity/v3/projects/5214c8455208476e92bfa238e4c7656d => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 00:57:37.318046 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3428a7d-5947-44e1-a72e-0de2adbd69d4 admin admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:57:37.319539 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-a3428a7d-5947-44e1-a72e-0de2adbd69d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:57:37.334698 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3428a7d-5947-44e1-a72e-0de2adbd69d4 admin admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:57:37.370352 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:57:37.402465 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe5c7d5-39f4-43dd-a1e9-7e629331c5a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:57:37.403141 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe5c7d5-39f4-43dd-a1e9-7e629331c5a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:57:37.403441 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe5c7d5-39f4-43dd-a1e9-7e629331c5a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:57:37.403714 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe5c7d5-39f4-43dd-a1e9-7e629331c5a4 admin admin] PATH_INFO: `/v3/users/434e7cd1a8664eddbc40c20c7731e7d5` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:57:37.404869 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe5c7d5-39f4-43dd-a1e9-7e629331c5a4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=434e7cd1a8664eddbc40c20c7731e7d5)` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:57:37.406807 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe5c7d5-39f4-43dd-a1e9-7e629331c5a4 admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:57:37.460328 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-efe5c7d5-39f4-43dd-a1e9-7e629331c5a4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '434e7cd1a8664eddbc40c20c7731e7d5'} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:57:37.461041 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-efe5c7d5-39f4-43dd-a1e9-7e629331c5a4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '434e7cd1a8664eddbc40c20c7731e7d5'} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:57:37.468314 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-efe5c7d5-39f4-43dd-a1e9-7e629331c5a4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '434e7cd1a8664eddbc40c20c7731e7d5'} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:57:37.468960 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-efe5c7d5-39f4-43dd-a1e9-7e629331c5a4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '434e7cd1a8664eddbc40c20c7731e7d5'} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:57:37.481935 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-efe5c7d5-39f4-43dd-a1e9-7e629331c5a4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '434e7cd1a8664eddbc40c20c7731e7d5'} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:57:37.497055 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 1234/2480] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 30 00:57:37 2022] DELETE /identity/v3/users/434e7cd1a8664eddbc40c20c7731e7d5 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 00:57:37.784331 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c8b97d-2317-407a-82e0-6725c498c911 admin admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:57:37.785822 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-85c8b97d-2317-407a-82e0-6725c498c911 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:57:37.802296 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c8b97d-2317-407a-82e0-6725c498c911 admin admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:57:37.860267 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0a6903-c4c2-41ab-9920-0da89e963cf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:57:37.860822 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0a6903-c4c2-41ab-9920-0da89e963cf5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:57:37.861142 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0a6903-c4c2-41ab-9920-0da89e963cf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:57:37.861410 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0a6903-c4c2-41ab-9920-0da89e963cf5 admin admin] PATH_INFO: `/v3/projects/24d5538d38bb4a4384517fa5fcb33f8b` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:57:37.862537 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0a6903-c4c2-41ab-9920-0da89e963cf5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=24d5538d38bb4a4384517fa5fcb33f8b)` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:57:37.864504 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0a6903-c4c2-41ab-9920-0da89e963cf5 admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:57:37.918306 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-bc0a6903-c4c2-41ab-9920-0da89e963cf5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '24d5538d38bb4a4384517fa5fcb33f8b', 'request_id': 'req-bc0a6903-c4c2-41ab-9920-0da89e963cf5'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:57:37.926972 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-bc0a6903-c4c2-41ab-9920-0da89e963cf5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '24d5538d38bb4a4384517fa5fcb33f8b', 'request_id': 'req-bc0a6903-c4c2-41ab-9920-0da89e963cf5'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:57:37.933909 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-bc0a6903-c4c2-41ab-9920-0da89e963cf5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '24d5538d38bb4a4384517fa5fcb33f8b', 'request_id': 'req-bc0a6903-c4c2-41ab-9920-0da89e963cf5'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:57:37.948704 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-bc0a6903-c4c2-41ab-9920-0da89e963cf5 admin admin] The token cache is being invalidate because project 24d5538d38bb4a4384517fa5fcb33f8b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87956) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 00:57:37.949089 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-bc0a6903-c4c2-41ab-9920-0da89e963cf5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:57:37.950043 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-bc0a6903-c4c2-41ab-9920-0da89e963cf5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:57:37.952553 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 1247/2481] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 30 00:57:37 2022] DELETE /identity/v3/projects/24d5538d38bb4a4384517fa5fcb33f8b => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 00:57:37.960485 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab725ea-55b8-440f-94f7-8fa361fd780c None None] REQUEST_METHOD: `POST` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:57:37.960952 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab725ea-55b8-440f-94f7-8fa361fd780c None None] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:57:37.961072 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab725ea-55b8-440f-94f7-8fa361fd780c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:57:37.982656 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.auth.core [None req-dab725ea-55b8-440f-94f7-8fa361fd780c None None] MFA Rules not processed for user `eb55b6cbca4945abb21b0e49eb745e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=87955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:57:37.983899 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-dab725ea-55b8-440f-94f7-8fa361fd780c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:57:38.047736 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 1235/2482] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 30 00:57:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:57:38.057484 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfb9bdc-fd8a-4395-8059-e48093400715 None None] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:57:38.057792 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfb9bdc-fd8a-4395-8059-e48093400715 None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:57:38.058139 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfb9bdc-fd8a-4395-8059-e48093400715 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:57:38.084846 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.auth.core [None req-1cfb9bdc-fd8a-4395-8059-e48093400715 None None] MFA Rules not processed for user `eb55b6cbca4945abb21b0e49eb745e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=87956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:57:38.086075 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-1cfb9bdc-fd8a-4395-8059-e48093400715 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:57:38.095455 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 1248/2483] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 30 00:57:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:57:38.099930 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab725ea-55b8-440f-94f7-8fa361fd780c None None] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:57:38.109820 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab725ea-55b8-440f-94f7-8fa361fd780c None None] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:57:38.115001 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64935646-f9c3-4c60-a0ba-7cc0f4ed2041 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:57:38.115580 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64935646-f9c3-4c60-a0ba-7cc0f4ed2041 admin admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:57:38.115860 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64935646-f9c3-4c60-a0ba-7cc0f4ed2041 admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:57:38.116133 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64935646-f9c3-4c60-a0ba-7cc0f4ed2041 admin admin] PATH_INFO: `/v3/domains` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:57:38.116812 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64935646-f9c3-4c60-a0ba-7cc0f4ed2041 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:57:38.117121 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64935646-f9c3-4c60-a0ba-7cc0f4ed2041 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:57:38.118729 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64935646-f9c3-4c60-a0ba-7cc0f4ed2041 admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:57:38.130355 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 1236/2484] 10.222.0.42 () {58 vars in 1153 bytes} [Sun Oct 30 00:57:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:57:38.136759 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfb9bdc-fd8a-4395-8059-e48093400715 None None] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:57:38.150180 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfb9bdc-fd8a-4395-8059-e48093400715 None None] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:57:38.157577 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd347a54-2aca-4445-ae88-e7adcaba39ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:57:38.158399 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd347a54-2aca-4445-ae88-e7adcaba39ba admin admin] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:57:38.158675 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd347a54-2aca-4445-ae88-e7adcaba39ba admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:57:38.158946 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd347a54-2aca-4445-ae88-e7adcaba39ba admin admin] PATH_INFO: `/v3/projects` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:57:38.159612 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd347a54-2aca-4445-ae88-e7adcaba39ba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:57:38.161495 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd347a54-2aca-4445-ae88-e7adcaba39ba admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:57:38.190431 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 1249/2485] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 30 00:57:38 2022] POST /identity/v3/projects => generated 385 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 00:57:38.194664 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64935646-f9c3-4c60-a0ba-7cc0f4ed2041 admin admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:57:38.205645 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64935646-f9c3-4c60-a0ba-7cc0f4ed2041 admin admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:57:38.247871 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:57:38.272693 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f47dd0-03f9-410d-b5f7-3a9a2e6f7faf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:57:38.273330 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f47dd0-03f9-410d-b5f7-3a9a2e6f7faf admin admin] REQUEST_METHOD: `POST` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:57:38.273607 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f47dd0-03f9-410d-b5f7-3a9a2e6f7faf admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:57:38.273877 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f47dd0-03f9-410d-b5f7-3a9a2e6f7faf admin admin] PATH_INFO: `/v3/users` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:57:38.274518 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f47dd0-03f9-410d-b5f7-3a9a2e6f7faf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:57:38.276516 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f47dd0-03f9-410d-b5f7-3a9a2e6f7faf admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:57:38.305255 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 1237/2486] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 30 00:57:38 2022] POST /identity/v3/users => generated 293 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 30 00:57:38.308553 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd347a54-2aca-4445-ae88-e7adcaba39ba admin admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:57:38.321557 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd347a54-2aca-4445-ae88-e7adcaba39ba admin admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:57:38.327381 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b96d9b2-5f5a-4029-ba27-4d96d721d40b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:57:38.328011 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b96d9b2-5f5a-4029-ba27-4d96d721d40b admin admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:57:38.328257 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b96d9b2-5f5a-4029-ba27-4d96d721d40b admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:57:38.328521 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b96d9b2-5f5a-4029-ba27-4d96d721d40b admin admin] PATH_INFO: `/v3/roles` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:57:38.329161 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b96d9b2-5f5a-4029-ba27-4d96d721d40b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:57:38.330749 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b96d9b2-5f5a-4029-ba27-4d96d721d40b admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:57:38.341138 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 1250/2487] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 30 00:57:38 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 00:57:38.349407 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f47dd0-03f9-410d-b5f7-3a9a2e6f7faf admin admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:57:38.359691 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f47dd0-03f9-410d-b5f7-3a9a2e6f7faf admin admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:57:38.364668 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542b6f74-7924-4bc8-8efa-c090577f3497 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:57:38.365305 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542b6f74-7924-4bc8-8efa-c090577f3497 admin admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:57:38.365528 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542b6f74-7924-4bc8-8efa-c090577f3497 admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:57:38.365796 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542b6f74-7924-4bc8-8efa-c090577f3497 admin admin] PATH_INFO: `/v3/roles` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:57:38.366466 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542b6f74-7924-4bc8-8efa-c090577f3497 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:57:38.368082 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542b6f74-7924-4bc8-8efa-c090577f3497 admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:57:38.378109 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 1238/2488] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 30 00:57:38 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 00:57:38.382571 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b96d9b2-5f5a-4029-ba27-4d96d721d40b admin admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:57:38.393253 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b96d9b2-5f5a-4029-ba27-4d96d721d40b admin admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:57:38.399105 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b365bcd-4b64-4ff6-b326-4c744709776f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:57:38.399801 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b365bcd-4b64-4ff6-b326-4c744709776f admin admin] REQUEST_METHOD: `PUT` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:57:38.400073 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b365bcd-4b64-4ff6-b326-4c744709776f admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:57:38.400339 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b365bcd-4b64-4ff6-b326-4c744709776f admin admin] PATH_INFO: `/v3/projects/54ef15c0888b47a5b6e668737c09f1ed/users/77ad9db670064173bd51ced9a259e63e/roles/1c93019874174c4b91118d9ce2347e47` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:57:38.415973 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b365bcd-4b64-4ff6-b326-4c744709776f admin admin] RBAC: Authorizing `identity:create_grant(project_id=54ef15c0888b47a5b6e668737c09f1ed, user_id=77ad9db670064173bd51ced9a259e63e, role_id=1c93019874174c4b91118d9ce2347e47)` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:57:38.418634 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b365bcd-4b64-4ff6-b326-4c744709776f admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:57:38.433875 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 1251/2489] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 30 00:57:38 2022] PUT /identity/v3/projects/54ef15c0888b47a5b6e668737c09f1ed/users/77ad9db670064173bd51ced9a259e63e/roles/1c93019874174c4b91118d9ce2347e47 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 00:57:38.503277 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b868dfe-dbd5-447d-a669-348cc912d73d None None] REQUEST_METHOD: `POST` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:57:38.503718 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b868dfe-dbd5-447d-a669-348cc912d73d None None] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:57:38.504303 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b868dfe-dbd5-447d-a669-348cc912d73d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:57:38.538498 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.auth.core [None req-8b868dfe-dbd5-447d-a669-348cc912d73d None None] MFA Rules not processed for user `77ad9db670064173bd51ced9a259e63e`. Rule list: `[]` (Enabled: `True`). {{(pid=87955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:57:38.539755 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-8b868dfe-dbd5-447d-a669-348cc912d73d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:57:38.609966 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 1239/2490] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 30 00:57:38 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:57:38.614777 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b365bcd-4b64-4ff6-b326-4c744709776f admin admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:57:38.643138 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:57:38.685657 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b365bcd-4b64-4ff6-b326-4c744709776f admin admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:57:38.691683 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3e188a-ab24-4503-9222-2381f400d515 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:57:38.692310 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3e188a-ab24-4503-9222-2381f400d515 admin admin] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:57:38.692592 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3e188a-ab24-4503-9222-2381f400d515 admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:57:38.692861 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3e188a-ab24-4503-9222-2381f400d515 admin admin] PATH_INFO: `/v3/projects` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:57:38.693513 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3e188a-ab24-4503-9222-2381f400d515 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:57:38.695459 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3e188a-ab24-4503-9222-2381f400d515 admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:57:38.724141 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 1252/2491] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 30 00:57:38 2022] POST /identity/v3/projects => generated 385 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 00:57:38.728254 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b868dfe-dbd5-447d-a669-348cc912d73d None None] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:57:38.739376 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b868dfe-dbd5-447d-a669-348cc912d73d None None] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:57:38.797147 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2476aa14-7b6b-4fc1-9a3a-485cabccf47a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:57:38.797799 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2476aa14-7b6b-4fc1-9a3a-485cabccf47a admin admin] REQUEST_METHOD: `POST` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:57:38.798080 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2476aa14-7b6b-4fc1-9a3a-485cabccf47a admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:57:38.798317 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2476aa14-7b6b-4fc1-9a3a-485cabccf47a admin admin] PATH_INFO: `/v3/users` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:57:38.798991 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2476aa14-7b6b-4fc1-9a3a-485cabccf47a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:57:38.800971 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2476aa14-7b6b-4fc1-9a3a-485cabccf47a admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:57:38.823960 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 1240/2492] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 30 00:57:38 2022] POST /identity/v3/users => generated 299 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 00:57:38.828185 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3e188a-ab24-4503-9222-2381f400d515 admin admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:57:38.839000 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3e188a-ab24-4503-9222-2381f400d515 admin admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:57:38.844003 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428b8c78-65cc-4224-b2ed-af651ab7f2eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:57:38.844604 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428b8c78-65cc-4224-b2ed-af651ab7f2eb admin admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:57:38.844883 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428b8c78-65cc-4224-b2ed-af651ab7f2eb admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:57:38.845172 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428b8c78-65cc-4224-b2ed-af651ab7f2eb admin admin] PATH_INFO: `/v3/roles` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:57:38.845841 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428b8c78-65cc-4224-b2ed-af651ab7f2eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:57:38.847504 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428b8c78-65cc-4224-b2ed-af651ab7f2eb admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:57:38.858397 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 1253/2493] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 30 00:57:38 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 00:57:38.863277 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2476aa14-7b6b-4fc1-9a3a-485cabccf47a admin admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:57:38.877789 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2476aa14-7b6b-4fc1-9a3a-485cabccf47a admin admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:57:38.883607 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61483401-0515-4988-80a8-e07627de2e38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:57:38.884259 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61483401-0515-4988-80a8-e07627de2e38 admin admin] REQUEST_METHOD: `PUT` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:57:38.884532 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61483401-0515-4988-80a8-e07627de2e38 admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:57:38.884803 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61483401-0515-4988-80a8-e07627de2e38 admin admin] PATH_INFO: `/v3/projects/9d31448a5b134218b06c8989d90a78df/users/995f0e193083414ba4736d71d900a3dc/roles/6ccaa8c11f29456fb4e4eeccb21616c7` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:57:38.900260 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61483401-0515-4988-80a8-e07627de2e38 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d31448a5b134218b06c8989d90a78df, user_id=995f0e193083414ba4736d71d900a3dc, role_id=6ccaa8c11f29456fb4e4eeccb21616c7)` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:57:38.902817 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61483401-0515-4988-80a8-e07627de2e38 admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:57:38.921922 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 1241/2494] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 30 00:57:38 2022] PUT /identity/v3/projects/9d31448a5b134218b06c8989d90a78df/users/995f0e193083414ba4736d71d900a3dc/roles/6ccaa8c11f29456fb4e4eeccb21616c7 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 00:57:38.926760 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428b8c78-65cc-4224-b2ed-af651ab7f2eb admin admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:57:38.941737 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428b8c78-65cc-4224-b2ed-af651ab7f2eb admin admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:57:39.000806 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d244f95-f549-4f71-a223-43efe6cc5b7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:57:39.001423 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d244f95-f549-4f71-a223-43efe6cc5b7e admin admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:57:39.001815 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d244f95-f549-4f71-a223-43efe6cc5b7e admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:57:39.002080 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d244f95-f549-4f71-a223-43efe6cc5b7e admin admin] PATH_INFO: `/v3/roles` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:57:39.002729 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d244f95-f549-4f71-a223-43efe6cc5b7e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:57:39.004387 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d244f95-f549-4f71-a223-43efe6cc5b7e admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:57:39.014517 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 1254/2495] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 30 00:57:38 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 00:57:39.018944 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61483401-0515-4988-80a8-e07627de2e38 admin admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:57:39.029731 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61483401-0515-4988-80a8-e07627de2e38 admin admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:57:39.034580 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccff227-2e84-4f4b-b24b-4e3c701266fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:57:39.035288 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccff227-2e84-4f4b-b24b-4e3c701266fa admin admin] REQUEST_METHOD: `PUT` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:57:39.035578 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccff227-2e84-4f4b-b24b-4e3c701266fa admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:57:39.035862 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccff227-2e84-4f4b-b24b-4e3c701266fa admin admin] PATH_INFO: `/v3/projects/9d31448a5b134218b06c8989d90a78df/users/995f0e193083414ba4736d71d900a3dc/roles/6ccaa8c11f29456fb4e4eeccb21616c7` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:57:39.037765 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ccff227-2e84-4f4b-b24b-4e3c701266fa admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d31448a5b134218b06c8989d90a78df, user_id=995f0e193083414ba4736d71d900a3dc, role_id=6ccaa8c11f29456fb4e4eeccb21616c7)` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:57:39.040405 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ccff227-2e84-4f4b-b24b-4e3c701266fa admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:57:39.046893 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:57:39.052424 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 1242/2496] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 30 00:57:39 2022] PUT /identity/v3/projects/9d31448a5b134218b06c8989d90a78df/users/995f0e193083414ba4736d71d900a3dc/roles/6ccaa8c11f29456fb4e4eeccb21616c7 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 00:57:39.063147 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae0e1be-b99b-4126-9a5d-715f9d75b927 None None] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:57:39.063521 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae0e1be-b99b-4126-9a5d-715f9d75b927 None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:57:39.063799 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae0e1be-b99b-4126-9a5d-715f9d75b927 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:57:39.095773 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.auth.core [None req-9ae0e1be-b99b-4126-9a5d-715f9d75b927 None None] MFA Rules not processed for user `995f0e193083414ba4736d71d900a3dc`. Rule list: `[]` (Enabled: `True`). {{(pid=87956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:57:39.096993 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-9ae0e1be-b99b-4126-9a5d-715f9d75b927 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:57:39.163613 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 1255/2497] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 30 00:57:39 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:57:39.180598 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccff227-2e84-4f4b-b24b-4e3c701266fa admin admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:57:39.182671 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-2ccff227-2e84-4f4b-b24b-4e3c701266fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:57:39.244354 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccff227-2e84-4f4b-b24b-4e3c701266fa admin admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:57:39.250553 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fe258d-da95-4f11-897d-8890ae717177 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48d928ff7fe24348ac900f09c56acc20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d2387fdf794d4eaef07bbcd7b39f2a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:57:39.251180 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fe258d-da95-4f11-897d-8890ae717177 service cinder] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:57:39.251513 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fe258d-da95-4f11-897d-8890ae717177 service cinder] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:57:39.251787 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fe258d-da95-4f11-897d-8890ae717177 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:57:39.317609 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63fe258d-da95-4f11-897d-8890ae717177 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:57:39.319044 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63fe258d-da95-4f11-897d-8890ae717177 service cinder] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:57:39.328154 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 1243/2498] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 30 00:57:39 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 30 00:57:43.644869 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae0e1be-b99b-4126-9a5d-715f9d75b927 None None] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:57:43.646451 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-9ae0e1be-b99b-4126-9a5d-715f9d75b927 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:57:43.660128 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae0e1be-b99b-4126-9a5d-715f9d75b927 None None] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:57:43.663792 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c585fba-5e1b-4a42-8b0a-a53428429dc6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48d928ff7fe24348ac900f09c56acc20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d2387fdf794d4eaef07bbcd7b39f2a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:57:43.664418 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c585fba-5e1b-4a42-8b0a-a53428429dc6 service cinder] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:57:43.664689 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c585fba-5e1b-4a42-8b0a-a53428429dc6 service cinder] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:57:43.664954 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c585fba-5e1b-4a42-8b0a-a53428429dc6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:57:43.673737 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c585fba-5e1b-4a42-8b0a-a53428429dc6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:57:43.675154 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c585fba-5e1b-4a42-8b0a-a53428429dc6 service cinder] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:57:43.684578 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 1256/2499] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 30 00:57:43 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 00:57:48.646819 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fe258d-da95-4f11-897d-8890ae717177 service cinder] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:57:48.720316 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fe258d-da95-4f11-897d-8890ae717177 service cinder] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:57:48.725523 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082f75ad-2e41-420c-a664-309c31f5a0f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:57:48.726142 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082f75ad-2e41-420c-a664-309c31f5a0f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:57:48.726416 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082f75ad-2e41-420c-a664-309c31f5a0f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:57:48.726684 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082f75ad-2e41-420c-a664-309c31f5a0f2 admin admin] PATH_INFO: `/v3/users/77ad9db670064173bd51ced9a259e63e` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:57:48.727951 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082f75ad-2e41-420c-a664-309c31f5a0f2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=77ad9db670064173bd51ced9a259e63e)` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:57:48.729862 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082f75ad-2e41-420c-a664-309c31f5a0f2 admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:57:48.780585 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-082f75ad-2e41-420c-a664-309c31f5a0f2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '77ad9db670064173bd51ced9a259e63e'} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:57:48.781219 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-082f75ad-2e41-420c-a664-309c31f5a0f2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '77ad9db670064173bd51ced9a259e63e'} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:57:48.788627 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-082f75ad-2e41-420c-a664-309c31f5a0f2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '77ad9db670064173bd51ced9a259e63e'} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:57:48.789237 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-082f75ad-2e41-420c-a664-309c31f5a0f2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '77ad9db670064173bd51ced9a259e63e'} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:57:48.790428 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:57:48.802552 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-082f75ad-2e41-420c-a664-309c31f5a0f2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '77ad9db670064173bd51ced9a259e63e'} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:57:48.816132 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 1244/2500] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 30 00:57:48 2022] DELETE /identity/v3/users/77ad9db670064173bd51ced9a259e63e => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 00:57:48.821130 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7a9344-59ec-4e1a-b69b-43d804eed3b4 None None] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:57:48.821753 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7a9344-59ec-4e1a-b69b-43d804eed3b4 None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:57:48.821854 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7a9344-59ec-4e1a-b69b-43d804eed3b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:57:48.836320 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:57:48.842523 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.auth.core [None req-aa7a9344-59ec-4e1a-b69b-43d804eed3b4 None None] MFA Rules not processed for user `eb55b6cbca4945abb21b0e49eb745e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=87956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:57:48.844129 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-aa7a9344-59ec-4e1a-b69b-43d804eed3b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:57:48.907154 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 1257/2501] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 30 00:57:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:57:48.917092 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082f75ad-2e41-420c-a664-309c31f5a0f2 admin admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:57:48.918600 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-082f75ad-2e41-420c-a664-309c31f5a0f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:57:48.979938 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082f75ad-2e41-420c-a664-309c31f5a0f2 admin admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:57:48.983648 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d9a005-3b36-4469-9ca5-13b6b7b052bd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5693f186c6ad4d9394f02ee3477cdcd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d2387fdf794d4eaef07bbcd7b39f2a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:57:48.984248 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d9a005-3b36-4469-9ca5-13b6b7b052bd service neutron] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:57:48.984518 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d9a005-3b36-4469-9ca5-13b6b7b052bd service neutron] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:57:48.984795 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d9a005-3b36-4469-9ca5-13b6b7b052bd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:57:48.994076 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d9a005-3b36-4469-9ca5-13b6b7b052bd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:57:48.995548 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d9a005-3b36-4469-9ca5-13b6b7b052bd service neutron] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:57:49.005186 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 1245/2502] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 30 00:57:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 00:57:49.280293 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7a9344-59ec-4e1a-b69b-43d804eed3b4 None None] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:57:49.281804 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-aa7a9344-59ec-4e1a-b69b-43d804eed3b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:57:49.294726 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7a9344-59ec-4e1a-b69b-43d804eed3b4 None None] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:57:49.300176 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abba1e98-38d2-4fe6-a6ed-5e2401182e1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:57:49.300819 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abba1e98-38d2-4fe6-a6ed-5e2401182e1a admin admin] REQUEST_METHOD: `DELETE` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:57:49.301144 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abba1e98-38d2-4fe6-a6ed-5e2401182e1a admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:57:49.301392 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abba1e98-38d2-4fe6-a6ed-5e2401182e1a admin admin] PATH_INFO: `/v3/projects/54ef15c0888b47a5b6e668737c09f1ed` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:57:49.302570 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abba1e98-38d2-4fe6-a6ed-5e2401182e1a admin admin] RBAC: Authorizing `identity:delete_project(project_id=54ef15c0888b47a5b6e668737c09f1ed)` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:57:49.304522 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abba1e98-38d2-4fe6-a6ed-5e2401182e1a admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:57:49.352032 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-abba1e98-38d2-4fe6-a6ed-5e2401182e1a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '54ef15c0888b47a5b6e668737c09f1ed', 'request_id': 'req-abba1e98-38d2-4fe6-a6ed-5e2401182e1a'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:57:49.360186 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-abba1e98-38d2-4fe6-a6ed-5e2401182e1a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '54ef15c0888b47a5b6e668737c09f1ed', 'request_id': 'req-abba1e98-38d2-4fe6-a6ed-5e2401182e1a'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:57:49.366907 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-abba1e98-38d2-4fe6-a6ed-5e2401182e1a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '54ef15c0888b47a5b6e668737c09f1ed', 'request_id': 'req-abba1e98-38d2-4fe6-a6ed-5e2401182e1a'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:57:49.378078 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-abba1e98-38d2-4fe6-a6ed-5e2401182e1a admin admin] The token cache is being invalidate because project 54ef15c0888b47a5b6e668737c09f1ed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87956) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 00:57:49.378352 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-abba1e98-38d2-4fe6-a6ed-5e2401182e1a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:57:49.379075 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-abba1e98-38d2-4fe6-a6ed-5e2401182e1a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:57:49.380623 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 1258/2503] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 30 00:57:49 2022] DELETE /identity/v3/projects/54ef15c0888b47a5b6e668737c09f1ed => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 00:57:49.384785 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d9a005-3b36-4469-9ca5-13b6b7b052bd service neutron] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:57:49.394501 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d9a005-3b36-4469-9ca5-13b6b7b052bd service neutron] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:57:49.465742 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92942da7-c853-47c3-8b74-23943ff8de52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:57:49.466281 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92942da7-c853-47c3-8b74-23943ff8de52 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:57:49.466554 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92942da7-c853-47c3-8b74-23943ff8de52 admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:57:49.466824 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92942da7-c853-47c3-8b74-23943ff8de52 admin admin] PATH_INFO: `/v3/users/995f0e193083414ba4736d71d900a3dc` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:57:49.468017 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92942da7-c853-47c3-8b74-23943ff8de52 admin admin] RBAC: Authorizing `identity:delete_user(user_id=995f0e193083414ba4736d71d900a3dc)` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:57:49.469919 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92942da7-c853-47c3-8b74-23943ff8de52 admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:57:49.525931 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-92942da7-c853-47c3-8b74-23943ff8de52 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '995f0e193083414ba4736d71d900a3dc'} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:57:49.526605 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-92942da7-c853-47c3-8b74-23943ff8de52 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '995f0e193083414ba4736d71d900a3dc'} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:57:49.533732 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-92942da7-c853-47c3-8b74-23943ff8de52 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '995f0e193083414ba4736d71d900a3dc'} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:57:49.534348 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-92942da7-c853-47c3-8b74-23943ff8de52 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '995f0e193083414ba4736d71d900a3dc'} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:57:49.548825 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-92942da7-c853-47c3-8b74-23943ff8de52 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '995f0e193083414ba4736d71d900a3dc'} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:57:49.552811 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:57:49.567397 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 1246/2504] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 30 00:57:49 2022] DELETE /identity/v3/users/995f0e193083414ba4736d71d900a3dc => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 00:57:49.850010 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abba1e98-38d2-4fe6-a6ed-5e2401182e1a admin admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:57:49.851530 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-abba1e98-38d2-4fe6-a6ed-5e2401182e1a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:57:49.864745 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abba1e98-38d2-4fe6-a6ed-5e2401182e1a admin admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:57:49.920874 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1c723b-82eb-49e8-8a91-18f7d113afc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:57:49.921502 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1c723b-82eb-49e8-8a91-18f7d113afc9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:57:49.921771 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1c723b-82eb-49e8-8a91-18f7d113afc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:57:49.922035 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1c723b-82eb-49e8-8a91-18f7d113afc9 admin admin] PATH_INFO: `/v3/projects/9d31448a5b134218b06c8989d90a78df` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:57:49.923130 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1c723b-82eb-49e8-8a91-18f7d113afc9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9d31448a5b134218b06c8989d90a78df)` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:57:49.925054 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1c723b-82eb-49e8-8a91-18f7d113afc9 admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:57:49.962531 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:57:49.976245 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-0f1c723b-82eb-49e8-8a91-18f7d113afc9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9d31448a5b134218b06c8989d90a78df', 'request_id': 'req-0f1c723b-82eb-49e8-8a91-18f7d113afc9'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:57:49.983907 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-0f1c723b-82eb-49e8-8a91-18f7d113afc9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9d31448a5b134218b06c8989d90a78df', 'request_id': 'req-0f1c723b-82eb-49e8-8a91-18f7d113afc9'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:57:49.990346 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-0f1c723b-82eb-49e8-8a91-18f7d113afc9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9d31448a5b134218b06c8989d90a78df', 'request_id': 'req-0f1c723b-82eb-49e8-8a91-18f7d113afc9'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:57:50.000682 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-0f1c723b-82eb-49e8-8a91-18f7d113afc9 admin admin] The token cache is being invalidate because project 9d31448a5b134218b06c8989d90a78df was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87956) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 00:57:50.000961 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-0f1c723b-82eb-49e8-8a91-18f7d113afc9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:57:50.001574 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-0f1c723b-82eb-49e8-8a91-18f7d113afc9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:57:50.003026 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 1259/2505] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 30 00:57:49 2022] DELETE /identity/v3/projects/9d31448a5b134218b06c8989d90a78df => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 00:57:50.009222 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b3baf1-aa73-4f0f-ad4d-2203782fecdf None None] REQUEST_METHOD: `POST` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:57:50.009694 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b3baf1-aa73-4f0f-ad4d-2203782fecdf None None] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:57:50.009817 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b3baf1-aa73-4f0f-ad4d-2203782fecdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:57:50.029982 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.auth.core [None req-36b3baf1-aa73-4f0f-ad4d-2203782fecdf None None] MFA Rules not processed for user `eb55b6cbca4945abb21b0e49eb745e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=87955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:57:50.031182 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-36b3baf1-aa73-4f0f-ad4d-2203782fecdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:57:50.092288 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 1247/2506] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 30 00:57:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:57:50.100890 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52289a6-c3ce-4c53-a7a9-2f79889a5a70 None None] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:57:50.101178 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52289a6-c3ce-4c53-a7a9-2f79889a5a70 None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:57:50.101456 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52289a6-c3ce-4c53-a7a9-2f79889a5a70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:57:50.121583 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.auth.core [None req-f52289a6-c3ce-4c53-a7a9-2f79889a5a70 None None] MFA Rules not processed for user `eb55b6cbca4945abb21b0e49eb745e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=87956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:57:50.122795 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-f52289a6-c3ce-4c53-a7a9-2f79889a5a70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:57:50.131456 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 1260/2507] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 30 00:57:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:57:50.136218 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b3baf1-aa73-4f0f-ad4d-2203782fecdf None None] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:57:50.150233 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b3baf1-aa73-4f0f-ad4d-2203782fecdf None None] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:57:50.157724 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a68163a-5e2e-4782-9e90-d1d55231772a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:57:50.158411 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a68163a-5e2e-4782-9e90-d1d55231772a admin admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:57:50.158686 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a68163a-5e2e-4782-9e90-d1d55231772a admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:57:50.159015 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a68163a-5e2e-4782-9e90-d1d55231772a admin admin] PATH_INFO: `/v3/domains` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:57:50.160013 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a68163a-5e2e-4782-9e90-d1d55231772a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:57:50.160425 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a68163a-5e2e-4782-9e90-d1d55231772a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:57:50.162849 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a68163a-5e2e-4782-9e90-d1d55231772a admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:57:50.175133 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 1248/2508] 10.222.0.42 () {58 vars in 1153 bytes} [Sun Oct 30 00:57:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:57:50.179663 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52289a6-c3ce-4c53-a7a9-2f79889a5a70 None None] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:57:50.189912 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52289a6-c3ce-4c53-a7a9-2f79889a5a70 None None] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:57:50.194798 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52364cd7-0a5c-4665-9130-ff387aa2de5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:57:50.195423 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52364cd7-0a5c-4665-9130-ff387aa2de5c admin admin] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:57:50.195707 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52364cd7-0a5c-4665-9130-ff387aa2de5c admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:57:50.195979 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52364cd7-0a5c-4665-9130-ff387aa2de5c admin admin] PATH_INFO: `/v3/projects` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:57:50.196702 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52364cd7-0a5c-4665-9130-ff387aa2de5c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:57:50.198597 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52364cd7-0a5c-4665-9130-ff387aa2de5c admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:57:50.228534 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 1261/2509] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 30 00:57:50 2022] POST /identity/v3/projects => generated 375 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 30 00:57:50.232973 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a68163a-5e2e-4782-9e90-d1d55231772a admin admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:57:50.243918 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a68163a-5e2e-4782-9e90-d1d55231772a admin admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:57:50.303080 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ec84c6-9058-4ca8-a959-306a72e1f194 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:57:50.303927 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ec84c6-9058-4ca8-a959-306a72e1f194 admin admin] REQUEST_METHOD: `POST` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:57:50.304205 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ec84c6-9058-4ca8-a959-306a72e1f194 admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:57:50.304476 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ec84c6-9058-4ca8-a959-306a72e1f194 admin admin] PATH_INFO: `/v3/users` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:57:50.305111 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ec84c6-9058-4ca8-a959-306a72e1f194 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:57:50.307059 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ec84c6-9058-4ca8-a959-306a72e1f194 admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:57:50.332059 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 1249/2510] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 30 00:57:50 2022] POST /identity/v3/users => generated 288 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 30 00:57:50.336506 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52364cd7-0a5c-4665-9130-ff387aa2de5c admin admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:57:50.347923 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52364cd7-0a5c-4665-9130-ff387aa2de5c admin admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:57:50.353660 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eff7bf6-a19e-40c0-88f9-19080acbd2f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:57:50.354274 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eff7bf6-a19e-40c0-88f9-19080acbd2f5 admin admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:57:50.354546 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eff7bf6-a19e-40c0-88f9-19080acbd2f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:57:50.354812 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eff7bf6-a19e-40c0-88f9-19080acbd2f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:57:50.355508 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eff7bf6-a19e-40c0-88f9-19080acbd2f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:57:50.357095 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eff7bf6-a19e-40c0-88f9-19080acbd2f5 admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:57:50.367301 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 1262/2511] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 30 00:57:50 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 00:57:50.371526 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ec84c6-9058-4ca8-a959-306a72e1f194 admin admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:57:50.381464 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ec84c6-9058-4ca8-a959-306a72e1f194 admin admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:57:50.386311 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b50ef13-a568-408d-8192-6ad35cb02ea4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:57:50.386902 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b50ef13-a568-408d-8192-6ad35cb02ea4 admin admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:57:50.387178 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b50ef13-a568-408d-8192-6ad35cb02ea4 admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:57:50.387487 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b50ef13-a568-408d-8192-6ad35cb02ea4 admin admin] PATH_INFO: `/v3/roles` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:57:50.388145 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b50ef13-a568-408d-8192-6ad35cb02ea4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:57:50.389738 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b50ef13-a568-408d-8192-6ad35cb02ea4 admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:57:50.400599 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 1250/2512] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 30 00:57:50 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 00:57:50.404806 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eff7bf6-a19e-40c0-88f9-19080acbd2f5 admin admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:57:50.414934 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eff7bf6-a19e-40c0-88f9-19080acbd2f5 admin admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:57:50.420223 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753c1633-4b53-402c-b8a6-1857004080cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:57:50.420867 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753c1633-4b53-402c-b8a6-1857004080cc admin admin] REQUEST_METHOD: `PUT` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:57:50.421167 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753c1633-4b53-402c-b8a6-1857004080cc admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:57:50.421417 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753c1633-4b53-402c-b8a6-1857004080cc admin admin] PATH_INFO: `/v3/projects/bc216bbf89eb4599a83f974055e5c58d/users/e81228d1c93944969271aed8a642a747/roles/1c93019874174c4b91118d9ce2347e47` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:57:50.436570 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753c1633-4b53-402c-b8a6-1857004080cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc216bbf89eb4599a83f974055e5c58d, user_id=e81228d1c93944969271aed8a642a747, role_id=1c93019874174c4b91118d9ce2347e47)` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:57:50.439573 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753c1633-4b53-402c-b8a6-1857004080cc admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:57:50.455824 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 1263/2513] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 30 00:57:50 2022] PUT /identity/v3/projects/bc216bbf89eb4599a83f974055e5c58d/users/e81228d1c93944969271aed8a642a747/roles/1c93019874174c4b91118d9ce2347e47 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 00:57:50.468833 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69207862-20bd-4f19-a276-d7a0ca594b0c None None] REQUEST_METHOD: `POST` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:57:50.469114 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69207862-20bd-4f19-a276-d7a0ca594b0c None None] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:57:50.469377 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69207862-20bd-4f19-a276-d7a0ca594b0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:57:50.499494 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.auth.core [None req-69207862-20bd-4f19-a276-d7a0ca594b0c None None] MFA Rules not processed for user `e81228d1c93944969271aed8a642a747`. Rule list: `[]` (Enabled: `True`). {{(pid=87955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:57:50.500630 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-69207862-20bd-4f19-a276-d7a0ca594b0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:57:50.565898 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:57:50.584773 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 1251/2514] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 30 00:57:50 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:57:50.589520 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753c1633-4b53-402c-b8a6-1857004080cc admin admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:57:50.650822 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753c1633-4b53-402c-b8a6-1857004080cc admin admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:57:50.658963 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef05ee91-b01d-44e1-a785-e542d1814a5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:57:50.659854 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef05ee91-b01d-44e1-a785-e542d1814a5f admin admin] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:57:50.660224 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef05ee91-b01d-44e1-a785-e542d1814a5f admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:57:50.660577 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef05ee91-b01d-44e1-a785-e542d1814a5f admin admin] PATH_INFO: `/v3/projects` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:57:50.661688 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef05ee91-b01d-44e1-a785-e542d1814a5f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:57:50.664649 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef05ee91-b01d-44e1-a785-e542d1814a5f admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:57:50.700994 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 1264/2515] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 30 00:57:50 2022] POST /identity/v3/projects => generated 373 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 00:57:50.706518 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69207862-20bd-4f19-a276-d7a0ca594b0c None None] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:57:50.717920 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69207862-20bd-4f19-a276-d7a0ca594b0c None None] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:57:50.773873 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7123ef3b-888c-4060-a74b-5bfdaa970db6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:57:50.774507 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7123ef3b-888c-4060-a74b-5bfdaa970db6 admin admin] REQUEST_METHOD: `POST` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:57:50.774785 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7123ef3b-888c-4060-a74b-5bfdaa970db6 admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:57:50.775053 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7123ef3b-888c-4060-a74b-5bfdaa970db6 admin admin] PATH_INFO: `/v3/users` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:57:50.775720 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7123ef3b-888c-4060-a74b-5bfdaa970db6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:57:50.777635 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7123ef3b-888c-4060-a74b-5bfdaa970db6 admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:57:50.805194 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 1252/2516] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 30 00:57:50 2022] POST /identity/v3/users => generated 293 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 00:57:50.809975 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef05ee91-b01d-44e1-a785-e542d1814a5f admin admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:57:50.824758 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef05ee91-b01d-44e1-a785-e542d1814a5f admin admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:57:50.830402 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468a6fb7-a8ae-48fb-a769-05a1bb5dede5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:57:50.831040 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468a6fb7-a8ae-48fb-a769-05a1bb5dede5 admin admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:57:50.831353 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468a6fb7-a8ae-48fb-a769-05a1bb5dede5 admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:57:50.831629 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468a6fb7-a8ae-48fb-a769-05a1bb5dede5 admin admin] PATH_INFO: `/v3/roles` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:57:50.832280 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468a6fb7-a8ae-48fb-a769-05a1bb5dede5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:57:50.833892 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468a6fb7-a8ae-48fb-a769-05a1bb5dede5 admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:57:50.844865 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 1265/2517] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 30 00:57:50 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 00:57:50.849024 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7123ef3b-888c-4060-a74b-5bfdaa970db6 admin admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:57:50.859314 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7123ef3b-888c-4060-a74b-5bfdaa970db6 admin admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:57:50.864134 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7795bd7-a2a7-47cb-95d4-5f9f14309af1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:57:50.864771 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7795bd7-a2a7-47cb-95d4-5f9f14309af1 admin admin] REQUEST_METHOD: `PUT` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:57:50.865045 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7795bd7-a2a7-47cb-95d4-5f9f14309af1 admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:57:50.865312 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7795bd7-a2a7-47cb-95d4-5f9f14309af1 admin admin] PATH_INFO: `/v3/projects/33f91668c5f74916822c66ea81b8996c/users/9558f83d0f3d4940afd5652c8e81359a/roles/6ccaa8c11f29456fb4e4eeccb21616c7` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:57:50.879985 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7795bd7-a2a7-47cb-95d4-5f9f14309af1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=33f91668c5f74916822c66ea81b8996c, user_id=9558f83d0f3d4940afd5652c8e81359a, role_id=6ccaa8c11f29456fb4e4eeccb21616c7)` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:57:50.882604 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7795bd7-a2a7-47cb-95d4-5f9f14309af1 admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:57:50.897529 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 1253/2518] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 30 00:57:50 2022] PUT /identity/v3/projects/33f91668c5f74916822c66ea81b8996c/users/9558f83d0f3d4940afd5652c8e81359a/roles/6ccaa8c11f29456fb4e4eeccb21616c7 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 00:57:50.902114 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468a6fb7-a8ae-48fb-a769-05a1bb5dede5 admin admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:57:50.912939 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468a6fb7-a8ae-48fb-a769-05a1bb5dede5 admin admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:57:50.944290 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:57:50.974872 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3341c39a-7e45-4914-87cf-e6f68c7de156 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:57:50.975522 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3341c39a-7e45-4914-87cf-e6f68c7de156 admin admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:57:50.975802 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3341c39a-7e45-4914-87cf-e6f68c7de156 admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:57:50.976184 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3341c39a-7e45-4914-87cf-e6f68c7de156 admin admin] PATH_INFO: `/v3/roles` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:57:50.976745 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3341c39a-7e45-4914-87cf-e6f68c7de156 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:57:50.978375 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3341c39a-7e45-4914-87cf-e6f68c7de156 admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:57:50.988634 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 1266/2519] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 30 00:57:50 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 00:57:50.993032 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7795bd7-a2a7-47cb-95d4-5f9f14309af1 admin admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:57:51.004759 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7795bd7-a2a7-47cb-95d4-5f9f14309af1 admin admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:57:51.009918 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebae6ddd-7571-4437-83ae-ec3e3f910377 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:57:51.010534 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebae6ddd-7571-4437-83ae-ec3e3f910377 admin admin] REQUEST_METHOD: `PUT` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:57:51.010825 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebae6ddd-7571-4437-83ae-ec3e3f910377 admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:57:51.011091 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebae6ddd-7571-4437-83ae-ec3e3f910377 admin admin] PATH_INFO: `/v3/projects/33f91668c5f74916822c66ea81b8996c/users/9558f83d0f3d4940afd5652c8e81359a/roles/6ccaa8c11f29456fb4e4eeccb21616c7` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:57:51.013209 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebae6ddd-7571-4437-83ae-ec3e3f910377 admin admin] RBAC: Authorizing `identity:create_grant(project_id=33f91668c5f74916822c66ea81b8996c, user_id=9558f83d0f3d4940afd5652c8e81359a, role_id=6ccaa8c11f29456fb4e4eeccb21616c7)` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:57:51.015851 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebae6ddd-7571-4437-83ae-ec3e3f910377 admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:57:51.026909 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 1254/2520] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 30 00:57:50 2022] PUT /identity/v3/projects/33f91668c5f74916822c66ea81b8996c/users/9558f83d0f3d4940afd5652c8e81359a/roles/6ccaa8c11f29456fb4e4eeccb21616c7 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 00:57:51.037298 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1e3c99-cd31-4c41-8a7e-cceced4a2a4a None None] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:57:51.037573 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1e3c99-cd31-4c41-8a7e-cceced4a2a4a None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:57:51.037861 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1e3c99-cd31-4c41-8a7e-cceced4a2a4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:57:51.073820 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.auth.core [None req-5b1e3c99-cd31-4c41-8a7e-cceced4a2a4a None None] MFA Rules not processed for user `9558f83d0f3d4940afd5652c8e81359a`. Rule list: `[]` (Enabled: `True`). {{(pid=87956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:57:51.075084 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-5b1e3c99-cd31-4c41-8a7e-cceced4a2a4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:57:51.143704 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 1267/2521] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 30 00:57:51 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:57:51.155244 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebae6ddd-7571-4437-83ae-ec3e3f910377 admin admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:57:51.157125 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-ebae6ddd-7571-4437-83ae-ec3e3f910377 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:57:51.217507 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebae6ddd-7571-4437-83ae-ec3e3f910377 admin admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:57:51.221656 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f36fa10-bbac-43b0-bc8c-f662ce2de008 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48d928ff7fe24348ac900f09c56acc20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d2387fdf794d4eaef07bbcd7b39f2a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:57:51.222240 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f36fa10-bbac-43b0-bc8c-f662ce2de008 service cinder] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:57:51.222514 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f36fa10-bbac-43b0-bc8c-f662ce2de008 service cinder] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:57:51.222786 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f36fa10-bbac-43b0-bc8c-f662ce2de008 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:57:51.278749 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f36fa10-bbac-43b0-bc8c-f662ce2de008 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:57:51.280161 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f36fa10-bbac-43b0-bc8c-f662ce2de008 service cinder] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:57:51.283695 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:57:51.291901 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 1255/2522] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 30 00:57:51 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 00:57:53.891536 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1e3c99-cd31-4c41-8a7e-cceced4a2a4a None None] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:57:53.963247 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1e3c99-cd31-4c41-8a7e-cceced4a2a4a None None] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:57:53.968923 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db494f5-0488-40af-979a-9186fb01114f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:57:53.969544 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db494f5-0488-40af-979a-9186fb01114f admin admin] REQUEST_METHOD: `DELETE` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:57:53.969817 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db494f5-0488-40af-979a-9186fb01114f admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:57:53.970053 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db494f5-0488-40af-979a-9186fb01114f admin admin] PATH_INFO: `/v3/users/e81228d1c93944969271aed8a642a747` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:57:53.971344 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db494f5-0488-40af-979a-9186fb01114f admin admin] RBAC: Authorizing `identity:delete_user(user_id=e81228d1c93944969271aed8a642a747)` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:57:53.973244 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db494f5-0488-40af-979a-9186fb01114f admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:57:54.026349 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-0db494f5-0488-40af-979a-9186fb01114f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e81228d1c93944969271aed8a642a747'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:57:54.027008 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-0db494f5-0488-40af-979a-9186fb01114f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e81228d1c93944969271aed8a642a747'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:57:54.032391 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:57:54.040374 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-0db494f5-0488-40af-979a-9186fb01114f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e81228d1c93944969271aed8a642a747'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:57:54.049107 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-0db494f5-0488-40af-979a-9186fb01114f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e81228d1c93944969271aed8a642a747'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:57:54.056680 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-0db494f5-0488-40af-979a-9186fb01114f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e81228d1c93944969271aed8a642a747'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:57:54.063643 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 1268/2523] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 30 00:57:53 2022] DELETE /identity/v3/users/e81228d1c93944969271aed8a642a747 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 00:57:54.068227 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ceb7d6f-cc38-4dd1-934e-9bc81f6c672b None None] REQUEST_METHOD: `POST` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:57:54.068746 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ceb7d6f-cc38-4dd1-934e-9bc81f6c672b None None] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:57:54.068746 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ceb7d6f-cc38-4dd1-934e-9bc81f6c672b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:57:54.090044 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.auth.core [None req-7ceb7d6f-cc38-4dd1-934e-9bc81f6c672b None None] MFA Rules not processed for user `eb55b6cbca4945abb21b0e49eb745e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=87955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:57:54.091442 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-7ceb7d6f-cc38-4dd1-934e-9bc81f6c672b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:57:54.153542 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 1256/2524] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 30 00:57:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:57:54.163825 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db494f5-0488-40af-979a-9186fb01114f admin admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:57:54.165463 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-0db494f5-0488-40af-979a-9186fb01114f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:57:54.224712 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db494f5-0488-40af-979a-9186fb01114f admin admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:57:54.228793 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772bb3a1-5815-4d4c-8f37-5974987e0d64 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5693f186c6ad4d9394f02ee3477cdcd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d2387fdf794d4eaef07bbcd7b39f2a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:57:54.229406 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772bb3a1-5815-4d4c-8f37-5974987e0d64 service neutron] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:57:54.229682 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772bb3a1-5815-4d4c-8f37-5974987e0d64 service neutron] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:57:54.229948 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772bb3a1-5815-4d4c-8f37-5974987e0d64 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:57:54.240162 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772bb3a1-5815-4d4c-8f37-5974987e0d64 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:57:54.241591 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772bb3a1-5815-4d4c-8f37-5974987e0d64 service neutron] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:57:54.251434 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 1269/2525] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 30 00:57:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 00:57:54.528022 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ceb7d6f-cc38-4dd1-934e-9bc81f6c672b None None] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:57:54.529762 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-7ceb7d6f-cc38-4dd1-934e-9bc81f6c672b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:57:54.549954 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ceb7d6f-cc38-4dd1-934e-9bc81f6c672b None None] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:57:54.556098 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bf3c37-f0d3-4a3e-b128-3f8fedccc7e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:57:54.557085 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bf3c37-f0d3-4a3e-b128-3f8fedccc7e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:57:54.557397 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bf3c37-f0d3-4a3e-b128-3f8fedccc7e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:57:54.557622 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bf3c37-f0d3-4a3e-b128-3f8fedccc7e7 admin admin] PATH_INFO: `/v3/projects/bc216bbf89eb4599a83f974055e5c58d` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:57:54.559114 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0bf3c37-f0d3-4a3e-b128-3f8fedccc7e7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bc216bbf89eb4599a83f974055e5c58d)` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:57:54.561427 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0bf3c37-f0d3-4a3e-b128-3f8fedccc7e7 admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:57:54.612945 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-a0bf3c37-f0d3-4a3e-b128-3f8fedccc7e7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bc216bbf89eb4599a83f974055e5c58d', 'request_id': 'req-a0bf3c37-f0d3-4a3e-b128-3f8fedccc7e7'} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:57:54.618711 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-a0bf3c37-f0d3-4a3e-b128-3f8fedccc7e7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bc216bbf89eb4599a83f974055e5c58d', 'request_id': 'req-a0bf3c37-f0d3-4a3e-b128-3f8fedccc7e7'} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:57:54.627594 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-a0bf3c37-f0d3-4a3e-b128-3f8fedccc7e7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bc216bbf89eb4599a83f974055e5c58d', 'request_id': 'req-a0bf3c37-f0d3-4a3e-b128-3f8fedccc7e7'} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:57:54.642587 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-a0bf3c37-f0d3-4a3e-b128-3f8fedccc7e7 admin admin] The token cache is being invalidate because project bc216bbf89eb4599a83f974055e5c58d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87955) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 00:57:54.642867 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-a0bf3c37-f0d3-4a3e-b128-3f8fedccc7e7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:57:54.643521 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-a0bf3c37-f0d3-4a3e-b128-3f8fedccc7e7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:57:54.645047 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 1257/2526] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 30 00:57:54 2022] DELETE /identity/v3/projects/bc216bbf89eb4599a83f974055e5c58d => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 00:57:54.649234 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772bb3a1-5815-4d4c-8f37-5974987e0d64 service neutron] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:57:54.658870 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772bb3a1-5815-4d4c-8f37-5974987e0d64 service neutron] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:57:54.724572 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca28ecd-fadd-4dff-8405-9f107d89ed4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:57:54.725227 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca28ecd-fadd-4dff-8405-9f107d89ed4f admin admin] REQUEST_METHOD: `DELETE` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:57:54.725535 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca28ecd-fadd-4dff-8405-9f107d89ed4f admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:57:54.725812 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca28ecd-fadd-4dff-8405-9f107d89ed4f admin admin] PATH_INFO: `/v3/users/9558f83d0f3d4940afd5652c8e81359a` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:57:54.726965 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca28ecd-fadd-4dff-8405-9f107d89ed4f admin admin] RBAC: Authorizing `identity:delete_user(user_id=9558f83d0f3d4940afd5652c8e81359a)` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:57:54.728942 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca28ecd-fadd-4dff-8405-9f107d89ed4f admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:57:54.779312 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-eca28ecd-fadd-4dff-8405-9f107d89ed4f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9558f83d0f3d4940afd5652c8e81359a'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:57:54.779945 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-eca28ecd-fadd-4dff-8405-9f107d89ed4f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9558f83d0f3d4940afd5652c8e81359a'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:57:54.792401 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-eca28ecd-fadd-4dff-8405-9f107d89ed4f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9558f83d0f3d4940afd5652c8e81359a'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:57:54.801738 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-eca28ecd-fadd-4dff-8405-9f107d89ed4f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9558f83d0f3d4940afd5652c8e81359a'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:57:54.806639 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:57:54.810088 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-eca28ecd-fadd-4dff-8405-9f107d89ed4f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9558f83d0f3d4940afd5652c8e81359a'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:57:54.817787 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 1270/2527] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 30 00:57:54 2022] DELETE /identity/v3/users/9558f83d0f3d4940afd5652c8e81359a => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 00:57:55.103831 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bf3c37-f0d3-4a3e-b128-3f8fedccc7e7 admin admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:57:55.105429 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-a0bf3c37-f0d3-4a3e-b128-3f8fedccc7e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:57:55.121102 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bf3c37-f0d3-4a3e-b128-3f8fedccc7e7 admin admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:57:55.180068 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39219c7-8ca1-4639-b0af-fd8f8c1f71ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:57:55.180617 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39219c7-8ca1-4639-b0af-fd8f8c1f71ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:57:55.180888 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39219c7-8ca1-4639-b0af-fd8f8c1f71ea admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:57:55.181156 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39219c7-8ca1-4639-b0af-fd8f8c1f71ea admin admin] PATH_INFO: `/v3/projects/33f91668c5f74916822c66ea81b8996c` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:57:55.182257 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39219c7-8ca1-4639-b0af-fd8f8c1f71ea admin admin] RBAC: Authorizing `identity:delete_project(project_id=33f91668c5f74916822c66ea81b8996c)` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:57:55.184275 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39219c7-8ca1-4639-b0af-fd8f8c1f71ea admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:57:55.208227 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:57:55.240827 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-d39219c7-8ca1-4639-b0af-fd8f8c1f71ea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '33f91668c5f74916822c66ea81b8996c', 'request_id': 'req-d39219c7-8ca1-4639-b0af-fd8f8c1f71ea'} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:57:55.248569 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-d39219c7-8ca1-4639-b0af-fd8f8c1f71ea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '33f91668c5f74916822c66ea81b8996c', 'request_id': 'req-d39219c7-8ca1-4639-b0af-fd8f8c1f71ea'} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:57:55.259134 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-d39219c7-8ca1-4639-b0af-fd8f8c1f71ea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '33f91668c5f74916822c66ea81b8996c', 'request_id': 'req-d39219c7-8ca1-4639-b0af-fd8f8c1f71ea'} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:57:55.271093 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-d39219c7-8ca1-4639-b0af-fd8f8c1f71ea admin admin] The token cache is being invalidate because project 33f91668c5f74916822c66ea81b8996c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87955) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 00:57:55.271504 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-d39219c7-8ca1-4639-b0af-fd8f8c1f71ea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:57:55.272149 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-d39219c7-8ca1-4639-b0af-fd8f8c1f71ea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:57:55.273933 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 1258/2528] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 30 00:57:55 2022] DELETE /identity/v3/projects/33f91668c5f74916822c66ea81b8996c => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 00:57:55.279387 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b47a325-c754-4724-8ec6-ddb66bd01980 None None] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:57:55.279960 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b47a325-c754-4724-8ec6-ddb66bd01980 None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:57:55.279960 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b47a325-c754-4724-8ec6-ddb66bd01980 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:57:55.301193 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.auth.core [None req-7b47a325-c754-4724-8ec6-ddb66bd01980 None None] MFA Rules not processed for user `eb55b6cbca4945abb21b0e49eb745e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=87956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:57:55.302473 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-7b47a325-c754-4724-8ec6-ddb66bd01980 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:57:55.370030 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 1271/2529] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 30 00:57:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:57:55.379003 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a207e7de-dc41-4728-b60f-c2b394183fe6 None None] REQUEST_METHOD: `POST` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:57:55.379293 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a207e7de-dc41-4728-b60f-c2b394183fe6 None None] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:57:55.379565 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a207e7de-dc41-4728-b60f-c2b394183fe6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:57:55.403067 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.auth.core [None req-a207e7de-dc41-4728-b60f-c2b394183fe6 None None] MFA Rules not processed for user `eb55b6cbca4945abb21b0e49eb745e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=87955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:57:55.404385 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-a207e7de-dc41-4728-b60f-c2b394183fe6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:57:55.412426 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 1259/2530] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 30 00:57:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:57:55.416850 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b47a325-c754-4724-8ec6-ddb66bd01980 None None] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:57:55.427173 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b47a325-c754-4724-8ec6-ddb66bd01980 None None] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:57:55.432144 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41d16da-2498-4ada-92ba-b6892164926c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:57:55.432680 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41d16da-2498-4ada-92ba-b6892164926c admin admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:57:55.432950 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41d16da-2498-4ada-92ba-b6892164926c admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:57:55.433216 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41d16da-2498-4ada-92ba-b6892164926c admin admin] PATH_INFO: `/v3/domains` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:57:55.434176 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41d16da-2498-4ada-92ba-b6892164926c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87956) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:57:55.434495 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41d16da-2498-4ada-92ba-b6892164926c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:57:55.436561 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41d16da-2498-4ada-92ba-b6892164926c admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:57:55.448452 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 1272/2531] 10.222.0.42 () {58 vars in 1153 bytes} [Sun Oct 30 00:57:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:57:55.452872 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a207e7de-dc41-4728-b60f-c2b394183fe6 None None] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:57:55.462032 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a207e7de-dc41-4728-b60f-c2b394183fe6 None None] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:57:55.467089 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b84908-75bf-4b32-838c-f68fea89d2e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:57:55.467797 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b84908-75bf-4b32-838c-f68fea89d2e3 admin admin] REQUEST_METHOD: `POST` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:57:55.468071 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b84908-75bf-4b32-838c-f68fea89d2e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:57:55.468360 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b84908-75bf-4b32-838c-f68fea89d2e3 admin admin] PATH_INFO: `/v3/projects` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:57:55.468965 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b84908-75bf-4b32-838c-f68fea89d2e3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:57:55.470848 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b84908-75bf-4b32-838c-f68fea89d2e3 admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:57:55.503154 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 1260/2532] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 30 00:57:55 2022] POST /identity/v3/projects => generated 375 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 00:57:55.507653 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41d16da-2498-4ada-92ba-b6892164926c admin admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:57:55.518903 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41d16da-2498-4ada-92ba-b6892164926c admin admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:57:55.586984 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ae9c0f-3886-42e6-803f-0c03d4f6c6c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:57:55.587790 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ae9c0f-3886-42e6-803f-0c03d4f6c6c9 admin admin] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:57:55.588280 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ae9c0f-3886-42e6-803f-0c03d4f6c6c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:57:55.588561 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ae9c0f-3886-42e6-803f-0c03d4f6c6c9 admin admin] PATH_INFO: `/v3/users` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:57:55.589310 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ae9c0f-3886-42e6-803f-0c03d4f6c6c9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:57:55.591740 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ae9c0f-3886-42e6-803f-0c03d4f6c6c9 admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:57:55.614527 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 1273/2533] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 30 00:57:55 2022] POST /identity/v3/users => generated 288 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 00:57:55.618862 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b84908-75bf-4b32-838c-f68fea89d2e3 admin admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:57:55.629796 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b84908-75bf-4b32-838c-f68fea89d2e3 admin admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:57:55.634877 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a27b2a-627d-48f7-9084-80fd7bf21148 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:57:55.635515 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a27b2a-627d-48f7-9084-80fd7bf21148 admin admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:57:55.635794 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a27b2a-627d-48f7-9084-80fd7bf21148 admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:57:55.636065 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a27b2a-627d-48f7-9084-80fd7bf21148 admin admin] PATH_INFO: `/v3/roles` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:57:55.636754 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a27b2a-627d-48f7-9084-80fd7bf21148 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:57:55.638400 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a27b2a-627d-48f7-9084-80fd7bf21148 admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:57:55.648599 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 1261/2534] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 30 00:57:55 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 30 00:57:55.652728 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ae9c0f-3886-42e6-803f-0c03d4f6c6c9 admin admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:57:55.662995 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ae9c0f-3886-42e6-803f-0c03d4f6c6c9 admin admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:57:55.668754 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f8da80-b16f-4ef6-85e7-510630dffbca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:57:55.669361 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f8da80-b16f-4ef6-85e7-510630dffbca admin admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:57:55.669637 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f8da80-b16f-4ef6-85e7-510630dffbca admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:57:55.669906 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f8da80-b16f-4ef6-85e7-510630dffbca admin admin] PATH_INFO: `/v3/roles` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:57:55.670566 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f8da80-b16f-4ef6-85e7-510630dffbca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:57:55.672244 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f8da80-b16f-4ef6-85e7-510630dffbca admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:57:55.683881 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 1274/2535] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 30 00:57:55 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 00:57:55.688598 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a27b2a-627d-48f7-9084-80fd7bf21148 admin admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:57:55.699047 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a27b2a-627d-48f7-9084-80fd7bf21148 admin admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:57:55.704555 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0120e7-45d0-4167-ba5d-cbce5197873f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:57:55.705198 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0120e7-45d0-4167-ba5d-cbce5197873f admin admin] REQUEST_METHOD: `PUT` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:57:55.705463 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0120e7-45d0-4167-ba5d-cbce5197873f admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:57:55.705732 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0120e7-45d0-4167-ba5d-cbce5197873f admin admin] PATH_INFO: `/v3/projects/0f36371d43a44770a3c134e072b695da/users/f37cfa0066c84e4ab77eaac91fb4d2b0/roles/1c93019874174c4b91118d9ce2347e47` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:57:55.722154 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0120e7-45d0-4167-ba5d-cbce5197873f admin admin] RBAC: Authorizing `identity:create_grant(project_id=0f36371d43a44770a3c134e072b695da, user_id=f37cfa0066c84e4ab77eaac91fb4d2b0, role_id=1c93019874174c4b91118d9ce2347e47)` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:57:55.725018 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0120e7-45d0-4167-ba5d-cbce5197873f admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:57:55.741220 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 1262/2536] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 30 00:57:55 2022] PUT /identity/v3/projects/0f36371d43a44770a3c134e072b695da/users/f37cfa0066c84e4ab77eaac91fb4d2b0/roles/1c93019874174c4b91118d9ce2347e47 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 00:57:55.752388 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fba989-84ad-4ea4-9c17-8f2ebcc04cc0 None None] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:57:55.752671 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fba989-84ad-4ea4-9c17-8f2ebcc04cc0 None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:57:55.752938 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fba989-84ad-4ea4-9c17-8f2ebcc04cc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:57:55.783240 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.auth.core [None req-a9fba989-84ad-4ea4-9c17-8f2ebcc04cc0 None None] MFA Rules not processed for user `f37cfa0066c84e4ab77eaac91fb4d2b0`. Rule list: `[]` (Enabled: `True`). {{(pid=87956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:57:55.784487 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-a9fba989-84ad-4ea4-9c17-8f2ebcc04cc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:57:55.833967 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:57:55.855170 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 1275/2537] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 30 00:57:55 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 30 00:57:55.866978 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0120e7-45d0-4167-ba5d-cbce5197873f admin admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:57:55.868917 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-6d0120e7-45d0-4167-ba5d-cbce5197873f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:57:55.930835 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0120e7-45d0-4167-ba5d-cbce5197873f admin admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:57:55.935022 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1af2153-4619-46f7-97a8-258f21cdaca4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48d928ff7fe24348ac900f09c56acc20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d2387fdf794d4eaef07bbcd7b39f2a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:57:55.935556 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1af2153-4619-46f7-97a8-258f21cdaca4 service cinder] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:57:55.935869 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1af2153-4619-46f7-97a8-258f21cdaca4 service cinder] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:57:55.936097 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1af2153-4619-46f7-97a8-258f21cdaca4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:57:55.945081 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1af2153-4619-46f7-97a8-258f21cdaca4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:57:55.946507 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1af2153-4619-46f7-97a8-258f21cdaca4 service cinder] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:57:55.955542 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 1263/2538] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 30 00:57:55 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 00:58:05.851870 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=5 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:58:05.951823 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=68,keystone:DELETE=6,keystone:INSERT=3 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:58:07.573075 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fba989-84ad-4ea4-9c17-8f2ebcc04cc0 None None] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:58:07.653351 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fba989-84ad-4ea4-9c17-8f2ebcc04cc0 None None] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:58:07.658441 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bf51ad-818d-4e1e-aeed-2106489a7f3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:58:07.659083 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bf51ad-818d-4e1e-aeed-2106489a7f3e admin admin] REQUEST_METHOD: `DELETE` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:58:07.659383 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bf51ad-818d-4e1e-aeed-2106489a7f3e admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:58:07.659652 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bf51ad-818d-4e1e-aeed-2106489a7f3e admin admin] PATH_INFO: `/v3/users/f37cfa0066c84e4ab77eaac91fb4d2b0` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:58:07.660838 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9bf51ad-818d-4e1e-aeed-2106489a7f3e admin admin] RBAC: Authorizing `identity:delete_user(user_id=f37cfa0066c84e4ab77eaac91fb4d2b0)` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:58:07.662884 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9bf51ad-818d-4e1e-aeed-2106489a7f3e admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:58:07.714690 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-f9bf51ad-818d-4e1e-aeed-2106489a7f3e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f37cfa0066c84e4ab77eaac91fb4d2b0'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:58:07.715317 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-f9bf51ad-818d-4e1e-aeed-2106489a7f3e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f37cfa0066c84e4ab77eaac91fb4d2b0'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:58:07.726883 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-f9bf51ad-818d-4e1e-aeed-2106489a7f3e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f37cfa0066c84e4ab77eaac91fb4d2b0'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:58:07.735752 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-f9bf51ad-818d-4e1e-aeed-2106489a7f3e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f37cfa0066c84e4ab77eaac91fb4d2b0'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:58:07.742990 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-f9bf51ad-818d-4e1e-aeed-2106489a7f3e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f37cfa0066c84e4ab77eaac91fb4d2b0'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:58:07.749021 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 1276/2539] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 30 00:58:07 2022] DELETE /identity/v3/users/f37cfa0066c84e4ab77eaac91fb4d2b0 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 00:58:07.753635 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8760a593-d084-4fc3-a80a-3a2c7edf7568 None None] REQUEST_METHOD: `POST` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:58:07.754139 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8760a593-d084-4fc3-a80a-3a2c7edf7568 None None] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:58:07.754139 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8760a593-d084-4fc3-a80a-3a2c7edf7568 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:58:07.773775 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.auth.core [None req-8760a593-d084-4fc3-a80a-3a2c7edf7568 None None] MFA Rules not processed for user `eb55b6cbca4945abb21b0e49eb745e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=87955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:58:07.774946 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-8760a593-d084-4fc3-a80a-3a2c7edf7568 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:58:07.845320 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 1264/2540] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 30 00:58:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:58:07.855244 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bf51ad-818d-4e1e-aeed-2106489a7f3e admin admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:58:07.856788 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-f9bf51ad-818d-4e1e-aeed-2106489a7f3e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:58:07.918921 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bf51ad-818d-4e1e-aeed-2106489a7f3e admin admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:58:07.923486 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce1dd64-1aec-497f-aa06-9aac0755c641 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5693f186c6ad4d9394f02ee3477cdcd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d2387fdf794d4eaef07bbcd7b39f2a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:58:07.924124 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce1dd64-1aec-497f-aa06-9aac0755c641 service neutron] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:58:07.924397 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce1dd64-1aec-497f-aa06-9aac0755c641 service neutron] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:58:07.924669 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce1dd64-1aec-497f-aa06-9aac0755c641 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:58:07.934755 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce1dd64-1aec-497f-aa06-9aac0755c641 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:58:07.936234 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce1dd64-1aec-497f-aa06-9aac0755c641 service neutron] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:58:07.946220 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 1277/2541] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 30 00:58:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 00:58:08.219772 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8760a593-d084-4fc3-a80a-3a2c7edf7568 None None] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:58:08.221212 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-8760a593-d084-4fc3-a80a-3a2c7edf7568 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:58:08.235455 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8760a593-d084-4fc3-a80a-3a2c7edf7568 None None] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:58:08.240902 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c6d466-ba6f-443e-92c2-8e5014b82ebb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:58:08.242220 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c6d466-ba6f-443e-92c2-8e5014b82ebb admin admin] REQUEST_METHOD: `DELETE` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:58:08.242668 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c6d466-ba6f-443e-92c2-8e5014b82ebb admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:58:08.242947 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c6d466-ba6f-443e-92c2-8e5014b82ebb admin admin] PATH_INFO: `/v3/projects/0f36371d43a44770a3c134e072b695da` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:58:08.244324 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c6d466-ba6f-443e-92c2-8e5014b82ebb admin admin] RBAC: Authorizing `identity:delete_project(project_id=0f36371d43a44770a3c134e072b695da)` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:58:08.246308 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c6d466-ba6f-443e-92c2-8e5014b82ebb admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:58:08.295071 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-40c6d466-ba6f-443e-92c2-8e5014b82ebb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0f36371d43a44770a3c134e072b695da', 'request_id': 'req-40c6d466-ba6f-443e-92c2-8e5014b82ebb'} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:58:08.301743 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-40c6d466-ba6f-443e-92c2-8e5014b82ebb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0f36371d43a44770a3c134e072b695da', 'request_id': 'req-40c6d466-ba6f-443e-92c2-8e5014b82ebb'} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:58:08.310286 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-40c6d466-ba6f-443e-92c2-8e5014b82ebb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0f36371d43a44770a3c134e072b695da', 'request_id': 'req-40c6d466-ba6f-443e-92c2-8e5014b82ebb'} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:58:08.321808 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-40c6d466-ba6f-443e-92c2-8e5014b82ebb admin admin] The token cache is being invalidate because project 0f36371d43a44770a3c134e072b695da was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87955) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 00:58:08.322092 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-40c6d466-ba6f-443e-92c2-8e5014b82ebb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:58:08.322729 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-40c6d466-ba6f-443e-92c2-8e5014b82ebb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:58:08.324296 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 1265/2542] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 30 00:58:08 2022] DELETE /identity/v3/projects/0f36371d43a44770a3c134e072b695da => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 00:58:08.329399 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372d8495-df39-4722-bbe1-9a6f637b6e5a None None] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:58:08.329682 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372d8495-df39-4722-bbe1-9a6f637b6e5a None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:58:08.329928 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372d8495-df39-4722-bbe1-9a6f637b6e5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:58:08.350212 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.auth.core [None req-372d8495-df39-4722-bbe1-9a6f637b6e5a None None] MFA Rules not processed for user `eb55b6cbca4945abb21b0e49eb745e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=87956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:58:08.351464 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-372d8495-df39-4722-bbe1-9a6f637b6e5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:58:08.369665 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:58:08.415505 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 1278/2543] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 30 00:58:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:58:08.424457 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04d8589-8114-4ea5-8bd5-0cf559594469 None None] REQUEST_METHOD: `POST` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:58:08.424865 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04d8589-8114-4ea5-8bd5-0cf559594469 None None] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:58:08.425267 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04d8589-8114-4ea5-8bd5-0cf559594469 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:58:08.451165 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.auth.core [None req-f04d8589-8114-4ea5-8bd5-0cf559594469 None None] MFA Rules not processed for user `eb55b6cbca4945abb21b0e49eb745e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=87955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:58:08.452434 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-f04d8589-8114-4ea5-8bd5-0cf559594469 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:58:08.461695 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 1266/2544] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 30 00:58:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:58:08.466227 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372d8495-df39-4722-bbe1-9a6f637b6e5a None None] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:58:08.476361 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372d8495-df39-4722-bbe1-9a6f637b6e5a None None] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:58:08.481606 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f746782-a524-49cd-b980-2b8ebd63bc86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:58:08.482201 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f746782-a524-49cd-b980-2b8ebd63bc86 admin admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:58:08.482478 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f746782-a524-49cd-b980-2b8ebd63bc86 admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:58:08.482740 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f746782-a524-49cd-b980-2b8ebd63bc86 admin admin] PATH_INFO: `/v3/domains` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:58:08.483422 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f746782-a524-49cd-b980-2b8ebd63bc86 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87956) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:58:08.483721 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f746782-a524-49cd-b980-2b8ebd63bc86 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:58:08.485311 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f746782-a524-49cd-b980-2b8ebd63bc86 admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:58:08.497064 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 1279/2545] 10.222.0.42 () {58 vars in 1153 bytes} [Sun Oct 30 00:58:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:58:08.501622 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04d8589-8114-4ea5-8bd5-0cf559594469 None None] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:58:08.511242 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04d8589-8114-4ea5-8bd5-0cf559594469 None None] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:58:08.516959 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8c76be-5c90-4ec7-84e9-605c26fec6e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:58:08.517555 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8c76be-5c90-4ec7-84e9-605c26fec6e2 admin admin] REQUEST_METHOD: `POST` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:58:08.517831 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8c76be-5c90-4ec7-84e9-605c26fec6e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:58:08.518095 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8c76be-5c90-4ec7-84e9-605c26fec6e2 admin admin] PATH_INFO: `/v3/projects` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:58:08.518721 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8c76be-5c90-4ec7-84e9-605c26fec6e2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:58:08.520639 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8c76be-5c90-4ec7-84e9-605c26fec6e2 admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:58:08.551819 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 1267/2546] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 30 00:58:08 2022] POST /identity/v3/projects => generated 385 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 00:58:08.556104 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f746782-a524-49cd-b980-2b8ebd63bc86 admin admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:58:08.566854 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f746782-a524-49cd-b980-2b8ebd63bc86 admin admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:58:08.623810 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc91d98-c1f8-43c4-8fd6-303dbb183a21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:58:08.624453 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc91d98-c1f8-43c4-8fd6-303dbb183a21 admin admin] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:58:08.624678 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc91d98-c1f8-43c4-8fd6-303dbb183a21 admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:58:08.624970 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc91d98-c1f8-43c4-8fd6-303dbb183a21 admin admin] PATH_INFO: `/v3/users` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:58:08.625595 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc91d98-c1f8-43c4-8fd6-303dbb183a21 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:58:08.627670 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc91d98-c1f8-43c4-8fd6-303dbb183a21 admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:58:08.651781 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 1280/2547] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 30 00:58:08 2022] POST /identity/v3/users => generated 293 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 00:58:08.655931 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8c76be-5c90-4ec7-84e9-605c26fec6e2 admin admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:58:08.666761 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8c76be-5c90-4ec7-84e9-605c26fec6e2 admin admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:58:08.671484 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6410f74f-f35e-4be7-8034-21ba7c47c89d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:58:08.672072 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6410f74f-f35e-4be7-8034-21ba7c47c89d admin admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:58:08.672340 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6410f74f-f35e-4be7-8034-21ba7c47c89d admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:58:08.672606 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6410f74f-f35e-4be7-8034-21ba7c47c89d admin admin] PATH_INFO: `/v3/roles` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:58:08.673244 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6410f74f-f35e-4be7-8034-21ba7c47c89d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:58:08.674832 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6410f74f-f35e-4be7-8034-21ba7c47c89d admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:58:08.685268 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 1268/2548] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 30 00:58:08 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 00:58:08.689600 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc91d98-c1f8-43c4-8fd6-303dbb183a21 admin admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:58:08.700125 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc91d98-c1f8-43c4-8fd6-303dbb183a21 admin admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:58:08.705310 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797408a8-29d8-4c45-82bb-294ede054c09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:58:08.705908 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797408a8-29d8-4c45-82bb-294ede054c09 admin admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:58:08.706186 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797408a8-29d8-4c45-82bb-294ede054c09 admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:58:08.706433 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797408a8-29d8-4c45-82bb-294ede054c09 admin admin] PATH_INFO: `/v3/roles` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:58:08.707075 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797408a8-29d8-4c45-82bb-294ede054c09 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:58:08.708804 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797408a8-29d8-4c45-82bb-294ede054c09 admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:58:08.720128 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 1281/2549] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 30 00:58:08 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 00:58:08.724561 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6410f74f-f35e-4be7-8034-21ba7c47c89d admin admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:58:08.734466 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6410f74f-f35e-4be7-8034-21ba7c47c89d admin admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:58:08.739369 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711403e2-affc-49b9-8960-e2eb7310117d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:58:08.740038 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711403e2-affc-49b9-8960-e2eb7310117d admin admin] REQUEST_METHOD: `PUT` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:58:08.740306 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711403e2-affc-49b9-8960-e2eb7310117d admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:58:08.740575 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711403e2-affc-49b9-8960-e2eb7310117d admin admin] PATH_INFO: `/v3/projects/8925aec079954cbdb52901b88d55037a/users/24c857e087954f2f8c874f82134b1992/roles/1c93019874174c4b91118d9ce2347e47` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:58:08.755961 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711403e2-affc-49b9-8960-e2eb7310117d admin admin] RBAC: Authorizing `identity:create_grant(project_id=8925aec079954cbdb52901b88d55037a, user_id=24c857e087954f2f8c874f82134b1992, role_id=1c93019874174c4b91118d9ce2347e47)` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:58:08.758584 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711403e2-affc-49b9-8960-e2eb7310117d admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:58:08.773058 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 1269/2550] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 30 00:58:08 2022] PUT /identity/v3/projects/8925aec079954cbdb52901b88d55037a/users/24c857e087954f2f8c874f82134b1992/roles/1c93019874174c4b91118d9ce2347e47 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 00:58:08.785289 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbf722d-db2e-4818-b0b9-310aa79e1bb3 None None] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:58:08.785649 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbf722d-db2e-4818-b0b9-310aa79e1bb3 None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:58:08.785963 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbf722d-db2e-4818-b0b9-310aa79e1bb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:58:08.821143 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.auth.core [None req-1fbf722d-db2e-4818-b0b9-310aa79e1bb3 None None] MFA Rules not processed for user `24c857e087954f2f8c874f82134b1992`. Rule list: `[]` (Enabled: `True`). {{(pid=87956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:58:08.822289 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-1fbf722d-db2e-4818-b0b9-310aa79e1bb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:58:08.890955 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 1282/2551] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 30 00:58:08 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:58:08.897652 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711403e2-affc-49b9-8960-e2eb7310117d admin admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:58:08.920055 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:58:08.964237 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711403e2-affc-49b9-8960-e2eb7310117d admin admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:58:08.969182 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32f30c5-510a-4343-9c32-b244368c03ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:58:08.969783 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32f30c5-510a-4343-9c32-b244368c03ef admin admin] REQUEST_METHOD: `POST` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:58:08.970053 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32f30c5-510a-4343-9c32-b244368c03ef admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:58:08.970324 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32f30c5-510a-4343-9c32-b244368c03ef admin admin] PATH_INFO: `/v3/projects` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:58:08.970939 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32f30c5-510a-4343-9c32-b244368c03ef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:58:08.972891 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32f30c5-510a-4343-9c32-b244368c03ef admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:58:09.001417 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 1270/2552] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 30 00:58:08 2022] POST /identity/v3/projects => generated 385 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 00:58:09.005286 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbf722d-db2e-4818-b0b9-310aa79e1bb3 None None] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:58:09.017512 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbf722d-db2e-4818-b0b9-310aa79e1bb3 None None] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:58:09.036595 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:58:09.086189 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223e934c-9bd9-47d8-99d2-f0b44e4096ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:58:09.086833 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223e934c-9bd9-47d8-99d2-f0b44e4096ea admin admin] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:58:09.087188 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223e934c-9bd9-47d8-99d2-f0b44e4096ea admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:58:09.087523 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223e934c-9bd9-47d8-99d2-f0b44e4096ea admin admin] PATH_INFO: `/v3/users` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:58:09.088157 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223e934c-9bd9-47d8-99d2-f0b44e4096ea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:58:09.090114 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223e934c-9bd9-47d8-99d2-f0b44e4096ea admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:58:09.113671 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 1283/2553] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 30 00:58:09 2022] POST /identity/v3/users => generated 293 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 00:58:09.117949 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32f30c5-510a-4343-9c32-b244368c03ef admin admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:58:09.128450 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32f30c5-510a-4343-9c32-b244368c03ef admin admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:58:09.133757 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e169cf-0b90-42fd-830d-effb1f7ea718 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:58:09.134354 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e169cf-0b90-42fd-830d-effb1f7ea718 admin admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:58:09.134629 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e169cf-0b90-42fd-830d-effb1f7ea718 admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:58:09.134899 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e169cf-0b90-42fd-830d-effb1f7ea718 admin admin] PATH_INFO: `/v3/roles` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:58:09.135559 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e169cf-0b90-42fd-830d-effb1f7ea718 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:58:09.137161 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e169cf-0b90-42fd-830d-effb1f7ea718 admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:58:09.147797 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 1271/2554] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 30 00:58:09 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 00:58:09.151824 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223e934c-9bd9-47d8-99d2-f0b44e4096ea admin admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:58:09.162523 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223e934c-9bd9-47d8-99d2-f0b44e4096ea admin admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:58:09.167249 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b61c17-b588-4c3d-ae89-963b8a46b0c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:58:09.167842 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b61c17-b588-4c3d-ae89-963b8a46b0c4 admin admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:58:09.168142 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b61c17-b588-4c3d-ae89-963b8a46b0c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:58:09.168406 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b61c17-b588-4c3d-ae89-963b8a46b0c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:58:09.169045 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b61c17-b588-4c3d-ae89-963b8a46b0c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:58:09.170638 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b61c17-b588-4c3d-ae89-963b8a46b0c4 admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:58:09.180647 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 1284/2555] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 30 00:58:09 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 00:58:09.184752 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e169cf-0b90-42fd-830d-effb1f7ea718 admin admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:58:09.194988 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e169cf-0b90-42fd-830d-effb1f7ea718 admin admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:58:09.199639 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a101c64-deb3-41ce-a0e3-4a9bb298da99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:58:09.200267 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a101c64-deb3-41ce-a0e3-4a9bb298da99 admin admin] REQUEST_METHOD: `PUT` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:58:09.200540 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a101c64-deb3-41ce-a0e3-4a9bb298da99 admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:58:09.200801 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a101c64-deb3-41ce-a0e3-4a9bb298da99 admin admin] PATH_INFO: `/v3/projects/8c42a620cfe04340907fd22ee1d58b88/users/c09fb084b1404a09baccfa0bc9340fc6/roles/1c93019874174c4b91118d9ce2347e47` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:58:09.215271 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a101c64-deb3-41ce-a0e3-4a9bb298da99 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c42a620cfe04340907fd22ee1d58b88, user_id=c09fb084b1404a09baccfa0bc9340fc6, role_id=1c93019874174c4b91118d9ce2347e47)` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:58:09.217896 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a101c64-deb3-41ce-a0e3-4a9bb298da99 admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:58:09.231763 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 1272/2556] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 30 00:58:09 2022] PUT /identity/v3/projects/8c42a620cfe04340907fd22ee1d58b88/users/c09fb084b1404a09baccfa0bc9340fc6/roles/1c93019874174c4b91118d9ce2347e47 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 00:58:09.242243 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f08285-96f4-4bab-81d4-9a28936845d3 None None] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:58:09.242634 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f08285-96f4-4bab-81d4-9a28936845d3 None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:58:09.242986 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f08285-96f4-4bab-81d4-9a28936845d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:58:09.272794 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.auth.core [None req-e2f08285-96f4-4bab-81d4-9a28936845d3 None None] MFA Rules not processed for user `c09fb084b1404a09baccfa0bc9340fc6`. Rule list: `[]` (Enabled: `True`). {{(pid=87956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:58:09.274019 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-e2f08285-96f4-4bab-81d4-9a28936845d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:58:09.356607 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 1285/2557] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 30 00:58:09 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:58:09.361204 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a101c64-deb3-41ce-a0e3-4a9bb298da99 admin admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:58:09.437975 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a101c64-deb3-41ce-a0e3-4a9bb298da99 admin admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:58:09.443579 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2992243d-1caa-4efc-ae2b-685ee5380ffb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:58:09.444178 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2992243d-1caa-4efc-ae2b-685ee5380ffb admin admin] REQUEST_METHOD: `POST` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:58:09.444448 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2992243d-1caa-4efc-ae2b-685ee5380ffb admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:58:09.444716 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2992243d-1caa-4efc-ae2b-685ee5380ffb admin admin] PATH_INFO: `/v3/projects` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:58:09.445345 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2992243d-1caa-4efc-ae2b-685ee5380ffb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:58:09.447377 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2992243d-1caa-4efc-ae2b-685ee5380ffb admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:58:09.477577 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 1273/2558] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 30 00:58:09 2022] POST /identity/v3/projects => generated 383 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 00:58:09.482060 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f08285-96f4-4bab-81d4-9a28936845d3 None None] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:58:09.493758 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f08285-96f4-4bab-81d4-9a28936845d3 None None] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:58:09.558406 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab27abf6-7a5a-49a1-8fdc-175d5c964012 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:58:09.559006 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab27abf6-7a5a-49a1-8fdc-175d5c964012 admin admin] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:58:09.559314 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab27abf6-7a5a-49a1-8fdc-175d5c964012 admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:58:09.559586 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab27abf6-7a5a-49a1-8fdc-175d5c964012 admin admin] PATH_INFO: `/v3/users` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:58:09.560213 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab27abf6-7a5a-49a1-8fdc-175d5c964012 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:58:09.562143 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab27abf6-7a5a-49a1-8fdc-175d5c964012 admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:58:09.584530 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 1286/2559] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 30 00:58:09 2022] POST /identity/v3/users => generated 298 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 00:58:09.588671 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2992243d-1caa-4efc-ae2b-685ee5380ffb admin admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:58:09.599031 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2992243d-1caa-4efc-ae2b-685ee5380ffb admin admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:58:09.610268 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6aa633d-5994-49c1-88bc-b159d73c445d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:58:09.611241 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6aa633d-5994-49c1-88bc-b159d73c445d admin admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:58:09.611750 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6aa633d-5994-49c1-88bc-b159d73c445d admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:58:09.612248 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6aa633d-5994-49c1-88bc-b159d73c445d admin admin] PATH_INFO: `/v3/roles` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:58:09.613406 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6aa633d-5994-49c1-88bc-b159d73c445d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:58:09.616546 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6aa633d-5994-49c1-88bc-b159d73c445d admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:58:09.628682 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 1274/2560] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 30 00:58:09 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 00:58:09.634207 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab27abf6-7a5a-49a1-8fdc-175d5c964012 admin admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:58:09.651245 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab27abf6-7a5a-49a1-8fdc-175d5c964012 admin admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:58:09.661045 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3029f87f-8624-4390-a05f-ca4e24920825 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:58:09.662012 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3029f87f-8624-4390-a05f-ca4e24920825 admin admin] REQUEST_METHOD: `PUT` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:58:09.662297 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3029f87f-8624-4390-a05f-ca4e24920825 admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:58:09.662548 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3029f87f-8624-4390-a05f-ca4e24920825 admin admin] PATH_INFO: `/v3/projects/f012beaed52649fbb76bd128d586b977/users/34bcb5aa46584e85be95d578f45b72c2/roles/6ccaa8c11f29456fb4e4eeccb21616c7` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:58:09.676709 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:58:09.681200 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3029f87f-8624-4390-a05f-ca4e24920825 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f012beaed52649fbb76bd128d586b977, user_id=34bcb5aa46584e85be95d578f45b72c2, role_id=6ccaa8c11f29456fb4e4eeccb21616c7)` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:58:09.685809 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3029f87f-8624-4390-a05f-ca4e24920825 admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:58:09.704113 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 1287/2561] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 30 00:58:09 2022] PUT /identity/v3/projects/f012beaed52649fbb76bd128d586b977/users/34bcb5aa46584e85be95d578f45b72c2/roles/6ccaa8c11f29456fb4e4eeccb21616c7 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 00:58:09.709669 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6aa633d-5994-49c1-88bc-b159d73c445d admin admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:58:09.720315 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6aa633d-5994-49c1-88bc-b159d73c445d admin admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:58:09.765361 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:58:09.783079 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd9848a-b6ff-46b0-9711-07feffb8c209 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:58:09.783731 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd9848a-b6ff-46b0-9711-07feffb8c209 admin admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:58:09.784004 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd9848a-b6ff-46b0-9711-07feffb8c209 admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:58:09.784273 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd9848a-b6ff-46b0-9711-07feffb8c209 admin admin] PATH_INFO: `/v3/roles` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:58:09.784905 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd9848a-b6ff-46b0-9711-07feffb8c209 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:58:09.786483 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd9848a-b6ff-46b0-9711-07feffb8c209 admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:58:09.796550 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 1275/2562] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 30 00:58:09 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 00:58:09.801032 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3029f87f-8624-4390-a05f-ca4e24920825 admin admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:58:09.812341 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3029f87f-8624-4390-a05f-ca4e24920825 admin admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:58:09.818120 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2a294a-caa4-4d83-b43e-e11a14052a52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:58:09.818768 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2a294a-caa4-4d83-b43e-e11a14052a52 admin admin] REQUEST_METHOD: `PUT` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:58:09.819045 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2a294a-caa4-4d83-b43e-e11a14052a52 admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:58:09.819338 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2a294a-caa4-4d83-b43e-e11a14052a52 admin admin] PATH_INFO: `/v3/projects/f012beaed52649fbb76bd128d586b977/users/34bcb5aa46584e85be95d578f45b72c2/roles/6ccaa8c11f29456fb4e4eeccb21616c7` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:58:09.821298 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2a294a-caa4-4d83-b43e-e11a14052a52 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f012beaed52649fbb76bd128d586b977, user_id=34bcb5aa46584e85be95d578f45b72c2, role_id=6ccaa8c11f29456fb4e4eeccb21616c7)` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:58:09.823966 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2a294a-caa4-4d83-b43e-e11a14052a52 admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:58:09.834449 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 1288/2563] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 30 00:58:09 2022] PUT /identity/v3/projects/f012beaed52649fbb76bd128d586b977/users/34bcb5aa46584e85be95d578f45b72c2/roles/6ccaa8c11f29456fb4e4eeccb21616c7 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 00:58:09.845923 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5e589f-12c0-4722-81d9-8fd1c8523779 None None] REQUEST_METHOD: `POST` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:58:09.846205 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5e589f-12c0-4722-81d9-8fd1c8523779 None None] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:58:09.846477 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5e589f-12c0-4722-81d9-8fd1c8523779 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:58:09.876439 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.auth.core [None req-aa5e589f-12c0-4722-81d9-8fd1c8523779 None None] MFA Rules not processed for user `34bcb5aa46584e85be95d578f45b72c2`. Rule list: `[]` (Enabled: `True`). {{(pid=87955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:58:09.877586 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-aa5e589f-12c0-4722-81d9-8fd1c8523779 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:58:09.947517 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 1276/2564] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 30 00:58:09 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:58:09.959138 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2a294a-caa4-4d83-b43e-e11a14052a52 admin admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:58:09.961268 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-dc2a294a-caa4-4d83-b43e-e11a14052a52 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:58:10.031784 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2a294a-caa4-4d83-b43e-e11a14052a52 admin admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:58:10.035974 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50856c4-5b05-4326-a22e-974b2c22aa38 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48d928ff7fe24348ac900f09c56acc20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d2387fdf794d4eaef07bbcd7b39f2a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:58:10.036587 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50856c4-5b05-4326-a22e-974b2c22aa38 service cinder] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:58:10.036867 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50856c4-5b05-4326-a22e-974b2c22aa38 service cinder] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:58:10.037133 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50856c4-5b05-4326-a22e-974b2c22aa38 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:58:10.097961 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50856c4-5b05-4326-a22e-974b2c22aa38 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:58:10.099440 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50856c4-5b05-4326-a22e-974b2c22aa38 service cinder] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:58:10.109003 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 1289/2565] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 30 00:58:09 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 00:58:11.668310 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5e589f-12c0-4722-81d9-8fd1c8523779 None None] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:58:11.670899 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-aa5e589f-12c0-4722-81d9-8fd1c8523779 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:58:11.687789 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5e589f-12c0-4722-81d9-8fd1c8523779 None None] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:58:11.692008 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f4bf9a-642c-4e66-b7d1-f7d41ec1916c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48d928ff7fe24348ac900f09c56acc20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d2387fdf794d4eaef07bbcd7b39f2a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:58:11.692668 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f4bf9a-642c-4e66-b7d1-f7d41ec1916c service cinder] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:58:11.692950 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f4bf9a-642c-4e66-b7d1-f7d41ec1916c service cinder] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:58:11.693223 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f4bf9a-642c-4e66-b7d1-f7d41ec1916c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:58:11.752784 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f4bf9a-642c-4e66-b7d1-f7d41ec1916c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:58:11.754216 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f4bf9a-642c-4e66-b7d1-f7d41ec1916c service cinder] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:58:11.763361 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 1277/2566] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 30 00:58:11 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 00:58:12.307354 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50856c4-5b05-4326-a22e-974b2c22aa38 service cinder] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:58:12.316784 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50856c4-5b05-4326-a22e-974b2c22aa38 service cinder] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:58:12.321565 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f21f931-fc24-43e3-a39f-273a4dafdd69 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48d928ff7fe24348ac900f09c56acc20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d2387fdf794d4eaef07bbcd7b39f2a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:58:12.322160 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f21f931-fc24-43e3-a39f-273a4dafdd69 service cinder] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:58:12.322430 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f21f931-fc24-43e3-a39f-273a4dafdd69 service cinder] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:58:12.322691 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f21f931-fc24-43e3-a39f-273a4dafdd69 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:58:12.332190 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f21f931-fc24-43e3-a39f-273a4dafdd69 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:58:12.333696 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f21f931-fc24-43e3-a39f-273a4dafdd69 service cinder] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:58:12.343418 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 1290/2567] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 30 00:58:12 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 00:58:16.303801 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f4bf9a-642c-4e66-b7d1-f7d41ec1916c service cinder] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:58:16.368384 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f4bf9a-642c-4e66-b7d1-f7d41ec1916c service cinder] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:58:16.374003 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af3e494-5a04-4f8a-9b88-7ae61b75607f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:58:16.374634 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af3e494-5a04-4f8a-9b88-7ae61b75607f admin admin] REQUEST_METHOD: `DELETE` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:58:16.374929 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af3e494-5a04-4f8a-9b88-7ae61b75607f admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:58:16.375194 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af3e494-5a04-4f8a-9b88-7ae61b75607f admin admin] PATH_INFO: `/v3/users/24c857e087954f2f8c874f82134b1992` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:58:16.376450 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af3e494-5a04-4f8a-9b88-7ae61b75607f admin admin] RBAC: Authorizing `identity:delete_user(user_id=24c857e087954f2f8c874f82134b1992)` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:58:16.378395 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af3e494-5a04-4f8a-9b88-7ae61b75607f admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:58:16.383444 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=100 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:58:16.428472 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-7af3e494-5a04-4f8a-9b88-7ae61b75607f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '24c857e087954f2f8c874f82134b1992'} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:58:16.429106 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-7af3e494-5a04-4f8a-9b88-7ae61b75607f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '24c857e087954f2f8c874f82134b1992'} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:58:16.435944 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-7af3e494-5a04-4f8a-9b88-7ae61b75607f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '24c857e087954f2f8c874f82134b1992'} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:58:16.436548 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-7af3e494-5a04-4f8a-9b88-7ae61b75607f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '24c857e087954f2f8c874f82134b1992'} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:58:16.448378 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-7af3e494-5a04-4f8a-9b88-7ae61b75607f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '24c857e087954f2f8c874f82134b1992'} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:58:16.463633 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 1278/2568] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 30 00:58:16 2022] DELETE /identity/v3/users/24c857e087954f2f8c874f82134b1992 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 00:58:16.468245 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ee1295-bdf4-4936-9985-16ac3b78164c None None] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:58:16.468711 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ee1295-bdf4-4936-9985-16ac3b78164c None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:58:16.468842 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ee1295-bdf4-4936-9985-16ac3b78164c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:58:16.487747 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.auth.core [None req-e2ee1295-bdf4-4936-9985-16ac3b78164c None None] MFA Rules not processed for user `eb55b6cbca4945abb21b0e49eb745e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=87956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:58:16.488935 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-e2ee1295-bdf4-4936-9985-16ac3b78164c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:58:16.552446 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 1291/2569] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 30 00:58:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:58:16.562765 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af3e494-5a04-4f8a-9b88-7ae61b75607f admin admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:58:16.564209 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-7af3e494-5a04-4f8a-9b88-7ae61b75607f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:58:16.622966 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af3e494-5a04-4f8a-9b88-7ae61b75607f admin admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:58:16.627336 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109d3db7-a7df-4c2f-8647-3fe68b097a24 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5693f186c6ad4d9394f02ee3477cdcd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d2387fdf794d4eaef07bbcd7b39f2a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:58:16.628035 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109d3db7-a7df-4c2f-8647-3fe68b097a24 service neutron] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:58:16.628274 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109d3db7-a7df-4c2f-8647-3fe68b097a24 service neutron] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:58:16.628554 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109d3db7-a7df-4c2f-8647-3fe68b097a24 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:58:16.639127 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109d3db7-a7df-4c2f-8647-3fe68b097a24 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:58:16.640600 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109d3db7-a7df-4c2f-8647-3fe68b097a24 service neutron] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:58:16.650572 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 1279/2570] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 30 00:58:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 00:58:16.920986 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ee1295-bdf4-4936-9985-16ac3b78164c None None] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:58:16.922473 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-e2ee1295-bdf4-4936-9985-16ac3b78164c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:58:16.935242 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ee1295-bdf4-4936-9985-16ac3b78164c None None] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:58:16.940688 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c574aede-d84b-458f-8a93-bcecdd64039e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:58:16.941406 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c574aede-d84b-458f-8a93-bcecdd64039e admin admin] REQUEST_METHOD: `DELETE` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:58:16.941743 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c574aede-d84b-458f-8a93-bcecdd64039e admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:58:16.942073 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c574aede-d84b-458f-8a93-bcecdd64039e admin admin] PATH_INFO: `/v3/projects/8925aec079954cbdb52901b88d55037a` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:58:16.943319 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c574aede-d84b-458f-8a93-bcecdd64039e admin admin] RBAC: Authorizing `identity:delete_project(project_id=8925aec079954cbdb52901b88d55037a)` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:58:16.945218 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c574aede-d84b-458f-8a93-bcecdd64039e admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:58:16.961606 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:58:16.996602 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-c574aede-d84b-458f-8a93-bcecdd64039e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8925aec079954cbdb52901b88d55037a', 'request_id': 'req-c574aede-d84b-458f-8a93-bcecdd64039e'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:58:17.006051 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-c574aede-d84b-458f-8a93-bcecdd64039e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8925aec079954cbdb52901b88d55037a', 'request_id': 'req-c574aede-d84b-458f-8a93-bcecdd64039e'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:58:17.012927 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-c574aede-d84b-458f-8a93-bcecdd64039e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8925aec079954cbdb52901b88d55037a', 'request_id': 'req-c574aede-d84b-458f-8a93-bcecdd64039e'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:58:17.023826 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-c574aede-d84b-458f-8a93-bcecdd64039e admin admin] The token cache is being invalidate because project 8925aec079954cbdb52901b88d55037a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87956) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 00:58:17.024114 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-c574aede-d84b-458f-8a93-bcecdd64039e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:58:17.024743 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-c574aede-d84b-458f-8a93-bcecdd64039e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:58:17.026240 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 1292/2571] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 30 00:58:16 2022] DELETE /identity/v3/projects/8925aec079954cbdb52901b88d55037a => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 00:58:17.030469 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109d3db7-a7df-4c2f-8647-3fe68b097a24 service neutron] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:58:17.040746 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109d3db7-a7df-4c2f-8647-3fe68b097a24 service neutron] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:58:17.101715 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b742841-1a8a-4f02-8167-4dcb0486a7bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:58:17.102351 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b742841-1a8a-4f02-8167-4dcb0486a7bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:58:17.102630 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b742841-1a8a-4f02-8167-4dcb0486a7bd admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:58:17.102904 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b742841-1a8a-4f02-8167-4dcb0486a7bd admin admin] PATH_INFO: `/v3/users/c09fb084b1404a09baccfa0bc9340fc6` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:58:17.104090 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b742841-1a8a-4f02-8167-4dcb0486a7bd admin admin] RBAC: Authorizing `identity:delete_user(user_id=c09fb084b1404a09baccfa0bc9340fc6)` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:58:17.106001 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b742841-1a8a-4f02-8167-4dcb0486a7bd admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:58:17.136897 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:58:17.156235 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-0b742841-1a8a-4f02-8167-4dcb0486a7bd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c09fb084b1404a09baccfa0bc9340fc6'} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:58:17.156966 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-0b742841-1a8a-4f02-8167-4dcb0486a7bd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c09fb084b1404a09baccfa0bc9340fc6'} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:58:17.164297 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-0b742841-1a8a-4f02-8167-4dcb0486a7bd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c09fb084b1404a09baccfa0bc9340fc6'} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:58:17.164841 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-0b742841-1a8a-4f02-8167-4dcb0486a7bd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c09fb084b1404a09baccfa0bc9340fc6'} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:58:17.177518 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-0b742841-1a8a-4f02-8167-4dcb0486a7bd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c09fb084b1404a09baccfa0bc9340fc6'} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:58:17.191380 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 1280/2572] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 30 00:58:17 2022] DELETE /identity/v3/users/c09fb084b1404a09baccfa0bc9340fc6 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 00:58:17.821722 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c574aede-d84b-458f-8a93-bcecdd64039e admin admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:58:17.823170 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-c574aede-d84b-458f-8a93-bcecdd64039e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:58:17.837585 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c574aede-d84b-458f-8a93-bcecdd64039e admin admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:58:17.900855 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5683a7e4-0a50-44cf-b8f4-48d680c5d963 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:58:17.901495 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5683a7e4-0a50-44cf-b8f4-48d680c5d963 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:58:17.901783 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5683a7e4-0a50-44cf-b8f4-48d680c5d963 admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:58:17.902056 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5683a7e4-0a50-44cf-b8f4-48d680c5d963 admin admin] PATH_INFO: `/v3/projects/8c42a620cfe04340907fd22ee1d58b88` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:58:17.903178 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5683a7e4-0a50-44cf-b8f4-48d680c5d963 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8c42a620cfe04340907fd22ee1d58b88)` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:58:17.905125 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5683a7e4-0a50-44cf-b8f4-48d680c5d963 admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:58:17.954018 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-5683a7e4-0a50-44cf-b8f4-48d680c5d963 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8c42a620cfe04340907fd22ee1d58b88', 'request_id': 'req-5683a7e4-0a50-44cf-b8f4-48d680c5d963'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:58:17.962622 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-5683a7e4-0a50-44cf-b8f4-48d680c5d963 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8c42a620cfe04340907fd22ee1d58b88', 'request_id': 'req-5683a7e4-0a50-44cf-b8f4-48d680c5d963'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:58:17.970148 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-5683a7e4-0a50-44cf-b8f4-48d680c5d963 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8c42a620cfe04340907fd22ee1d58b88', 'request_id': 'req-5683a7e4-0a50-44cf-b8f4-48d680c5d963'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:58:17.982155 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-5683a7e4-0a50-44cf-b8f4-48d680c5d963 admin admin] The token cache is being invalidate because project 8c42a620cfe04340907fd22ee1d58b88 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87956) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 00:58:17.982419 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-5683a7e4-0a50-44cf-b8f4-48d680c5d963 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:58:17.983341 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-5683a7e4-0a50-44cf-b8f4-48d680c5d963 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:58:17.985160 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 1293/2573] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 30 00:58:17 2022] DELETE /identity/v3/projects/8c42a620cfe04340907fd22ee1d58b88 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 00:58:17.989419 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b742841-1a8a-4f02-8167-4dcb0486a7bd admin admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:58:17.991020 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-0b742841-1a8a-4f02-8167-4dcb0486a7bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:58:18.008969 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b742841-1a8a-4f02-8167-4dcb0486a7bd admin admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:58:18.105700 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b90d417-ac3a-49be-befb-6a20d1e641f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:58:18.106433 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b90d417-ac3a-49be-befb-6a20d1e641f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:58:18.106906 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b90d417-ac3a-49be-befb-6a20d1e641f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:58:18.107284 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b90d417-ac3a-49be-befb-6a20d1e641f3 admin admin] PATH_INFO: `/v3/users/34bcb5aa46584e85be95d578f45b72c2` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:58:18.108861 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b90d417-ac3a-49be-befb-6a20d1e641f3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=34bcb5aa46584e85be95d578f45b72c2)` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:58:18.110506 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b90d417-ac3a-49be-befb-6a20d1e641f3 admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:58:18.177887 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-9b90d417-ac3a-49be-befb-6a20d1e641f3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '34bcb5aa46584e85be95d578f45b72c2'} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:58:18.179089 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-9b90d417-ac3a-49be-befb-6a20d1e641f3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '34bcb5aa46584e85be95d578f45b72c2'} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:58:18.191696 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-9b90d417-ac3a-49be-befb-6a20d1e641f3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '34bcb5aa46584e85be95d578f45b72c2'} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:58:18.192419 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-9b90d417-ac3a-49be-befb-6a20d1e641f3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '34bcb5aa46584e85be95d578f45b72c2'} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:58:18.238152 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-9b90d417-ac3a-49be-befb-6a20d1e641f3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '34bcb5aa46584e85be95d578f45b72c2'} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:58:18.259150 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 1281/2574] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 30 00:58:17 2022] DELETE /identity/v3/users/34bcb5aa46584e85be95d578f45b72c2 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 00:58:18.819188 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5683a7e4-0a50-44cf-b8f4-48d680c5d963 admin admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:58:18.820765 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-5683a7e4-0a50-44cf-b8f4-48d680c5d963 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:58:18.855002 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5683a7e4-0a50-44cf-b8f4-48d680c5d963 admin admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:58:18.889373 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:58:18.919887 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f2993c-b456-41b9-80f6-e2f14e52b5a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:58:18.920527 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f2993c-b456-41b9-80f6-e2f14e52b5a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:58:18.920802 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f2993c-b456-41b9-80f6-e2f14e52b5a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:58:18.921070 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f2993c-b456-41b9-80f6-e2f14e52b5a8 admin admin] PATH_INFO: `/v3/projects/f012beaed52649fbb76bd128d586b977` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:58:18.922171 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f2993c-b456-41b9-80f6-e2f14e52b5a8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f012beaed52649fbb76bd128d586b977)` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:58:18.924138 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f2993c-b456-41b9-80f6-e2f14e52b5a8 admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:58:18.981422 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-17f2993c-b456-41b9-80f6-e2f14e52b5a8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f012beaed52649fbb76bd128d586b977', 'request_id': 'req-17f2993c-b456-41b9-80f6-e2f14e52b5a8'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:58:18.990077 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-17f2993c-b456-41b9-80f6-e2f14e52b5a8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f012beaed52649fbb76bd128d586b977', 'request_id': 'req-17f2993c-b456-41b9-80f6-e2f14e52b5a8'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:58:18.996996 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-17f2993c-b456-41b9-80f6-e2f14e52b5a8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f012beaed52649fbb76bd128d586b977', 'request_id': 'req-17f2993c-b456-41b9-80f6-e2f14e52b5a8'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:58:19.007891 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-17f2993c-b456-41b9-80f6-e2f14e52b5a8 admin admin] The token cache is being invalidate because project f012beaed52649fbb76bd128d586b977 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87956) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 00:58:19.008178 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-17f2993c-b456-41b9-80f6-e2f14e52b5a8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:58:19.009002 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-17f2993c-b456-41b9-80f6-e2f14e52b5a8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:58:19.010503 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 1294/2575] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 30 00:58:18 2022] DELETE /identity/v3/projects/f012beaed52649fbb76bd128d586b977 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 00:58:19.166036 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b90d417-ac3a-49be-befb-6a20d1e641f3 admin admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:58:19.167624 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-9b90d417-ac3a-49be-befb-6a20d1e641f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:58:19.201871 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:58:19.239897 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b90d417-ac3a-49be-befb-6a20d1e641f3 admin admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:58:19.307480 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6130ba2f-b4f7-4acf-a8e6-8773dc58d781 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48d928ff7fe24348ac900f09c56acc20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d2387fdf794d4eaef07bbcd7b39f2a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:58:19.308185 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6130ba2f-b4f7-4acf-a8e6-8773dc58d781 service cinder] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:58:19.308523 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6130ba2f-b4f7-4acf-a8e6-8773dc58d781 service cinder] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:58:19.308859 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6130ba2f-b4f7-4acf-a8e6-8773dc58d781 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:58:19.310650 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-6130ba2f-b4f7-4acf-a8e6-8773dc58d781 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:58:19.392499 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6130ba2f-b4f7-4acf-a8e6-8773dc58d781 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:58:19.394052 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6130ba2f-b4f7-4acf-a8e6-8773dc58d781 service cinder] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:58:19.406685 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 1282/2576] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 30 00:58:19 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 00:58:20.719230 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f2993c-b456-41b9-80f6-e2f14e52b5a8 admin admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:58:20.720874 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-17f2993c-b456-41b9-80f6-e2f14e52b5a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:58:20.734192 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f2993c-b456-41b9-80f6-e2f14e52b5a8 admin admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:58:20.737904 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1694ff71-8091-446d-a8e1-12a184b8367e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48d928ff7fe24348ac900f09c56acc20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d2387fdf794d4eaef07bbcd7b39f2a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:58:20.738525 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1694ff71-8091-446d-a8e1-12a184b8367e service cinder] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:58:20.738793 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1694ff71-8091-446d-a8e1-12a184b8367e service cinder] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:58:20.739110 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1694ff71-8091-446d-a8e1-12a184b8367e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:58:20.740915 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-1694ff71-8091-446d-a8e1-12a184b8367e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:58:20.754127 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1694ff71-8091-446d-a8e1-12a184b8367e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:58:20.755582 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1694ff71-8091-446d-a8e1-12a184b8367e service cinder] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:58:20.766311 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 1295/2577] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 30 00:58:20 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 00:58:25.732858 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25accbc2-d3b9-472f-962f-dd1bf4302ca4 None None] REQUEST_METHOD: `POST` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:58:25.733352 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25accbc2-d3b9-472f-962f-dd1bf4302ca4 None None] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:58:25.733453 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25accbc2-d3b9-472f-962f-dd1bf4302ca4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:58:25.760228 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.auth.core [None req-25accbc2-d3b9-472f-962f-dd1bf4302ca4 None None] MFA Rules not processed for user `3e7b21b55fb84a6cad507a8954492d48`. Rule list: `[]` (Enabled: `True`). {{(pid=87955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:58:25.762057 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-25accbc2-d3b9-472f-962f-dd1bf4302ca4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:58:25.823407 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 1283/2578] 10.222.0.42 () {58 vars in 967 bytes} [Sun Oct 30 00:58:25 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:58:25.863466 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1694ff71-8091-446d-a8e1-12a184b8367e service cinder] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:58:25.865025 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-1694ff71-8091-446d-a8e1-12a184b8367e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:58:25.938534 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1694ff71-8091-446d-a8e1-12a184b8367e service cinder] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:58:25.944070 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6fed92-9b93-4153-893b-7163d35bedf8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6d6e884a8104a428e4de6be1cfa467c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d2387fdf794d4eaef07bbcd7b39f2a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:58:25.944674 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6fed92-9b93-4153-893b-7163d35bedf8 service swift] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:58:25.944944 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6fed92-9b93-4153-893b-7163d35bedf8 service swift] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:58:25.945213 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6fed92-9b93-4153-893b-7163d35bedf8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:58:25.953730 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6fed92-9b93-4153-893b-7163d35bedf8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:58:25.955386 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6fed92-9b93-4153-893b-7163d35bedf8 service swift] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:58:25.963861 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 1296/2579] 10.222.0.42 () {60 vars in 1384 bytes} [Sun Oct 30 00:58:25 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 30 00:58:32.716694 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25accbc2-d3b9-472f-962f-dd1bf4302ca4 None None] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:58:32.720420 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-25accbc2-d3b9-472f-962f-dd1bf4302ca4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:58:32.757484 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=100 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:58:32.802108 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25accbc2-d3b9-472f-962f-dd1bf4302ca4 None None] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:58:32.807070 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83382a95-2efb-4769-8598-b9b5db647228 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:58:32.807764 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83382a95-2efb-4769-8598-b9b5db647228 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:58:32.808038 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83382a95-2efb-4769-8598-b9b5db647228 admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:58:32.808305 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83382a95-2efb-4769-8598-b9b5db647228 admin admin] PATH_INFO: `/v3/users/35adfeb50b9d4944b51e540977978756` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:58:32.809455 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83382a95-2efb-4769-8598-b9b5db647228 admin admin] RBAC: Authorizing `identity:delete_user(user_id=35adfeb50b9d4944b51e540977978756)` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:58:32.811779 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83382a95-2efb-4769-8598-b9b5db647228 admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:58:32.858516 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-83382a95-2efb-4769-8598-b9b5db647228 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '35adfeb50b9d4944b51e540977978756'} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:58:32.859265 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-83382a95-2efb-4769-8598-b9b5db647228 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '35adfeb50b9d4944b51e540977978756'} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:58:32.866381 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-83382a95-2efb-4769-8598-b9b5db647228 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '35adfeb50b9d4944b51e540977978756'} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:58:32.867029 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-83382a95-2efb-4769-8598-b9b5db647228 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '35adfeb50b9d4944b51e540977978756'} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:58:32.879442 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-83382a95-2efb-4769-8598-b9b5db647228 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '35adfeb50b9d4944b51e540977978756'} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:58:32.893725 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 1284/2580] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 30 00:58:32 2022] DELETE /identity/v3/users/35adfeb50b9d4944b51e540977978756 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 00:58:33.075403 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6fed92-9b93-4153-893b-7163d35bedf8 service swift] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:58:33.094247 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6fed92-9b93-4153-893b-7163d35bedf8 service swift] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:58:33.135788 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:58:33.156447 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6faeb9-43bf-4145-8c85-e3c2ade88881 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:58:33.157107 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6faeb9-43bf-4145-8c85-e3c2ade88881 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:58:33.157445 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6faeb9-43bf-4145-8c85-e3c2ade88881 admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:58:33.157680 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6faeb9-43bf-4145-8c85-e3c2ade88881 admin admin] PATH_INFO: `/v3/projects/f9730985e6b444a8b344093607a9cd95` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:58:33.158814 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6faeb9-43bf-4145-8c85-e3c2ade88881 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f9730985e6b444a8b344093607a9cd95)` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:58:33.161038 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6faeb9-43bf-4145-8c85-e3c2ade88881 admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:58:33.208951 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-2f6faeb9-43bf-4145-8c85-e3c2ade88881 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f9730985e6b444a8b344093607a9cd95', 'request_id': 'req-2f6faeb9-43bf-4145-8c85-e3c2ade88881'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:58:33.218822 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-2f6faeb9-43bf-4145-8c85-e3c2ade88881 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f9730985e6b444a8b344093607a9cd95', 'request_id': 'req-2f6faeb9-43bf-4145-8c85-e3c2ade88881'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:58:33.226486 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-2f6faeb9-43bf-4145-8c85-e3c2ade88881 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f9730985e6b444a8b344093607a9cd95', 'request_id': 'req-2f6faeb9-43bf-4145-8c85-e3c2ade88881'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:58:33.237542 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-2f6faeb9-43bf-4145-8c85-e3c2ade88881 admin admin] The token cache is being invalidate because project f9730985e6b444a8b344093607a9cd95 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87956) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 00:58:33.237826 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-2f6faeb9-43bf-4145-8c85-e3c2ade88881 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:58:33.238525 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-2f6faeb9-43bf-4145-8c85-e3c2ade88881 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:58:33.240063 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 1297/2581] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 30 00:58:33 2022] DELETE /identity/v3/projects/f9730985e6b444a8b344093607a9cd95 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 00:58:33.244313 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83382a95-2efb-4769-8598-b9b5db647228 admin admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:58:33.245786 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-83382a95-2efb-4769-8598-b9b5db647228 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:58:33.259845 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83382a95-2efb-4769-8598-b9b5db647228 admin admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:58:33.319097 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ad30b7-4ef6-4ede-b2b9-572e130910c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:58:33.319846 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ad30b7-4ef6-4ede-b2b9-572e130910c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:58:33.320118 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ad30b7-4ef6-4ede-b2b9-572e130910c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:58:33.320386 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ad30b7-4ef6-4ede-b2b9-572e130910c2 admin admin] PATH_INFO: `/v3/users/7055c493b3904dbbb27ba0ca15db8a6a` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:58:33.321531 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ad30b7-4ef6-4ede-b2b9-572e130910c2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7055c493b3904dbbb27ba0ca15db8a6a)` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:58:33.323478 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ad30b7-4ef6-4ede-b2b9-572e130910c2 admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:58:33.372968 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-f0ad30b7-4ef6-4ede-b2b9-572e130910c2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7055c493b3904dbbb27ba0ca15db8a6a'} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:58:33.373648 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-f0ad30b7-4ef6-4ede-b2b9-572e130910c2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7055c493b3904dbbb27ba0ca15db8a6a'} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:58:33.374813 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:58:33.381903 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-f0ad30b7-4ef6-4ede-b2b9-572e130910c2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7055c493b3904dbbb27ba0ca15db8a6a'} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:58:33.382653 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-f0ad30b7-4ef6-4ede-b2b9-572e130910c2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7055c493b3904dbbb27ba0ca15db8a6a'} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:58:33.395008 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-f0ad30b7-4ef6-4ede-b2b9-572e130910c2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7055c493b3904dbbb27ba0ca15db8a6a'} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:58:33.408428 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 1285/2582] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 30 00:58:33 2022] DELETE /identity/v3/users/7055c493b3904dbbb27ba0ca15db8a6a => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 00:58:33.587892 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6faeb9-43bf-4145-8c85-e3c2ade88881 admin admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:58:33.589497 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-2f6faeb9-43bf-4145-8c85-e3c2ade88881 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:58:33.607526 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6faeb9-43bf-4145-8c85-e3c2ade88881 admin admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:58:33.666275 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abf6d0b-b9f0-4f17-b562-f0cc87e6d0ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:58:33.666905 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abf6d0b-b9f0-4f17-b562-f0cc87e6d0ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:58:33.667175 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abf6d0b-b9f0-4f17-b562-f0cc87e6d0ec admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:58:33.667470 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abf6d0b-b9f0-4f17-b562-f0cc87e6d0ec admin admin] PATH_INFO: `/v3/projects/d17f7f7526f74401a2782adc57dab96e` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:58:33.668612 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abf6d0b-b9f0-4f17-b562-f0cc87e6d0ec admin admin] RBAC: Authorizing `identity:delete_project(project_id=d17f7f7526f74401a2782adc57dab96e)` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:58:33.670494 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abf6d0b-b9f0-4f17-b562-f0cc87e6d0ec admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:58:33.723424 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-8abf6d0b-b9f0-4f17-b562-f0cc87e6d0ec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd17f7f7526f74401a2782adc57dab96e', 'request_id': 'req-8abf6d0b-b9f0-4f17-b562-f0cc87e6d0ec'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:58:33.733111 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-8abf6d0b-b9f0-4f17-b562-f0cc87e6d0ec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd17f7f7526f74401a2782adc57dab96e', 'request_id': 'req-8abf6d0b-b9f0-4f17-b562-f0cc87e6d0ec'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:58:33.739615 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-8abf6d0b-b9f0-4f17-b562-f0cc87e6d0ec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd17f7f7526f74401a2782adc57dab96e', 'request_id': 'req-8abf6d0b-b9f0-4f17-b562-f0cc87e6d0ec'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:58:33.747012 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:58:33.751354 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-8abf6d0b-b9f0-4f17-b562-f0cc87e6d0ec admin admin] The token cache is being invalidate because project d17f7f7526f74401a2782adc57dab96e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87956) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 00:58:33.751845 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-8abf6d0b-b9f0-4f17-b562-f0cc87e6d0ec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:58:33.752845 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-8abf6d0b-b9f0-4f17-b562-f0cc87e6d0ec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 00:58:33.754608 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 1298/2583] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 30 00:58:33 2022] DELETE /identity/v3/projects/d17f7f7526f74401a2782adc57dab96e => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 00:58:33.759841 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e697f4c3-7456-4e46-b28b-e2779b594f3f None None] REQUEST_METHOD: `POST` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:58:33.760323 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e697f4c3-7456-4e46-b28b-e2779b594f3f None None] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:58:33.760420 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e697f4c3-7456-4e46-b28b-e2779b594f3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:58:33.780816 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.auth.core [None req-e697f4c3-7456-4e46-b28b-e2779b594f3f None None] MFA Rules not processed for user `eb55b6cbca4945abb21b0e49eb745e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=87955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:58:33.782036 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-e697f4c3-7456-4e46-b28b-e2779b594f3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:58:33.855341 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 1286/2584] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 30 00:58:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:58:33.864329 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebbe16f-a5ff-424b-86f9-ba494eb4b430 None None] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:58:33.864689 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebbe16f-a5ff-424b-86f9-ba494eb4b430 None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:58:33.865068 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebbe16f-a5ff-424b-86f9-ba494eb4b430 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:58:33.891549 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.auth.core [None req-5ebbe16f-a5ff-424b-86f9-ba494eb4b430 None None] MFA Rules not processed for user `eb55b6cbca4945abb21b0e49eb745e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=87956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:58:33.892769 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-5ebbe16f-a5ff-424b-86f9-ba494eb4b430 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:58:33.902122 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 1299/2585] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 30 00:58:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:58:33.906274 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e697f4c3-7456-4e46-b28b-e2779b594f3f None None] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:58:33.916658 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e697f4c3-7456-4e46-b28b-e2779b594f3f None None] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:58:33.922249 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9a387c-2120-467a-8d90-ebd06652b43f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:58:33.922858 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9a387c-2120-467a-8d90-ebd06652b43f admin admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:58:33.923133 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9a387c-2120-467a-8d90-ebd06652b43f admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:58:33.923426 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9a387c-2120-467a-8d90-ebd06652b43f admin admin] PATH_INFO: `/v3/domains` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:58:33.924072 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9a387c-2120-467a-8d90-ebd06652b43f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:58:33.924368 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9a387c-2120-467a-8d90-ebd06652b43f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:58:33.925979 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9a387c-2120-467a-8d90-ebd06652b43f admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:58:33.938200 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 1287/2586] 10.222.0.42 () {58 vars in 1153 bytes} [Sun Oct 30 00:58:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:58:33.942838 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebbe16f-a5ff-424b-86f9-ba494eb4b430 None None] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:58:33.952346 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebbe16f-a5ff-424b-86f9-ba494eb4b430 None None] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:58:33.957793 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d7e7cb-bdf8-434f-9ee2-4f3b2ec87fee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:58:33.958399 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d7e7cb-bdf8-434f-9ee2-4f3b2ec87fee admin admin] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:58:33.958669 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d7e7cb-bdf8-434f-9ee2-4f3b2ec87fee admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:58:33.958940 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d7e7cb-bdf8-434f-9ee2-4f3b2ec87fee admin admin] PATH_INFO: `/v3/projects` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:58:33.959608 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d7e7cb-bdf8-434f-9ee2-4f3b2ec87fee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:58:33.961501 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d7e7cb-bdf8-434f-9ee2-4f3b2ec87fee admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:58:34.002822 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 1300/2587] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 30 00:58:33 2022] POST /identity/v3/projects => generated 373 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 00:58:34.007724 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9a387c-2120-467a-8d90-ebd06652b43f admin admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:58:34.018099 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9a387c-2120-467a-8d90-ebd06652b43f admin admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:58:34.081757 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1ee71e-080a-4e50-8115-3e4f17f53490 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:58:34.082369 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1ee71e-080a-4e50-8115-3e4f17f53490 admin admin] REQUEST_METHOD: `POST` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:58:34.082650 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1ee71e-080a-4e50-8115-3e4f17f53490 admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:58:34.082930 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1ee71e-080a-4e50-8115-3e4f17f53490 admin admin] PATH_INFO: `/v3/users` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:58:34.083590 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1ee71e-080a-4e50-8115-3e4f17f53490 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:58:34.085519 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1ee71e-080a-4e50-8115-3e4f17f53490 admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:58:34.106843 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 1288/2588] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 30 00:58:34 2022] POST /identity/v3/users => generated 287 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 00:58:34.110903 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d7e7cb-bdf8-434f-9ee2-4f3b2ec87fee admin admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:58:34.121226 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d7e7cb-bdf8-434f-9ee2-4f3b2ec87fee admin admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:58:34.126208 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9eb666-1cca-4492-a658-d8126ce73de7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:58:34.126808 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9eb666-1cca-4492-a658-d8126ce73de7 admin admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:58:34.127086 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9eb666-1cca-4492-a658-d8126ce73de7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:58:34.127388 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9eb666-1cca-4492-a658-d8126ce73de7 admin admin] PATH_INFO: `/v3/roles` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:58:34.128059 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9eb666-1cca-4492-a658-d8126ce73de7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:58:34.129696 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9eb666-1cca-4492-a658-d8126ce73de7 admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:58:34.139785 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 1301/2589] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 30 00:58:34 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 00:58:34.143716 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1ee71e-080a-4e50-8115-3e4f17f53490 admin admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:58:34.153935 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1ee71e-080a-4e50-8115-3e4f17f53490 admin admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:58:34.159551 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99b80d8-6e61-4ef1-8b58-3a2c82d4ab49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:58:34.160176 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99b80d8-6e61-4ef1-8b58-3a2c82d4ab49 admin admin] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:58:34.160588 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99b80d8-6e61-4ef1-8b58-3a2c82d4ab49 admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:58:34.160853 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99b80d8-6e61-4ef1-8b58-3a2c82d4ab49 admin admin] PATH_INFO: `/v3/roles` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:58:34.161513 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99b80d8-6e61-4ef1-8b58-3a2c82d4ab49 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:58:34.163106 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99b80d8-6e61-4ef1-8b58-3a2c82d4ab49 admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:58:34.174630 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 1289/2590] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 30 00:58:34 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 00:58:34.180126 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9eb666-1cca-4492-a658-d8126ce73de7 admin admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:58:34.190806 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9eb666-1cca-4492-a658-d8126ce73de7 admin admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:58:34.196518 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b0f696-e3a1-41dc-a7aa-11f636369012 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:58:34.197168 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b0f696-e3a1-41dc-a7aa-11f636369012 admin admin] REQUEST_METHOD: `PUT` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:58:34.197442 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b0f696-e3a1-41dc-a7aa-11f636369012 admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:58:34.197708 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b0f696-e3a1-41dc-a7aa-11f636369012 admin admin] PATH_INFO: `/v3/projects/57dc1ca2f68e4fb4b469426f4645ea69/users/3a645c34c01f480ab20308cd8fb1fc01/roles/1c93019874174c4b91118d9ce2347e47` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:58:34.214231 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b0f696-e3a1-41dc-a7aa-11f636369012 admin admin] RBAC: Authorizing `identity:create_grant(project_id=57dc1ca2f68e4fb4b469426f4645ea69, user_id=3a645c34c01f480ab20308cd8fb1fc01, role_id=1c93019874174c4b91118d9ce2347e47)` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:58:34.216972 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b0f696-e3a1-41dc-a7aa-11f636369012 admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:58:34.232628 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 1302/2591] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 30 00:58:34 2022] PUT /identity/v3/projects/57dc1ca2f68e4fb4b469426f4645ea69/users/3a645c34c01f480ab20308cd8fb1fc01/roles/1c93019874174c4b91118d9ce2347e47 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 00:58:34.237779 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01054860-1c48-4e9c-8277-3abb026268f6 None None] REQUEST_METHOD: `POST` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:58:34.238069 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01054860-1c48-4e9c-8277-3abb026268f6 None None] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:58:34.238343 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01054860-1c48-4e9c-8277-3abb026268f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:58:34.257818 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.auth.core [None req-01054860-1c48-4e9c-8277-3abb026268f6 None None] MFA Rules not processed for user `eb55b6cbca4945abb21b0e49eb745e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=87955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:58:34.259060 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-01054860-1c48-4e9c-8277-3abb026268f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:58:34.284305 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:58:34.333835 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 1290/2592] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 30 00:58:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:58:34.344083 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b0f696-e3a1-41dc-a7aa-11f636369012 admin admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:58:34.346055 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-d6b0f696-e3a1-41dc-a7aa-11f636369012 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:58:34.405819 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b0f696-e3a1-41dc-a7aa-11f636369012 admin admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:58:34.410517 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112c5386-b35e-4cd2-84ed-65ddf472fe29 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5693f186c6ad4d9394f02ee3477cdcd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d2387fdf794d4eaef07bbcd7b39f2a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:58:34.411140 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112c5386-b35e-4cd2-84ed-65ddf472fe29 service neutron] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:58:34.411477 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112c5386-b35e-4cd2-84ed-65ddf472fe29 service neutron] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:58:34.411748 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112c5386-b35e-4cd2-84ed-65ddf472fe29 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:58:34.422023 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112c5386-b35e-4cd2-84ed-65ddf472fe29 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:58:34.423521 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112c5386-b35e-4cd2-84ed-65ddf472fe29 service neutron] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:58:34.433462 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 1303/2593] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 30 00:58:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 00:58:38.525565 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7e4496-4153-4c52-8e80-2c0a9997df3c None None] REQUEST_METHOD: `POST` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:58:38.526151 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7e4496-4153-4c52-8e80-2c0a9997df3c None None] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:58:38.526151 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7e4496-4153-4c52-8e80-2c0a9997df3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:58:38.561528 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.auth.core [None req-4a7e4496-4153-4c52-8e80-2c0a9997df3c None None] MFA Rules not processed for user `3a645c34c01f480ab20308cd8fb1fc01`. Rule list: `[]` (Enabled: `True`). {{(pid=87955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:58:38.563055 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-4a7e4496-4153-4c52-8e80-2c0a9997df3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:58:38.630183 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 1291/2594] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 30 00:58:38 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:58:38.634839 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112c5386-b35e-4cd2-84ed-65ddf472fe29 service neutron] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:58:38.648330 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112c5386-b35e-4cd2-84ed-65ddf472fe29 service neutron] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:58:38.653139 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe615ab0-3c7e-448b-8a0b-5a6afe23e579 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:58:38.653750 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe615ab0-3c7e-448b-8a0b-5a6afe23e579 admin admin] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:58:38.654026 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe615ab0-3c7e-448b-8a0b-5a6afe23e579 admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:58:38.654293 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe615ab0-3c7e-448b-8a0b-5a6afe23e579 admin admin] PATH_INFO: `/v3/projects` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:58:38.654923 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe615ab0-3c7e-448b-8a0b-5a6afe23e579 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:58:38.656859 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe615ab0-3c7e-448b-8a0b-5a6afe23e579 admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:58:38.685163 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 1304/2595] 10.222.0.42 () {60 vars in 1153 bytes} [Sun Oct 30 00:58:38 2022] POST /identity/v3/projects => generated 371 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 00:58:38.689870 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7e4496-4153-4c52-8e80-2c0a9997df3c None None] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:58:38.700605 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7e4496-4153-4c52-8e80-2c0a9997df3c None None] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:58:38.757808 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0186d540-ec47-4c01-a3f9-98f7dc239a49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:58:38.758333 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0186d540-ec47-4c01-a3f9-98f7dc239a49 admin admin] REQUEST_METHOD: `POST` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:58:38.758603 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0186d540-ec47-4c01-a3f9-98f7dc239a49 admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:58:38.758873 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0186d540-ec47-4c01-a3f9-98f7dc239a49 admin admin] PATH_INFO: `/v3/users` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:58:38.759632 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0186d540-ec47-4c01-a3f9-98f7dc239a49 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:58:38.761546 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0186d540-ec47-4c01-a3f9-98f7dc239a49 admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:58:38.786379 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 1292/2596] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Oct 30 00:58:38 2022] POST /identity/v3/users => generated 292 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 00:58:38.792166 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe615ab0-3c7e-448b-8a0b-5a6afe23e579 admin admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:58:38.806157 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe615ab0-3c7e-448b-8a0b-5a6afe23e579 admin admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:58:38.812395 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec55c21a-6c1e-4a7e-9ebf-5d48784617c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:58:38.813000 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec55c21a-6c1e-4a7e-9ebf-5d48784617c0 admin admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:58:38.813274 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec55c21a-6c1e-4a7e-9ebf-5d48784617c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:58:38.813525 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec55c21a-6c1e-4a7e-9ebf-5d48784617c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:58:38.814222 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec55c21a-6c1e-4a7e-9ebf-5d48784617c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:58:38.815896 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec55c21a-6c1e-4a7e-9ebf-5d48784617c0 admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:58:38.826999 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 1305/2597] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 30 00:58:38 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 00:58:38.831368 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0186d540-ec47-4c01-a3f9-98f7dc239a49 admin admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:58:38.842642 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0186d540-ec47-4c01-a3f9-98f7dc239a49 admin admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:58:38.848490 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cf0524-1de3-4885-a819-270cf057a6d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:58:38.849261 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cf0524-1de3-4885-a819-270cf057a6d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:58:38.849538 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cf0524-1de3-4885-a819-270cf057a6d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:58:38.849806 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cf0524-1de3-4885-a819-270cf057a6d7 admin admin] PATH_INFO: `/v3/projects/435570c40bf5499d92ef0d01c331d368/users/5826dbac667e4cad965cc0db77cc6fb9/roles/6ccaa8c11f29456fb4e4eeccb21616c7` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:58:38.866447 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73cf0524-1de3-4885-a819-270cf057a6d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=435570c40bf5499d92ef0d01c331d368, user_id=5826dbac667e4cad965cc0db77cc6fb9, role_id=6ccaa8c11f29456fb4e4eeccb21616c7)` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:58:38.869147 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73cf0524-1de3-4885-a819-270cf057a6d7 admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:58:38.884759 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 1293/2598] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 30 00:58:38 2022] PUT /identity/v3/projects/435570c40bf5499d92ef0d01c331d368/users/5826dbac667e4cad965cc0db77cc6fb9/roles/6ccaa8c11f29456fb4e4eeccb21616c7 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 00:58:38.889080 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec55c21a-6c1e-4a7e-9ebf-5d48784617c0 admin admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:58:38.899120 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec55c21a-6c1e-4a7e-9ebf-5d48784617c0 admin admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:58:38.951514 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:58:38.958380 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf86392-afcc-461e-800d-556a1af81e5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:58:38.959338 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf86392-afcc-461e-800d-556a1af81e5e admin admin] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:58:38.959663 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf86392-afcc-461e-800d-556a1af81e5e admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:58:38.960118 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf86392-afcc-461e-800d-556a1af81e5e admin admin] PATH_INFO: `/v3/roles` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:58:38.960804 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf86392-afcc-461e-800d-556a1af81e5e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:58:38.962456 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf86392-afcc-461e-800d-556a1af81e5e admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:58:38.972731 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 1306/2599] 10.222.0.42 () {58 vars in 1122 bytes} [Sun Oct 30 00:58:38 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 00:58:38.976937 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cf0524-1de3-4885-a819-270cf057a6d7 admin admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:58:38.987314 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cf0524-1de3-4885-a819-270cf057a6d7 admin admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:58:38.992105 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dac3c36-c392-4783-a178-468c6d97b87a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:58:38.992760 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dac3c36-c392-4783-a178-468c6d97b87a admin admin] REQUEST_METHOD: `PUT` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:58:38.993030 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dac3c36-c392-4783-a178-468c6d97b87a admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:58:38.993296 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dac3c36-c392-4783-a178-468c6d97b87a admin admin] PATH_INFO: `/v3/projects/435570c40bf5499d92ef0d01c331d368/users/5826dbac667e4cad965cc0db77cc6fb9/roles/6ccaa8c11f29456fb4e4eeccb21616c7` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:58:38.995227 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dac3c36-c392-4783-a178-468c6d97b87a admin admin] RBAC: Authorizing `identity:create_grant(project_id=435570c40bf5499d92ef0d01c331d368, user_id=5826dbac667e4cad965cc0db77cc6fb9, role_id=6ccaa8c11f29456fb4e4eeccb21616c7)` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:58:38.997916 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dac3c36-c392-4783-a178-468c6d97b87a admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:58:39.010217 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 1294/2600] 10.222.0.42 () {60 vars in 1483 bytes} [Sun Oct 30 00:58:38 2022] PUT /identity/v3/projects/435570c40bf5499d92ef0d01c331d368/users/5826dbac667e4cad965cc0db77cc6fb9/roles/6ccaa8c11f29456fb4e4eeccb21616c7 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 00:58:43.351496 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269e8eb2-5662-4af7-8ff4-078acbad58f7 None None] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:58:43.352339 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269e8eb2-5662-4af7-8ff4-078acbad58f7 None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:58:43.352822 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269e8eb2-5662-4af7-8ff4-078acbad58f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:58:43.387495 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.auth.core [None req-269e8eb2-5662-4af7-8ff4-078acbad58f7 None None] MFA Rules not processed for user `5826dbac667e4cad965cc0db77cc6fb9`. Rule list: `[]` (Enabled: `True`). {{(pid=87956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:58:43.388735 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-269e8eb2-5662-4af7-8ff4-078acbad58f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:58:43.469408 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 1307/2601] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 30 00:58:43 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:58:43.483626 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dac3c36-c392-4783-a178-468c6d97b87a admin admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:58:43.485383 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-4dac3c36-c392-4783-a178-468c6d97b87a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:58:43.509920 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:58:43.586061 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dac3c36-c392-4783-a178-468c6d97b87a admin admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:58:43.594527 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25b1751-0191-4264-b46d-1e419daf5a39 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fde877b6ddc74f4a87baf21471eb31d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d2387fdf794d4eaef07bbcd7b39f2a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:58:43.595327 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25b1751-0191-4264-b46d-1e419daf5a39 service nova] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:58:43.595733 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25b1751-0191-4264-b46d-1e419daf5a39 service nova] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:58:43.596123 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25b1751-0191-4264-b46d-1e419daf5a39 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:58:43.658269 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25b1751-0191-4264-b46d-1e419daf5a39 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:58:43.660423 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25b1751-0191-4264-b46d-1e419daf5a39 service nova] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:58:43.673421 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 1295/2602] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 30 00:58:43 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 00:58:44.688495 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b54f468-bec1-4c5d-915a-c0bed552da96 None None] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:58:44.689074 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b54f468-bec1-4c5d-915a-c0bed552da96 None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:58:44.689074 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b54f468-bec1-4c5d-915a-c0bed552da96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:58:44.710108 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.auth.core [None req-1b54f468-bec1-4c5d-915a-c0bed552da96 None None] MFA Rules not processed for user `3a645c34c01f480ab20308cd8fb1fc01`. Rule list: `[]` (Enabled: `True`). {{(pid=87956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:58:44.711400 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-1b54f468-bec1-4c5d-915a-c0bed552da96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:58:44.719160 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 1308/2603] 10.222.0.42 () {58 vars in 958 bytes} [Sun Oct 30 00:58:44 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 00:58:53.667964 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=50 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:58:54.703597 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=40 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:58:59.741265 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25b1751-0191-4264-b46d-1e419daf5a39 service nova] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:58:59.742786 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-d25b1751-0191-4264-b46d-1e419daf5a39 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:58:59.815167 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25b1751-0191-4264-b46d-1e419daf5a39 service nova] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:58:59.821018 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed03a02-0330-4b67-a018-c3c06aafe92a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '202b8b2c0f454297bfb97c1ac4033625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d2387fdf794d4eaef07bbcd7b39f2a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:58:59.821625 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed03a02-0330-4b67-a018-c3c06aafe92a service placement] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:58:59.821902 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed03a02-0330-4b67-a018-c3c06aafe92a service placement] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:58:59.822173 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed03a02-0330-4b67-a018-c3c06aafe92a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:58:59.824066 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-fed03a02-0330-4b67-a018-c3c06aafe92a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:58:59.836044 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed03a02-0330-4b67-a018-c3c06aafe92a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:58:59.837673 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed03a02-0330-4b67-a018-c3c06aafe92a service placement] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:58:59.847630 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 1296/2604] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 30 00:58:59 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 00:59:01.918393 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b54f468-bec1-4c5d-915a-c0bed552da96 None None] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:59:01.980541 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b54f468-bec1-4c5d-915a-c0bed552da96 None None] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:59:01.984261 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b803714-9c1a-4f48-9344-388703a1e59c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5693f186c6ad4d9394f02ee3477cdcd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d2387fdf794d4eaef07bbcd7b39f2a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:59:01.984889 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b803714-9c1a-4f48-9344-388703a1e59c service neutron] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:59:01.985167 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b803714-9c1a-4f48-9344-388703a1e59c service neutron] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:59:01.985436 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b803714-9c1a-4f48-9344-388703a1e59c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:59:01.987663 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-2b803714-9c1a-4f48-9344-388703a1e59c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:59:01.999561 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b803714-9c1a-4f48-9344-388703a1e59c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:59:02.001005 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b803714-9c1a-4f48-9344-388703a1e59c service neutron] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:59:02.010544 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 1309/2605] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 30 00:59:01 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 00:59:09.735915 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed03a02-0330-4b67-a018-c3c06aafe92a service placement] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:59:09.737674 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-fed03a02-0330-4b67-a018-c3c06aafe92a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:59:09.750614 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed03a02-0330-4b67-a018-c3c06aafe92a service placement] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:59:09.755029 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a607bf51-6f17-420f-99b0-d79fcae65b7f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5693f186c6ad4d9394f02ee3477cdcd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d2387fdf794d4eaef07bbcd7b39f2a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:59:09.755650 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a607bf51-6f17-420f-99b0-d79fcae65b7f service neutron] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:59:09.755935 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a607bf51-6f17-420f-99b0-d79fcae65b7f service neutron] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:59:09.756207 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a607bf51-6f17-420f-99b0-d79fcae65b7f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:59:09.765561 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a607bf51-6f17-420f-99b0-d79fcae65b7f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:59:09.766980 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a607bf51-6f17-420f-99b0-d79fcae65b7f service neutron] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:59:09.776668 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 1297/2606] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 30 00:59:09 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 00:59:12.005842 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=26 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:59:19.772365 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=38 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:01:22.073190 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b803714-9c1a-4f48-9344-388703a1e59c service neutron] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:01:22.082588 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b803714-9c1a-4f48-9344-388703a1e59c service neutron] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:01:22.086653 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf2c969-a770-4b2e-8fc6-bf420bacc345 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5693f186c6ad4d9394f02ee3477cdcd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d2387fdf794d4eaef07bbcd7b39f2a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:01:22.087245 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf2c969-a770-4b2e-8fc6-bf420bacc345 service neutron] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:01:22.087556 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf2c969-a770-4b2e-8fc6-bf420bacc345 service neutron] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:01:22.087826 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf2c969-a770-4b2e-8fc6-bf420bacc345 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:01:22.089770 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-ccf2c969-a770-4b2e-8fc6-bf420bacc345 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:01:22.099873 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf2c969-a770-4b2e-8fc6-bf420bacc345 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:01:22.101314 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf2c969-a770-4b2e-8fc6-bf420bacc345 service neutron] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:01:22.109653 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 1310/2607] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 30 01:01:22 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:01:22.242516 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5638e8-fffc-4cbb-9b78-b75b3d9f13e3 None None] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:01:22.243124 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5638e8-fffc-4cbb-9b78-b75b3d9f13e3 None None] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:01:22.243124 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5638e8-fffc-4cbb-9b78-b75b3d9f13e3 None None] PATH_INFO: `/` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:01:22.244424 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 1298/2608] 10.222.0.42 () {54 vars in 921 bytes} [Sun Oct 30 01:01:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 30 01:01:22.250309 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed81cf3-7b9c-4a7e-aac1-9b2a3a2ae154 None None] REQUEST_METHOD: `POST` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:01:22.250809 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed81cf3-7b9c-4a7e-aac1-9b2a3a2ae154 None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:01:22.251131 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed81cf3-7b9c-4a7e-aac1-9b2a3a2ae154 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:01:22.289962 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.auth.core [None req-1ed81cf3-7b9c-4a7e-aac1-9b2a3a2ae154 None None] MFA Rules not processed for user `5693f186c6ad4d9394f02ee3477cdcd3`. Rule list: `[]` (Enabled: `True`). {{(pid=87956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:01:22.291190 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-1ed81cf3-7b9c-4a7e-aac1-9b2a3a2ae154 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:01:22.298150 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 1311/2609] 10.222.0.42 () {58 vars in 1018 bytes} [Sun Oct 30 01:01:22 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:01:22.310515 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5638e8-fffc-4cbb-9b78-b75b3d9f13e3 None None] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:01:22.321619 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5638e8-fffc-4cbb-9b78-b75b3d9f13e3 None None] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:01:22.325027 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe66712a-6e6f-4edb-83a6-aec285980962 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5693f186c6ad4d9394f02ee3477cdcd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d2387fdf794d4eaef07bbcd7b39f2a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:01:22.325612 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe66712a-6e6f-4edb-83a6-aec285980962 service neutron] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:01:22.325886 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe66712a-6e6f-4edb-83a6-aec285980962 service neutron] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:01:22.326192 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe66712a-6e6f-4edb-83a6-aec285980962 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:01:22.333748 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe66712a-6e6f-4edb-83a6-aec285980962 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:01:22.335448 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe66712a-6e6f-4edb-83a6-aec285980962 service neutron] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:01:22.343477 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 1299/2610] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 30 01:01:22 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 30 01:01:22.430182 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fd0e27-1c19-4ecd-8e17-7f853c2712da None None] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:01:22.430493 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fd0e27-1c19-4ecd-8e17-7f853c2712da None None] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:01:22.430762 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fd0e27-1c19-4ecd-8e17-7f853c2712da None None] PATH_INFO: `/` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:01:22.432201 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 1312/2611] 10.222.0.42 () {54 vars in 921 bytes} [Sun Oct 30 01:01:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 01:01:22.439111 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cf677a-efb2-481f-aacd-7714cc251db7 None None] REQUEST_METHOD: `POST` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:01:22.439423 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cf677a-efb2-481f-aacd-7714cc251db7 None None] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:01:22.439703 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cf677a-efb2-481f-aacd-7714cc251db7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:01:22.478918 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.auth.core [None req-73cf677a-efb2-481f-aacd-7714cc251db7 None None] MFA Rules not processed for user `fde877b6ddc74f4a87baf21471eb31d2`. Rule list: `[]` (Enabled: `True`). {{(pid=87955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:01:22.480075 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-73cf677a-efb2-481f-aacd-7714cc251db7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:01:22.489958 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 1300/2612] 10.222.0.42 () {58 vars in 1018 bytes} [Sun Oct 30 01:01:22 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:01:22.501672 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fd0e27-1c19-4ecd-8e17-7f853c2712da None None] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:01:22.513675 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fd0e27-1c19-4ecd-8e17-7f853c2712da None None] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:01:22.517449 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c386f9-b2e0-47d6-82cb-933446b7d0c0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5693f186c6ad4d9394f02ee3477cdcd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d2387fdf794d4eaef07bbcd7b39f2a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:01:22.518047 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c386f9-b2e0-47d6-82cb-933446b7d0c0 service neutron] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:01:22.518318 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c386f9-b2e0-47d6-82cb-933446b7d0c0 service neutron] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:01:22.518589 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c386f9-b2e0-47d6-82cb-933446b7d0c0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:01:22.528571 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c386f9-b2e0-47d6-82cb-933446b7d0c0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:01:22.530126 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c386f9-b2e0-47d6-82cb-933446b7d0c0 service neutron] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:01:22.540618 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 1313/2613] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 30 01:01:22 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:01:23.570785 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cf677a-efb2-481f-aacd-7714cc251db7 None None] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:01:23.572319 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-73cf677a-efb2-481f-aacd-7714cc251db7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:01:23.588397 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cf677a-efb2-481f-aacd-7714cc251db7 None None] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:01:23.594463 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fc5f2c-26a2-4556-ae60-01fdf5c268d6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fde877b6ddc74f4a87baf21471eb31d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d2387fdf794d4eaef07bbcd7b39f2a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:01:23.595102 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fc5f2c-26a2-4556-ae60-01fdf5c268d6 service nova] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:01:23.595403 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fc5f2c-26a2-4556-ae60-01fdf5c268d6 service nova] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:01:23.595671 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fc5f2c-26a2-4556-ae60-01fdf5c268d6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:01:23.597360 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-42fc5f2c-26a2-4556-ae60-01fdf5c268d6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:01:23.610179 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fc5f2c-26a2-4556-ae60-01fdf5c268d6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:01:23.612030 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fc5f2c-26a2-4556-ae60-01fdf5c268d6 service nova] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:01:23.623112 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 1301/2614] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 30 01:01:23 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:01:32.536235 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=21 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:01:33.618508 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=21 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:02:36.044068 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c386f9-b2e0-47d6-82cb-933446b7d0c0 service neutron] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:02:36.046349 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-38c386f9-b2e0-47d6-82cb-933446b7d0c0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:02:36.064083 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c386f9-b2e0-47d6-82cb-933446b7d0c0 service neutron] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:02:36.070481 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55438d85-379e-4757-827c-e6258b240691 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '202b8b2c0f454297bfb97c1ac4033625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d2387fdf794d4eaef07bbcd7b39f2a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:02:36.071077 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55438d85-379e-4757-827c-e6258b240691 service placement] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:02:36.071389 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55438d85-379e-4757-827c-e6258b240691 service placement] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:02:36.071657 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55438d85-379e-4757-827c-e6258b240691 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:02:36.074331 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-55438d85-379e-4757-827c-e6258b240691 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:02:36.092691 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55438d85-379e-4757-827c-e6258b240691 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:02:36.094537 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55438d85-379e-4757-827c-e6258b240691 service placement] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:02:36.104919 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 1314/2615] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 30 01:02:36 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:02:46.100607 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=6 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:02:48.237236 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fc5f2c-26a2-4556-ae60-01fdf5c268d6 service nova] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:02:48.255434 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fc5f2c-26a2-4556-ae60-01fdf5c268d6 service nova] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:02:48.262452 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37a7794-6895-4566-a89b-49790ba21d1a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fde877b6ddc74f4a87baf21471eb31d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d2387fdf794d4eaef07bbcd7b39f2a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:02:48.263448 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37a7794-6895-4566-a89b-49790ba21d1a service nova] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:02:48.263975 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37a7794-6895-4566-a89b-49790ba21d1a service nova] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:02:48.264462 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37a7794-6895-4566-a89b-49790ba21d1a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:02:48.266701 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-d37a7794-6895-4566-a89b-49790ba21d1a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:02:48.281525 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37a7794-6895-4566-a89b-49790ba21d1a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:02:48.283428 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37a7794-6895-4566-a89b-49790ba21d1a service nova] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:02:48.296779 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 1302/2616] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 30 01:02:48 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:02:51.660535 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55438d85-379e-4757-827c-e6258b240691 service placement] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:02:51.673503 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55438d85-379e-4757-827c-e6258b240691 service placement] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:02:51.679898 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ac09fb-7aaf-4756-8808-179d4ec783d9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fde877b6ddc74f4a87baf21471eb31d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d2387fdf794d4eaef07bbcd7b39f2a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:02:51.680509 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ac09fb-7aaf-4756-8808-179d4ec783d9 service nova] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:02:51.680789 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ac09fb-7aaf-4756-8808-179d4ec783d9 service nova] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:02:51.681062 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ac09fb-7aaf-4756-8808-179d4ec783d9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:02:51.683326 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-78ac09fb-7aaf-4756-8808-179d4ec783d9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:02:51.697785 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ac09fb-7aaf-4756-8808-179d4ec783d9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:02:51.699404 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ac09fb-7aaf-4756-8808-179d4ec783d9 service nova] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:02:51.710240 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 1315/2617] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 30 01:02:51 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:02:55.981602 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37a7794-6895-4566-a89b-49790ba21d1a service nova] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:02:55.994783 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37a7794-6895-4566-a89b-49790ba21d1a service nova] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:02:56.000288 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a32b0f-c7f9-44bf-8f84-57b9e90a9eef service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '202b8b2c0f454297bfb97c1ac4033625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d2387fdf794d4eaef07bbcd7b39f2a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:02:56.000979 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a32b0f-c7f9-44bf-8f84-57b9e90a9eef service placement] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:02:56.001256 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a32b0f-c7f9-44bf-8f84-57b9e90a9eef service placement] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:02:56.001531 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a32b0f-c7f9-44bf-8f84-57b9e90a9eef service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:02:56.003740 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-49a32b0f-c7f9-44bf-8f84-57b9e90a9eef service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:02:56.016822 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a32b0f-c7f9-44bf-8f84-57b9e90a9eef service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:02:56.018410 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a32b0f-c7f9-44bf-8f84-57b9e90a9eef service placement] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:02:56.029584 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 1303/2618] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 30 01:02:55 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:02:59.423757 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ac09fb-7aaf-4756-8808-179d4ec783d9 service nova] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:02:59.445041 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ac09fb-7aaf-4756-8808-179d4ec783d9 service nova] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:02:59.451699 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6870d2a-4511-4d60-91c9-daa8bd32c7c1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '202b8b2c0f454297bfb97c1ac4033625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d2387fdf794d4eaef07bbcd7b39f2a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:02:59.452370 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6870d2a-4511-4d60-91c9-daa8bd32c7c1 service placement] REQUEST_METHOD: `GET` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:02:59.452651 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6870d2a-4511-4d60-91c9-daa8bd32c7c1 service placement] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:02:59.452924 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6870d2a-4511-4d60-91c9-daa8bd32c7c1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:02:59.455339 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-b6870d2a-4511-4d60-91c9-daa8bd32c7c1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:02:59.478196 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6870d2a-4511-4d60-91c9-daa8bd32c7c1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:02:59.479973 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6870d2a-4511-4d60-91c9-daa8bd32c7c1 service placement] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:02:59.492136 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a32b0f-c7f9-44bf-8f84-57b9e90a9eef service placement] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:02:59.495750 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 1316/2619] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 30 01:02:59 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:02:59.559941 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a32b0f-c7f9-44bf-8f84-57b9e90a9eef service placement] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:02:59.564672 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e267aaeb-146a-4f7f-b522-9294b7383e06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:02:59.565506 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e267aaeb-146a-4f7f-b522-9294b7383e06 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:02:59.565999 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e267aaeb-146a-4f7f-b522-9294b7383e06 admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:02:59.566358 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e267aaeb-146a-4f7f-b522-9294b7383e06 admin admin] PATH_INFO: `/v3/users/3a645c34c01f480ab20308cd8fb1fc01` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:02:59.568141 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e267aaeb-146a-4f7f-b522-9294b7383e06 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3a645c34c01f480ab20308cd8fb1fc01)` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:02:59.571072 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e267aaeb-146a-4f7f-b522-9294b7383e06 admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:02:59.625840 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-e267aaeb-146a-4f7f-b522-9294b7383e06 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3a645c34c01f480ab20308cd8fb1fc01'} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:02:59.626440 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-e267aaeb-146a-4f7f-b522-9294b7383e06 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3a645c34c01f480ab20308cd8fb1fc01'} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:02:59.633667 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-e267aaeb-146a-4f7f-b522-9294b7383e06 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3a645c34c01f480ab20308cd8fb1fc01'} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:02:59.634337 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-e267aaeb-146a-4f7f-b522-9294b7383e06 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3a645c34c01f480ab20308cd8fb1fc01'} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:02:59.646680 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-e267aaeb-146a-4f7f-b522-9294b7383e06 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3a645c34c01f480ab20308cd8fb1fc01'} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:02:59.660275 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 1304/2620] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 30 01:02:59 2022] DELETE /identity/v3/users/3a645c34c01f480ab20308cd8fb1fc01 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 01:02:59.841285 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6870d2a-4511-4d60-91c9-daa8bd32c7c1 service placement] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:02:59.852762 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6870d2a-4511-4d60-91c9-daa8bd32c7c1 service placement] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:02:59.913836 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd55992f-0c94-4d3e-ae43-67a34ef605a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:02:59.914461 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd55992f-0c94-4d3e-ae43-67a34ef605a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:02:59.914732 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd55992f-0c94-4d3e-ae43-67a34ef605a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:02:59.915000 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd55992f-0c94-4d3e-ae43-67a34ef605a3 admin admin] PATH_INFO: `/v3/projects/57dc1ca2f68e4fb4b469426f4645ea69` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:02:59.916153 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd55992f-0c94-4d3e-ae43-67a34ef605a3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=57dc1ca2f68e4fb4b469426f4645ea69)` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:02:59.918035 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd55992f-0c94-4d3e-ae43-67a34ef605a3 admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:02:59.965565 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-dd55992f-0c94-4d3e-ae43-67a34ef605a3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '57dc1ca2f68e4fb4b469426f4645ea69', 'request_id': 'req-dd55992f-0c94-4d3e-ae43-67a34ef605a3'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:02:59.973221 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-dd55992f-0c94-4d3e-ae43-67a34ef605a3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '57dc1ca2f68e4fb4b469426f4645ea69', 'request_id': 'req-dd55992f-0c94-4d3e-ae43-67a34ef605a3'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:02:59.979604 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-dd55992f-0c94-4d3e-ae43-67a34ef605a3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '57dc1ca2f68e4fb4b469426f4645ea69', 'request_id': 'req-dd55992f-0c94-4d3e-ae43-67a34ef605a3'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:02:59.989592 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-dd55992f-0c94-4d3e-ae43-67a34ef605a3 admin admin] The token cache is being invalidate because project 57dc1ca2f68e4fb4b469426f4645ea69 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87956) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:02:59.989875 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-dd55992f-0c94-4d3e-ae43-67a34ef605a3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:02:59.990525 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-dd55992f-0c94-4d3e-ae43-67a34ef605a3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:02:59.992066 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 1317/2621] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 30 01:02:59 2022] DELETE /identity/v3/projects/57dc1ca2f68e4fb4b469426f4645ea69 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:02:59.996196 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e267aaeb-146a-4f7f-b522-9294b7383e06 admin admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:02:59.997842 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-e267aaeb-146a-4f7f-b522-9294b7383e06 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:03:00.011869 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e267aaeb-146a-4f7f-b522-9294b7383e06 admin admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:03:00.066855 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:03:00.081217 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979d059c-623d-44b3-a246-609061efd4fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:03:00.082109 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979d059c-623d-44b3-a246-609061efd4fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:03:00.082411 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979d059c-623d-44b3-a246-609061efd4fd admin admin] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:03:00.082757 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979d059c-623d-44b3-a246-609061efd4fd admin admin] PATH_INFO: `/v3/users/5826dbac667e4cad965cc0db77cc6fb9` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:03:00.084591 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979d059c-623d-44b3-a246-609061efd4fd admin admin] RBAC: Authorizing `identity:delete_user(user_id=5826dbac667e4cad965cc0db77cc6fb9)` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:03:00.087646 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979d059c-623d-44b3-a246-609061efd4fd admin admin] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:03:00.148236 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-979d059c-623d-44b3-a246-609061efd4fd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5826dbac667e4cad965cc0db77cc6fb9'} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:03:00.148901 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-979d059c-623d-44b3-a246-609061efd4fd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5826dbac667e4cad965cc0db77cc6fb9'} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:03:00.155828 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-979d059c-623d-44b3-a246-609061efd4fd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5826dbac667e4cad965cc0db77cc6fb9'} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:03:00.156461 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-979d059c-623d-44b3-a246-609061efd4fd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5826dbac667e4cad965cc0db77cc6fb9'} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:03:00.168279 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.notifications [None req-979d059c-623d-44b3-a246-609061efd4fd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5826dbac667e4cad965cc0db77cc6fb9'} {{(pid=87955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:03:00.182917 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 1305/2622] 10.222.0.42 () {58 vars in 1224 bytes} [Sun Oct 30 01:02:59 2022] DELETE /identity/v3/users/5826dbac667e4cad965cc0db77cc6fb9 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:03:00.372922 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd55992f-0c94-4d3e-ae43-67a34ef605a3 admin admin] Authenticating user token {{(pid=87956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:03:00.377434 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.fernet_utils [None req-dd55992f-0c94-4d3e-ae43-67a34ef605a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:03:00.392749 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd55992f-0c94-4d3e-ae43-67a34ef605a3 admin admin] Validating token access rules against request {{(pid=87956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:03:00.449865 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91519878-3bcd-4de3-b0f4-596dfcbf4745 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb55b6cbca4945abb21b0e49eb745e1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39b871ca4334427a0ee2ffbee79352f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:03:00.450553 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91519878-3bcd-4de3-b0f4-596dfcbf4745 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:03:00.450728 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91519878-3bcd-4de3-b0f4-596dfcbf4745 admin admin] SCRIPT_NAME: `/identity` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:03:00.451019 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91519878-3bcd-4de3-b0f4-596dfcbf4745 admin admin] PATH_INFO: `/v3/projects/435570c40bf5499d92ef0d01c331d368` {{(pid=87956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:03:00.452175 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91519878-3bcd-4de3-b0f4-596dfcbf4745 admin admin] RBAC: Authorizing `identity:delete_project(project_id=435570c40bf5499d92ef0d01c331d368)` {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:03:00.454065 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91519878-3bcd-4de3-b0f4-596dfcbf4745 admin admin] RBAC: Authorization granted {{(pid=87956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:03:00.460795 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:03:00.504399 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-91519878-3bcd-4de3-b0f4-596dfcbf4745 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '435570c40bf5499d92ef0d01c331d368', 'request_id': 'req-91519878-3bcd-4de3-b0f4-596dfcbf4745'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:03:00.512148 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-91519878-3bcd-4de3-b0f4-596dfcbf4745 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '435570c40bf5499d92ef0d01c331d368', 'request_id': 'req-91519878-3bcd-4de3-b0f4-596dfcbf4745'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:03:00.519249 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-91519878-3bcd-4de3-b0f4-596dfcbf4745 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '435570c40bf5499d92ef0d01c331d368', 'request_id': 'req-91519878-3bcd-4de3-b0f4-596dfcbf4745'} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:03:00.529738 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-91519878-3bcd-4de3-b0f4-596dfcbf4745 admin admin] The token cache is being invalidate because project 435570c40bf5499d92ef0d01c331d368 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87956) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:03:00.530016 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-91519878-3bcd-4de3-b0f4-596dfcbf4745 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:03:00.530655 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG keystone.notifications [None req-91519878-3bcd-4de3-b0f4-596dfcbf4745 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:03:00.532252 dv-cinder-861491-6-smb devstack@keystone.service[87956]: [pid: 87956|app: 0|req: 1318/2623] 10.222.0.42 () {58 vars in 1233 bytes} [Sun Oct 30 01:03:00 2022] DELETE /identity/v3/projects/435570c40bf5499d92ef0d01c331d368 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:03:10.179682 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=29,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:03:10.527074 dv-cinder-861491-6-smb devstack@keystone.service[87956]: DEBUG dbcounter [-] [87956] Writing DB stats keystone:SELECT=22,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87956) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:07:37.968992 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979d059c-623d-44b3-a246-609061efd4fd admin admin] Authenticating user token {{(pid=87955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:07:37.970670 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-979d059c-623d-44b3-a246-609061efd4fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:07:38.132201 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979d059c-623d-44b3-a246-609061efd4fd admin admin] Validating token access rules against request {{(pid=87955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:07:38.194806 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b164dc6e-a780-4471-b08c-03a52c61b0a7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '202b8b2c0f454297bfb97c1ac4033625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d2387fdf794d4eaef07bbcd7b39f2a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:07:38.195362 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b164dc6e-a780-4471-b08c-03a52c61b0a7 service placement] REQUEST_METHOD: `GET` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:07:38.195641 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b164dc6e-a780-4471-b08c-03a52c61b0a7 service placement] SCRIPT_NAME: `/identity` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:07:38.195909 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b164dc6e-a780-4471-b08c-03a52c61b0a7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:07:38.197811 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.fernet_utils [None req-b164dc6e-a780-4471-b08c-03a52c61b0a7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:07:38.209301 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b164dc6e-a780-4471-b08c-03a52c61b0a7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:07:38.210868 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b164dc6e-a780-4471-b08c-03a52c61b0a7 service placement] RBAC: Authorization granted {{(pid=87955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:07:38.220931 dv-cinder-861491-6-smb devstack@keystone.service[87955]: [pid: 87955|app: 0|req: 1306/2624] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Oct 30 01:07:37 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 252 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:07:48.216632 dv-cinder-861491-6-smb devstack@keystone.service[87955]: DEBUG dbcounter [-] [87955] Writing DB stats keystone:SELECT=89 {{(pid=87955) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}